We want to develop in taurus new rules that do word search on a column. Knowing that Taurus Rules looks like contour and we can not use specific code on it. What is the most efficient way to implement algorithms like WordInWord, Regex or Full match ?
The question that I’m asking is that if we have effeicient ways to do this type of algorithms using Taurus Rule interface or should we think of developping new functionalities in our self-managed taurus pipeline ?
I think the path of least resistance here is to do some pre-processing in Pipeline Builder or PySpark transforms first.
You can implement your algorithms in either of these tools and produce flag column(s) like “word match.” Then, you can filter for these columns in Foundry Rules to produce your desired output.