Another question related to creating a view for deduplicating incremental data. Is there a way to change this so that i take the min value instead of the max value of the deduplicating key resolution? - We have a thread Id that comes with email data, but I want to keep always the first email of the thread, and as we are doing incremental ingests I cannot do a whole groupby to do that transformation.
Sorry, I don’t think this is in the Pipeline Builder application. Is this on the data connection screen for when you configuring the data ingest into Foundry?
This is when creating a view for deduplicating rows.
I have solved the issue by making a new variable based on the date diff between the send date and 2100 so i can deduplicate by the max of that value.
1 Like