Filter files in Foundry dataset based on row dataset

Ask the Community
,
1

I have a dataset which is the sync output of an SFTP crawler. I only want to process certain files, and have an auxiliary row level dataset which contains the paths of the files I want to process.

Normally, an inner join on the filepath would do the trick, however calling dataframe.filesystem().files() and then joining will throw a object does not have an attribute _jdf error.

How does one do this?

2

The dataframe on the left side of the join is fine, make sure you are calling .dataframe() on the one you are trying to join with.