Dynamic list of input datasets write to a single output dataset

I will like to retrieve the set of dataset rids that are stored in a column from dataset A → as a list → dynamically input as input rid in the decorator parameters @transform(Input0=rid0, Input1=rid1, Input2=rid2…, output=dataset B) on the compute().

Please advise the recommended way to do it on python transforms code repository

1 Like

Hello Saberwong,

I’m sorry to say that it is not possible to have dynamic inputs based upon data. All inputs must be defined at CI time. One could define them in a file within the code repo, and read from that file what the inputs are. This file must be added manually or via an external git process.

1 Like

I see. got it. thank you