How to coalesce files in pipeline builder?

how can I coalesce files? I only see repartition (which doesn’t let me choose file count, and requires an additional shuffle)

1 Like

We have an open Feature Request about this as well, including the ability to set a custom Filename/pattern.

Maybe you can open a feature request as well!

1 Like

We have built this out and it should be available soon!

1 Like

You should be able to do this now if you search for the coalsce data block

3 Likes