Hi @BenjaminG, I banged my head against the wall with these exact same error messages. I don’t know why this happens with transactionless media sets, and I switched to transactional media sets for this exact reason. Why are you using transactionless media sets? Would it be possible to use transactional instead?
Edit: This post linked below has my updated code that incrementally ran on 4M PDFs (took a few weeks running continuously with a build schedule that used downstream outputs as triggers until it detected no new rows, but it worked). Also potentially helpful, incremental batch size limits could be used to simplify how I batched 10K rows at a time (transactional media set transaction size limit): Limit batch size of incremental inputs
https://community.palantir.com/t/need-help-with-parallelization-when-using-filesystem/3238/8?u=joel