I ran a PB build and one of transforms included using an LLM to translate title and description strings, which were not more than 1000 characters max. After the build was finished, I noticed that about 70 to 90% of the rows were not translated, and returned null. Even after doing a few re-runs, the number does go down but not to zero. Is there any way I can resolve this issue? I also heard that there is a way to rerun the build only on the null rows.
Cross posting answer from @david: You could be rate limited. Try checking the show errors box on the use llm board and it should show you why the rows failed! You can read more here: https://www.palantir.com/docs/foundry/pipeline-builder/pipeline-builder-llm/#include-errors
Just to quickly add on, you can also mark the skip recomputing rows in the UseLlm board.