Estimate compute usage with token counts in Pipeline Builder
Token count metrics are now available for Pipeline Builder previews and trial runs that use OpenAI models. This feature provides more visibility into compute usage before deploying pipelines, giving users more control over compute usage and costs.
Use LLM node previews and downstream transforms now feature a total estimated token count when using OpenAI models. Trial runs also display the total estimated token count for the number of rows run.
The approximate token count for rows in a Use LLM node preview.
The approximate token count displayed in a trial run.
Note that token counts are not provided for cached results, since no additional tokens are used.
Learn more about Pipeline Builder previews and trial runs.