For reference here is an example from a logic function that I am creating an eval suite for. Can I use the ‘array of all notes’ array as the ‘target’ evaluation parameter for the rouge_score_evaluator? essentially can variables created from transform blocks within the logic function then be used in the eval suite as parameters? I can’t find a way to reference any of them when setting up different evaluators.
Hi Noah, thanks for posting. It sounds like what you want to use is “intermediate parameters”.
If you mouse over your block, you should see a beaker icon – clicking this will allow the output of that block to be used in Evals!
For more details, see https://www.palantir.com/docs/foundry/aip-evals/intermediate-parameters/
Hi thanks for your reply. The feature of exposing outputs seems to work for me, however when I create an evaluation suite it seems to break the functionality as seen below. It states that the function outputs have changed even though I have not done anything differently. I realise this is limited context but is there anything you can suggest? The main issue is that when trying to run the suite it removes the output I tried to expose earlier and asks me to ‘accept schema changes’
For a bit more context, a part of my logic app is displayed below and the output I am trying to expose is a string as seen but I’m not sure how much that helps.
