Issues with Gemini in Pipeline - using structs results in null values - trials fail to run

Ask the Community
,
1

I’m doing some analysis of text in Pipeline builder and outputting to a struct

This works great with GPT4o(incl mini) and Claude 3.7, however trials fail to run and I get null outputs when building the pipeline with the Gemini family of models.

Also, when Gemini models are imported to pipeline at the deployment stage, I see the following error

image
image602×378 23.9 KB

Not sure if that error is related, and I’ve not encountered any issues with Gemini before trying to work with outputting structs from analysed text.

Gemini has worked fine for outputting directly to columns, ditto outputting to a struct having been fed a PDF.

Tagging @Jim for awareness.

2

Seeing the same issue; attempting to output an array of structs.

1 Like
3

Hey @Samwise_AIP and @brett.adams , investigating this. Thanks for raising the issue! Will follow up with an update once we have one.

1 Like
4

Okay a few updates.

  1. Structured outputs are not supported in Language-Model-Service right now in Gemini models. Unless its part of the prompt (i.e. nudging the model), then this is going to fail for the moment.
  2. Work to support this and get parity with Gemini models is underway, and is probably in the timeline of days → weeks. I can re-tag here once that change is complete.
  3. Can work on making that more clear to users as a stop-gap that for structured outputs, these models are not the best option.

Thanks again for the feedback, and hustling to get parity on the Gemini models here.

2 Likes
5

Thanks @Jim will sit tight and wait for feedback

Not sure if its helps but just did some testing and my PDF → Gemini → Struct pipeline works for both 1.5 Pro and 2.0 Flash, ditto Image → Gemini → Struct.

They only seem to fail with text for me.

1 Like