I’m trying to use the Vega board in Quiver to plot a bar chart with a threshold line (as offered in the template), but it looks like the object set feeding into it can only have a maximum of 50k objects. I see that the bar plot chart works fine at a higher scale (even in the millions) however, though it doesn’t meet my needs.
What options do I have for generating Vega charts with more than 50k objects, that ideally don’t require creating additional ontology entities? I don’t seem to be able to use transform tables either.
The 50k objects limit isn’t exactly on Vega charts: Vega plots accept data from transform tables which have a limit of 50k rows.
If you want to plot a bar chart, I imagine that you run an aggregation in the Vega plot configuration, such as counting different values of a grouped by property. You could do this aggregation upstream of the transform table instead: in an expression materialization card, you would define the same aggregation, and then feed this smaller number of rows to the transform table, instead of all objects.
Transform tables and Vega plots load all the data into the browser, so there are scale limitations compared to other cards. As @comew mentioned, we recommend filtering or pre-aggregate the data before feeding it into Vega, using cards of “Object set” or “Materializations” data types.