Follow up: transforms read array data

Ask the Community
,
1

Hi,

I wanted to follow up on this feature request here to see if Zarr arrays are now supported within Palantir?

In my use case, other than feasibility to use/read zarr arrays. I also needed to access control along the dimensions of the array similar to row/column level permissioning available for DataSet. I can simply upload zarr arrays possibly as a zip archive and register it as a file based DataSet. This would allow to have resource level permissioning. But I wouldn’t be able to control beyond that at dimensions/row/columns.

The idea is that this will be giant dataset where depending on the team/users we can allow access to different dimensions. Essentially, the feasibility to create restricted view from this zarr array dataset.

Does anyone know if this may be feasible or is under development?

Thanks.

2

Hey! This isn’t supported in a first class way in Pipeline Builder but I think it’s worth tagging transforms-python for a response