Hi all! Has anyone worked with Hail Matrix tables? Wondering if parsing/transforming them is something we can do in Foundry.
I wanted to add a little more information. Hail (https://hail.is/docs/0.2/index.html) is a common library used for scalable genomics data analysis. There are instructions to use it with AWS EMR and Spark (here: https://aws.amazon.com/blogs/big-data/genomic-analysis-with-hail-on-amazon-emr-and-amazon-athena/) so I think it should be feasible to work with Hail within Palantir environment.
The exact feature request is essentially if we could register Hail DataSet/Matrix Tables as native Palantir’s Dataset to create restricted views and govern row/column level permissions.
If anyone has any thoughts if this may be feasible, can be developed as a new feature or anything. Please let me know.
Thanks,
Rahim.