Syncing GitHub code over to Foundry

Hi all, is it currently possible to connect to a private enterprise GitHub, and sync some python files over to a code repository in Foundry?

Noticed that the GH connector only supports agent worker connectivity (direct connection is out of the question because it’s not publicly accessible), but agent worker connections cannot be imported into a Code Repository, only agent proxy connections (which are only supported for REST API connections?)

Do let me know if there’s an easier way to do this and there’s something I’m missing, thanks!

You should be able to use a Rest API Source with Agent proxy to connect to your GH Enterprise host. This will allow you do to calls against the GH Rest API.

The GH Connector is likely a wrapped CDATA driver (which connects to the same APIs as above) and those do not support agent proxy.

Taking a step back - is your ultimate goal to use the code in foundry transforms, or do you want to ingest the code to mirror it into the ontology?

1 Like

The goal here would be to use the code in foundry transforms - e.g. best case scenario would be the ability to connect to a remote repository and do something like ‘from X import Y’ in the code repositories python transform file

In that case I would recommend to mirror the code into a foundry artifacts repository from where it can be used in transforms.

You could wrap the the code as pypi or conda package and write an external transform that pulls the code/finished package from GH Enterprise and uploads to the artifacts repository using a foundry token.

1 Like