Can I use External Transform with a Generic Source with an Agent Proxy?

Ask the Community
1

I would like to use a source-based external transform, through an Agent Proxy, to some on-prem system. It’s not a REST API, but a JDBC/ODBC connection, hence use sockets behind the hood to connect to the source system.

Is it possible to use external transform with a Generic source, to use it via the Agent proxy ?

It seems I can limit what the agent can access by using the agent allowlist
https://www.palantir.com/docs/foundry/data-connection/agent-proxy-runtime/#agent-allowlist-local-file

1 Like
2

You can use the Agent Proxy with the Generic Source and there will be no network security enforcement unless you opt in to the allowlist specified in Foundry or in the local file as you indicated.

The way you would have to use it is via the “create_socket(<target_host>, <target_port>” method on the Source in external transforms.

We are working towards adding the ability to transparently network via the Agent Proxy (so you will be magically tunneled into the Agent’s network), but currently the only way to use it outside of the REST API Source is to manually handle sockets.

3

Hi @ealvarez,

Thanks for this update around this isssue. Would you mind explaining a bit more about the ability with code snippets to implement a data pull/push to a system like using an ABFS connector through a Proxy Agent ? Or if it is through a REST API data connector how to manage a data push to an Azure Storage account while using external systems ?

Thanks