We are currently using file synchronization via Agent Worker.
Due to a Foundry update, the Completion strategies (deleting files after synchronization) have been discontinued, so we would like to know about alternative methods.
https://www.palantir.com/documentation/static/foundry/data-connection/file-based-syncs/#completion-strategies
Is my understanding of the alternative methods correct as follows?
(1) Creating a REST API Source
Create a REST API Source in the Foundry Data Connection app and configure the SSH connection information (hostname, port 22, SSH username, password). Register the password as a secret.
(2) Configuring Agent Proxy Egress Policy
Create an Agent Proxy Egress Policy to allow SSH communication from the Foundry Worker to the Agent Host. If the Agent Host has a private IP address, configure Host Override to allow access via the domain name.
(3) Implement File Deletion Transform
Delete files on the Agent Host via SSH
(The files to be deleted are the output of sync, which is linked via the Agent worker)
https://www.palantir.com/docs/foundry/available-connectors/directory/#example-delete-files-from-an-agent-host-via-ssh