Best practices for bulk decryption using Cipher in Functions: Handling timeouts and API limits

Ask the Community
,
1

Hi everyone,

I am currently working with Palantir Cipher and attempting to decrypt sensitive data within a Functions (Python & typescript v1) repository, following the official documentation.

The Challenge:
I need to decrypt approximately tens of thousands of records. When I use decryptAsync() on each record individually, the Function fails due to execution time limits (timeouts) and other internal errors.

My Questions:

  1. Is there a specific rate limit or a maximum number of calls allowed for the Cipher API within a single Function execution?

  2. Is there a way to perform “bulk decryption” on a specific column/property within Functions, rather than iterating through records one by one?

  3. If processing this volume in Functions is not recommended, what is the best practice for handling large-scale decryption while maintaining security (e.g., using Restricted Views or Batch Pipelines)?

I would appreciate any insights or code snippets on how to handle large datasets with Cipher efficiently.

Thanks in advance!