Connecting to S3Tables currently fails as the Foundry S3 Endpoint Policy only allowlists “s3:…” operations and not “s3tables:…” operations as required
https://docs.aws.amazon.com/AmazonS3/latest/userguide/s3-tables-VPC.html#s3-tables-vpc-endpoint-policies
The ask is to extend the control panel S3 Bucket Policy page to add a toggle that the bucket is an s3tables bucket and based on that set the correct s3 endpoint policy.
OSError: When reading information for key ‘metadata/snap-4762344495326118176-0-0bad39e2-a996-45c1-9e7c-ea0159fa2d08.avro’ in bucket ‘f72c1234-5f0b-999b-hnz1j1dcif7wzttb8kw7g3u1oegjceuc1b–table-s3’: AWS Error ACCESS_DENIED during HeadObject operation: No response body.> raised from /home/user/repo/transforms-python/src/myproject/datasets/lightweight-transform.py:37
This should unblock reading from S3Tables with lightweight transforms and pyiceberg.