QUESTION

Am I able to import compressed data, such as ZST formatted files from an S3 bucket? Is it possible to ingest a compressed CSV from S3 into a Lookup Table?

ANSWER

For S3 and GCS transports, Panther supports ingesting compressed data in Gzip and Zstd formats. Please see the documentation for more information: Ingesting compressed data in Panther.

You can set up a Lookup Table to read from an S3 object (CSV in this case) if the S3 object is Gzip compressed.