How can I export the full set of results from my query? Is there a limit on CSV exports from Panther Search?

QUESTION

How can I export the full set of results from my query? Is there a limit on CSV exports from Panther Search?

ANSWER

The search functionality on our platform is optimized for efficiency, which means there are certain limitations in place. The limit for CSV exports from the Panther Search page is up to 1 GB per file. If your query results exceed this limit, consider narrowing your search criteria or using filters to reduce the dataset. Alternatively, run multiple smaller exports to capture all the data.

If you wish to download the whole set of results you can use the workflows below:

Downloading Full Results Using Search

1. Perform your desired search on the Search page.

2. In the upper-right corner of the results table, click Share:

3. Select one of the menu options:

   • (If there are 1000 results or fewer) Download CSV: Downloads a CSV of the results table.

   • (If there are more than 1000 results) Generate CSV: Panther begins creating a CSV file of results (up to 1 GB) asynchronously, noted by a pop-up in the lower-left corner of your Panther Console. For more details, refer to the Sharing a Search documentation.

• Note: Data Explorer has a configured result size limit of 100MB. If your results exceed 100MB, please refer to this article for possible workarounds:📄 How to resolve Panther Data Explorer error "Result size exceeded configured limit"

Downloading Full Results Using Data Explorer

1. Perform your desired search on the Search page.

2. On the Search page, click on the Copy as SQL option. This action copies the SQL query generated by your search.

3. Open the Data Explorer.

4. Paste the copied SQL query into the query editor in Data Explorer.

5. Remove any LIMIT 999 statements from the SQL query. 

6. Execute the modified query in Data Explorer to retrieve the complete set of results.

7. Click the "Download CSV" button.

If you see a limitation on the exported CSV size, you can limit the time window of your query to include fewer results or you can use the Panther API as described below.

Downloading Full Results Using Panther API

1. Perform your desired search on the Search page.

2. On the Search page, click on the Copy as SQL option. This action copies the SQL query generated by your search.

3. Remove any LIMIT 999 statements from the SQL query. 

4. Execute your API calls, that will run your query following the steps on our Panther API documentation.