aws-s3 | Is there a server-side filter for aws-cli?

Question

I am trying to get some stats from a large bucket (90TB~) about last modified timestamp and some searches (ad hoc based on some keys/prefix). Based on https://aws.amazon.com/s3/pricing/, there is a cost for list request, so approaches like pagination or even --query (seems like it is client-side filter) are not eligible for this problem based on the amount of calls ($0.005 per 1,000 requests) that are going to be required for each filter.

Do we have a server-side filter that we can use with parameters as search criteria and only returning filtered-data?

Answer 1

This sounds like an excellent use-case for using Amazon S3 Inventory.

It can provide a daily file containing a list of all objects and their metadata.