Vadden
Reputation: 11
Should I store AWS S3 style object storage key in a database?
As described above, should I store object storage keys in database for the purpose of searching, aggregating etc.? What best practice you have?
Appreciated for any suggestions and answers.
Upvotes: 1
Views: 539
Answers (1)
Ashan
Reputation: 19728
It is a known practice to use AWS DynamoDB as a metadata store for S3 objects for searching and listing objects based on objects metadata.
However if you need full text search on objects (e.g Text files in S3) you might need to consider using an indexing service such as AWS Elastic Search. You can also use AWS Athena if the query time is not that significant.
Upvotes: 1
Related Questions
- Is Amazon S3 an object store or a key-value store?
- Storing of S3 Keys vs URLs
- Need for metadata store while storing an object
- Persisting S3 using "raw" format is a good idea or not?
- Store third party API key in S3 bucket or Dynamod DB?
- What is the closest mysql type for s3 key?
- When would you want to make s3 object keys similiar
- Best practices for storing references to AWS S3 objects in a database?
- Using Amazon S3 for image storage. Where should I store my Metadata?
- AmazonS3: is it a good idea to expose (public) key to users