CODEWITHSUNDEEP
amazon-web-servicescloudamazon-athenafederated-queries
Amit Dass
Amit Dass

Reputation: 41

AWS Athena comes with Athena Federated Query

I am going through with AWS Athena Federated Query page and got to know "you can use Athena Federated Query (Preview) to query the data in place or build pipelines that extract data from multiple data sources and store them in Amazon S3."

If I have a huge data outside the AWS account , still I have to transfer data to S3 , so that I can use it in Athena?

Please share your experience guys ? Thanks

Upvotes: 0

Views: 746

Answers (3)

Mohamed Saleh
Mohamed Saleh

Reputation: 41

Do not need to transfer the data to S3. for example you can query data in DynamoDB directly with Lambda connector which is ready to use from AWS.

Just worth to mention one thing here is that Athena timeout is 30 minutes, but If you are going to use some connectors that use Lambda, keep in mind that max timeout for Lambda is 15 minutes.

Upvotes: 0

Alan Sandriman
Alan Sandriman

Reputation: 31

If I have a huge data outside the AWS account , still I have to transfer data to S3 , so that I can use it in Athena?

No, you don't need to transfer data to S3 to query it with Athena Federated Query. You can just connect your external sources and query them. However, the result of you query will always be saved on S3.

This makes it a relatively easy way to extract, transfer and load data from external sources to S3 (if you want to use it for example for other services within AWS).

With Athena Federated Query there is no need to build complicated ETL workflows anymore. Just query your external datasource and the data is in S3.

Upvotes: 3

Chris Williams
Chris Williams

Reputation: 35188

Athena has support for additional sources. Amazon provides a list of these data source connectors with documentation exactly how to implement each one.

Its worth stating that if you want Athena to be performant/secure transferring data over the internet challenges this.

Upvotes: 0

Related Questions