CODEWITHSUNDEEP
scalaapache-sparkamazon-sqs
Philip K. Adetiloye
Philip K. Adetiloye

Reputation: 3270

Write to AWS SQS queue using Spark

Is there any way to stream or write data to Amazon SQS queue from Spark using a library?

There is nothing listed on the Spark packages.

What things can I try?

Upvotes: 5

Views: 4728

Answers (2)

Fabio
Fabio

Reputation: 3120

I wrote a small library to write a dataframe to SQS

https://github.com/fabiogouw/spark-aws-messaging

Upvotes: 1

Jeffrey Chung
Jeffrey Chung

Reputation: 19497

One idea is to use Alpakka's SQS connector, which is built on Akka Streams.

Upvotes: 2

Related Questions