StackOverflow Questions for Tag: dstream

Anil
Anil

Reputation: 420

How to gracefully stop a spark dStream process

Score: 0

Views: 160

Answers: 1

Read More
scalacode
scalacode

Reputation: 1106

Spark streaming error during job runtime in cluster (yarn resource manager)

Score: 6

Views: 338

Answers: 0

Read More
Jane Wayne
Jane Wayne

Reputation: 8855

Spark's socket text stream is empty

Score: 1

Views: 1097

Answers: 1

Read More
Chethan
Chethan

Reputation: 15

Join Dstream[Document] and Rdd by key Spark Scala

Score: 1

Views: 359

Answers: 1

Read More
SUNIL KUMAR C
SUNIL KUMAR C

Reputation: 61

Unable to create a dataframe from json dstream using pyspark

Score: 5

Views: 1037

Answers: 0

Read More
ak_lawati
ak_lawati

Reputation: 1

How to retrieve location when streaming twitter data using Pyspark

Score: 0

Views: 104

Answers: 1

Read More
wdmv1981
wdmv1981

Reputation: 49

Best practice for key with two values

Score: 0

Views: 216

Answers: 1

Read More
Developer87
Developer87

Reputation: 2708

Constructing window based on message timestamps in Spark DStream

Score: 1

Views: 392

Answers: 2

Read More
Sheel Pancholi
Sheel Pancholi

Reputation: 703

Kafka - Spark Streaming Integration: DStreams and Task reuse

Score: 1

Views: 210

Answers: 1

Read More
Slim AZAIZ
Slim AZAIZ

Reputation: 656

What's the difference between foreachRDD and transform in spark streaming?

Score: 0

Views: 648

Answers: 0

Read More
Ged
Ged

Reputation: 18108

Case Class within foreachRDD causes Serialization Error

Score: 0

Views: 194

Answers: 1

Read More
Ged
Ged

Reputation: 18108

Spark QueueStream never exhausted

Score: 1

Views: 321

Answers: 1

Read More
p3zo
p3zo

Reputation: 61

Spark streaming if(!rdd.partitions.isEmpty) not working

Score: 3

Views: 1092

Answers: 1

Read More
Man-Kit Yau
Man-Kit Yau

Reputation: 159

Scala Spark Streaming unit test with spark-testing-base throws error

Score: 0

Views: 442

Answers: 1

Read More
Alex
Alex

Reputation: 111

Spark Streaming Run Actions On DStream Asynchronously

Score: 0

Views: 243

Answers: 1

Read More
datawookie
datawookie

Reputation: 6574

Joining a DStream and RDD with checkpointing

Score: 3

Views: 153

Answers: 0

Read More
Dipas
Dipas

Reputation: 304

pyspark updateStateByKey fails, when calling my function

Score: 0

Views: 1008

Answers: 1

Read More
Vinayak Mishra
Vinayak Mishra

Reputation: 371

Increase number of partitions in Dstream to be greater then Kafka partitions in Direct approach

Score: 0

Views: 669

Answers: 2

Read More
steven
steven

Reputation: 683

Scala to Pyspark

Score: 3

Views: 357

Answers: 1

Read More
steven
steven

Reputation: 683

Kafka on Spark only reads realtime ingestion

Score: 0

Views: 90

Answers: 1

Read More
PreviousPage 2Next