StackOverflow Questions for Tag: dstream

Cole J Bromfield
Cole J Bromfield

Reputation: 11

Trying to apply real-time data processing to random data with Pyspark, but nothing is being generated

Score: 1

Views: 70

Answers: 0

Read More
Saurabh Agrawal
Saurabh Agrawal

Reputation: 1

spark-streaming (DStream): Does Spark stream Support pause/resume consumption of message from Kafka on runtime

Score: 0

Views: 25

Answers: 0

Read More
Muhammad Allain
Muhammad Allain

Reputation: 15

How to calculate average by category in pyspark streaming?

Score: 0

Views: 657

Answers: 2

Read More
BHC
BHC

Reputation: 77

Read Avro records from Kafka using Spark Dstreams

Score: 0

Views: 156

Answers: 1

Read More
biodegradablecoder
biodegradablecoder

Reputation: 1

How to setup a python feeder to connect to a Spark Dstream

Score: 0

Views: 26

Answers: 0

Read More
Y0gesh Gupta
Y0gesh Gupta

Reputation: 2204

mock input dstream apache spark

Score: 4

Views: 1179

Answers: 1

Read More
p3zo
p3zo

Reputation: 61

merge spark dStream with variable to saveToCassandra()

Score: 1

Views: 618

Answers: 3

Read More
tripityCoder
tripityCoder

Reputation: 11

Lambda function to groupby first substring?

Score: 1

Views: 74

Answers: 0

Read More
user9920500
user9920500

Reputation: 705

How to generate a DStream from RateStreamSource in Spark

Score: 0

Views: 93

Answers: 1

Read More
Danilo Rodrigues
Danilo Rodrigues

Reputation: 413

Why can I convert a DStream[String] to DStream[List[String]] but not to DStream[DataFrame]?

Score: 0

Views: 109

Answers: 0

Read More
ggagliano
ggagliano

Reputation: 1084

Spark Streaming in Standalone Cluster takes the same Kafka message more than once

Score: 0

Views: 142

Answers: 0

Read More
Prince Kumar Sharma
Prince Kumar Sharma

Reputation: 12641

Read Nested JSON Data in DStrem in pyspark

Score: 2

Views: 106

Answers: 1

Read More
Saif Nitham
Saif Nitham

Reputation: 11

Get Max & Min value for each key in the RDD

Score: 1

Views: 3646

Answers: 2

Read More
Yasin boloorchi
Yasin boloorchi

Reputation: 51

count number of elements in each pyspark Dstream

Score: 0

Views: 305

Answers: 1

Read More
voldy
voldy

Reputation: 387

Unable to manually commit offset in kafka direct stream, Spark streaming

Score: 3

Views: 1534

Answers: 2

Read More
Koenig Lear
Koenig Lear

Reputation: 2436

ConstantInputDStream.print() does nothing

Score: 0

Views: 93

Answers: 0

Read More
maxlandauer
maxlandauer

Reputation: 3

Spark never stops processing first batch

Score: 0

Views: 422

Answers: 1

Read More
alex
alex

Reputation: 2253

Spark Streaming tuning number of records per batch size not working?

Score: 2

Views: 6313

Answers: 2

Read More
Daniel Carretero
Daniel Carretero

Reputation: 3

DStream to Rdd in Spark-Straming

Score: 0

Views: 141

Answers: 1

Read More
sunnydev
sunnydev

Reputation: 11

Reg: Parallelizing RDD partitions in Spark executors

Score: 1

Views: 58

Answers: 0

Read More
PreviousPage 1Next