CODEWITHSUNDEEP
scalaapache-sparkdatastax-enterprise
instamynd ribble
instamynd ribble

Reputation: 31

How to import TwitterUtils library from scala

I am using DSE 4.8. I am trying to import twitterutils library by using:

import org.apache.spark.streaming.twitter.TwitterUtils

It's showing error:

object twitter is not a member of package org.apache.spark.streaming.

Please let me know how to add package so that I can stream twitter data

Upvotes: 2

Views: 508

Answers (1)

RBanerjee
RBanerjee

Reputation: 947

I think you have missed to add dependency spark-streaming-twitter.

<!-- https://mvnrepository.com/artifact/org.apache.spark/spark-streaming-twitter_2.10 -->
<dependency>
    <groupId>org.apache.spark</groupId>
    <artifactId>spark-streaming-twitter_2.10</artifactId>
    <version>1.6.1</version>
</dependency>

You can alternatively use --package option to let spark auto download the jar for you if you have internet connection.

spark-shell --packages org.apache.bahir:spark-streaming-twitter_2.11:2.1.0

** Change version of the library as per your spark(scala) version

Upvotes: 2

Related Questions