CODEWITHSUNDEEP
scalaapache-sparksbt
Georg Heiler
Georg Heiler

Reputation: 17724

Sbt console run from different package

I am curious if there is any possibility to tell the sbt console paste command to execute in a specific package.

So far I read about using :paste -raw but that did not do the trick.

My problem is due to the nice use of sparks default parameters writable which are only internally available in sparks private API I choose to place my custom estimator into sparks namespace. This works fine when run locally but the great and interactive experience of the scala repl is sort of destroyed as I cannot run my estimator which resides in organizing.apache.spark.ml

Upvotes: 2

Views: 72

Answers (1)

TheM00s3
TheM00s3

Reputation: 3711

One option is to take your estimator, use sbt assembly to turn it into a jar and then to upload that jar when you run a spark shell or run with spark-submit. Is there a reason why you need to use the spark namespace? Why not use your own name space?

Upvotes: 1

Related Questions