CODEWITHSUNDEEP
pythonscalaapache-sparkapache-spark-mllib
poiuytrez
poiuytrez

Reputation: 22546

MLlib and pyspark features

I would like to use areaUnderROC from MLlib in Apache Spark. I am currently running Spark 1.1.0 and this function is not available in pyspark but is available in scala.

Is there a feature tracker that tracks the advancement of porting Scala apis to Python apis?

I have tried to search in the official jira but I could not find any ticket number corresponding to this.

Upvotes: 1

Views: 271

Answers (1)

zero323
zero323

Reputation: 330393

pyspark.mllib.evaluation.BinaryClassificationMetrics.areaUnderROC has been introduced in Spark 1.4.0:

from pyspark.mllib.evaluation import BinaryClassificationMetrics

scoreAndLabels = ...
BinaryClassificationMetrics(scoreAndLabels).areaUnderROC

Upvotes: 2

Related Questions