How to convert spark response to JSON object

Question

val conf = new SparkConf().setAppName("test").setMaster("local")
val sc = new SparkContext(conf)
val sqlContext = new SQLContext(sc)
val input = sqlContext.read.json("input.json")
input.select("email", "first_name").where("email=='donny54@yahoo.com'").show()

I am getting following response

How can I get response as a JSON Object?

Answer 1

You can write it to Json File : https://www.tutorialkart.com/apache-spark/spark-write-dataset-to-json-file-example/

Or if you prefer to show it as a Dataset of Json Strings, use the toJSON function :

input
  .select("email", "first_name")
  .where("email=='donny54@yahoo.com'")
  .toJSON()
  .show()