Jacek Laskowski
Reputation: 74619
When would physical operator (e.g. LocalTableScanExec) show no SQL metrics in web UI?
Compare the following structured queries and their execution plans in web UI.
I use the same dataset for two different queries.
val names = Seq("Jacek").toDF("name")
The following basic query has no SQL metrics in web UI
names.show
Surprisingly the query has number of output rows metric.
names.count
Why?
Upvotes: 1
Views: 184
Answers (0)
Related Questions
- Spark - How can get the Logical / Physical Query execution using - Thirft - Hive Interactor
- How to retrieve Metrics like Output Size and Records Written from Spark UI?
- Why is the executors entry not visible in spark web ui
- spark UI,what is the meaning of the SQL tab?
- Understanding the metrics approach for Spark
- Running Applications doesn t appear spark web Ui but runs
- Enable Spark metric in LucidWorks Fusion
- How does spark report / collect metrics
- Unable to get RecordsWritten in OutputMetrics in Spark Sql
- How to enable ExecutorAllocationManagerSource metrics in Apache Spark?