CODEWITHSUNDEEP
apache-sparkpysparkdatabricks
Karthikeyan Rasipalay Durairaj
Karthikeyan Rasipalay Durairaj

Reputation: 2334

Databricks Timestamp format - How to find exact format?

When I tried to display the date column from pyspark dataframe through show() and display(dataframe) ,those format of the data columns are different . Now how do we arrive which date format is being there in dataframe ?

Display : 2018-02-15T06:47:19.000+0000

show : 2018-02-15 06:47:19

enter image description here

Upvotes: 2

Views: 914

Answers (1)

Alex Ott
Alex Ott

Reputation: 87369

Timestamp in dataframe isn't stored as a string - it's stored using internal representation (Long in case of timestamp) that is then converted into text by show or display.

Upvotes: 1

Related Questions