CODEWITHSUNDEEP
apache-sparkapache-spark-sql
dexter80
dexter80

Reputation: 75

Computing First Day of Previous Quarter in Spark SQL

How do I derive the first day of the last quarter pertaining to any given date in Spark-SQL query using the SQL API ? Few required samples are as below:

input_date | start_date
------------------------
2020-01-21 | 2019-10-01
2020-02-06 | 2019-10-01
2020-04-15 | 2020-01-01
2020-07-10 | 2020-04-01
2020-10-20 | 2020-07-01
2021-02-04 | 2020-10-01

The Quarters generally are:

1 | Jan - Mar
2 | Apr - Jun
3 | Jul - Sep
4 | Oct - Dec

Note:I am using Spark SQL v2.4.

Any help is appreciated. Thanks.

Upvotes: 0

Views: 2337

Answers (2)

Lamanus
Lamanus

Reputation: 13581

Use the date_trunc with the negation of 3 months.

df.withColumn("start_date", to_date(date_trunc("quarter", expr("input_date - interval 3 months"))))
  .show()

+----------+----------+
|input_date|start_date|
+----------+----------+
|2020-01-21|2019-10-01|
|2020-02-06|2019-10-01|
|2020-04-15|2020-01-01|
|2020-07-10|2020-04-01|
|2020-10-20|2020-07-01|
|2021-02-04|2020-10-01|
+----------+----------+

Upvotes: 2

Ed Elliott
Ed Elliott

Reputation: 6856

Personally I would create a table with the dates in from now for the next twenty years using excel or something and just reference that table.

Upvotes: 0

Related Questions