CODEWITHSUNDEEP
hivehiveqlhadoop-streaminghive-partitions
Anusha Radhakrishnan
Anusha Radhakrishnan

Reputation: 51

How to getting latest partition data from hive

I need to fetch all records from a table in hive which is having latest partitions. The table is partitioned by date,year,month eg (date=25,year=2020,month=3), likewise there will be many partitions.

The partitions are not static and it will be changing frequently. I am trying to handle of getting the latest partition in the query. Can anybody help me to write the query?

enter image description here

Upvotes: 2

Views: 3547

Answers (1)

leftjoin
leftjoin

Reputation: 38290

Try this:

select * 
  from your_table t
 where concat_ws('-',t.year,t.month,t.date) in (select max(concat_ws('-',s.year,s.month,s.date)) from your_table s)

Also read these related answers:

https://stackoverflow.com/a/59675908/2700344

https://stackoverflow.com/a/41952357/2700344

Upvotes: 1

Related Questions