CODEWITHSUNDEEP
pythonamazon-web-servicesamazon-s3amazon-athenaapache-iceberg
lightyagami96
lightyagami96

Reputation: 336

Count total partition for Athena table

I have Athena and Athena Iceberg tables partitioned by multiple columns. I want to create a logic in Python script to break data if have more than 100 total partitions to insert the data without errors.

SHOW PARTITIONS table_name lists all the partitions but I need the count for them. I need it to be generic to get the count for any table.

I tried select count(*) from information_schema.__internal_partitions__ WHERE table_schema = 'db_name' AND table_name = 'table_name' but it doesn't work.

Any workarounds?

Upvotes: 1

Views: 2181

Answers (1)

Robert Kossendey
Robert Kossendey

Reputation: 7028

This works for Athena Engine V2:

SELECT count(*) from "table_name$partitions"

Upvotes: 1

Related Questions