CODEWITHSUNDEEP
amazon-s3impaladata-corruption
Cassie
Cassie

Reputation: 3099

Inconsistent state Impala

I store the data on AWS S3 which is queried by Impala. I have recently purged underlying S3 directory for the reason of data corruption. Now there is no data in Impala table (select query shows 0 results), however, when I try to truncate the table I get this error message:

CatalogException: Failed to truncate table: test_table. Table may be in a partially truncated state. CAUSED BY: FileNotFoundException: No such file or directory: s3a://dir1/dir2/test_data/test_file_07_07_2019

Seems like Impala looks for the file which is already deleted. How to resolve this inconsistent state?

Upvotes: 0

Views: 498

Answers (0)

Related Questions