Reputation: 73
for the following query, both Hive and Spark-SQL work fine,
but the result returned by Presto (hive connector ) has wrong encoding/decoding.
Wonders how should I set the hive connector, or presto doesn't support reading zstd?
hive table:
CREATE TABLE mydb.testtb (
mid varchar COMMENT 'mid',
day varchar
)
WITH (
external_location = 'hdfs://userx/mydb/testtb/
format = 'TEXTFILE',
partitioned_by = ARRAY['day']
)
files pointing to the HDFS are written using zstd
compression like
.../testtb/day=20221113/part-00020-63c1xxxxx000.zst
SQL
select * from mydb.testtb where day=20221113 limit 5
Upvotes: 0
Views: 111