CODEWITHSUNDEEP
hadoophiveparquetapache-drill
Pavel
Pavel

Reputation: 974

How to use Parquet files created using Apache Drill inside Hive

Apache Drill has a nice feature of making parquet files out of many incoming datasets, but it seems like there is not a lot of information on how to use those parquet files later on - specifically in Hive.

Is there a way for Hive to make use of those "1_0_0.parquet", etc files? Maybe create a table and load the data from parquet files or create a table and somehow place those parquet files inside hdfs so that Hive reads it?

Upvotes: 0

Views: 291

Answers (1)

hlagos
hlagos

Reputation: 7957

I have faced this problem, if you are using a Cloudera distribution, you can create the tables using impala (Impala and Hive share the metastore), it allows create tables from a parquet file. Unfortunately Hive doesn't allow this 

CREATE EXTERNAL TABLE table_from_fileLIKE PARQUET     '/user/etl/destination/datafile1.parquet'
STORED AS PARQUET
LOCATION '/user/test/destination';

Upvotes: 1

Related Questions