CODEWITHSUNDEEP
hadoophivebigdatahql
Holmes
Holmes

Reputation: 1079

Hive: How to Handle files which has delimiter in the data file?

I have the below data that needs to be insert into a hive table. The data has the default delimiter in the file. How to insert into a hive table?

10,Andrew,Man”,”ager,DE,PC
11,Arun,Manager,NJ,PC
12,Harish,Sales,NJ,MAC
13,Robert,Manager,PA,MAC
14,Laura,Engineer,PA,MAC

Thanks!

Upvotes: 0

Views: 745

Answers (2)

Saravanan Elumalai
Saravanan Elumalai

Reputation: 328

Try using CSV Serde

create table test_table(id int,...)
ROW FORMAT SERDE 'org.apache.hadoop.hive.serde2.OpenCSVSerde'
WITH SERDEPROPERTIES (
   "separatorChar" = ",",
   "quoteChar"     = "”",
   "escapeChar"    = "\\"
)

change quoteChar based on the data

Upvotes: 1

Sahil Desai
Sahil Desai

Reputation: 3696

You have two options first you can used "|" (pipe) as delimiter and then insert into a hive table otherwise you have to enclose your data fields in double quotes " ", then use the OpenCSV Serde when creating the DDL for your Hive table. Now you can query the table and Hive will correctly display the data.

Upvotes: 0

Related Questions