CODEWITHSUNDEEP
sqoop
Choix
Choix

Reputation: 575

My simple sqoop export failed on map phase in the job

I am learning sqoop export and here is my command:

sqoop export -m 1 \
--connect jdbc:mysql://ms.itversity.com:3306/retail_export \
--username=<username> \
--password=<password> \
--table dep_export \
--export-dir departments_new \
--input-lines-terminated-by '\n' \
--input-fields-terminated-by '|'

This command means to export the data on hdfs to mysql but it failed for the following details:

Error: java.io.IOException: Can't export data, please check failed map task logs at org.apache.sqoop.mapreduce.TextExportMapper.map(TextExportMapper.java:122) at org.apache.sqoop.mapreduce.TextExportMapper.map(TextExportMapper.java:39) at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:146) at org.apache.sqoop.mapreduce.AutoProgressMapper.run(AutoProgressMapper.java:64) at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:787) at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341) at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:168) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1724) at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:162) Caused by: java.lang.RuntimeException: Can't parse input data: '10,physicss,2018-01-31 22:24:18.0' at dep_export.__loadFromFields(dep_export.java:316) at dep_export.parse(dep_export.java:254) at org.apache.sqoop.mapreduce.TextExportMapper.map(TextExportMapper.java:89) ... 10 more Caused by: java.lang.NumberFormatException: For input string: "10,physicss,2018-01-31 22:24:18.0" at java.lang.NumberFormatException.forInputString(NumberFormatException.java:65) at java.lang.Integer.parseInt(Integer.java:580) at java.lang.Integer.valueOf(Integer.java:766) at dep_export.__loadFromFields(dep_export.java:303) ... 12 more

Can someone help to sort it out? Thank you very much.

Upvotes: 0

Views: 1124

Answers (1)

sai harsha vardhan
sai harsha vardhan

Reputation: 72

Looks like your data is ',' delimited , try using the below

--input-fields-terminated-by ','

Upvotes: 1

Related Questions