CODEWITHSUNDEEP
pentahopentaho-spoonpentaho-data-integration
Felipe N
Felipe N

Reputation: 13

Unexpected Conversion Error String to BigNumber - Pentaho DI

In using the CSV Input step on a very large file, I'm getting the following error:

2018/09/03 14:16:43 - Select values.0 - Unexpected conversion error while converting value [ID String(255)] to a BigNumber

2018/09/03 14:16:43 - Select values.0 - ID String(255) : couldn't convert string value 'L 160-168' to a big number.

I've already tried using regex for eliminating line breaks and whitespace.

Upvotes: 1

Views: 4091

Answers (1)

AlainD
AlainD

Reputation: 6356

'L 160-168' is not a number.

If it is not an error in your data (which should then be corrected by your data provider), nor an bug in your data definition, you may read the data as a String, and then change its type.

To change the type, you can use the step Select values (tab Metadata) on which you have an error handling. Alternatively, if you need to make some processing on the data, you can convert it with a Javascript value step.

If the error is in the data, it may be due to a misplaced line break or some field missing. To put your finger on the error : cut the file in two at one line before the non numeric ID. The second file should break on the first line, and the first file should read OK although the error will be on the last line.

When you know where the error is, the problem is half solved.

Upvotes: 1

Related Questions