CODEWITHSUNDEEP
jsoncsvcharacter-encodingapache-nificsvtojson
Manish Narang
Manish Narang

Reputation: 87

Apache NiFi - All the spanish characters (ñ, á, í, ó, ú) in CSV changed to question mark (?) in JSON

I've fetched the CSV file using GetFile processor where CSV have spanish characters (ñ, á, í, ó, ú and more) within the English Words. When I try to use ConvertRecord processor with controller service of JSONRecordSetWriter, it displays the JSON output having question mark instead of special characters.

What is the correct way to convert CSV records into JSON format with proper encoding?

Any response/feedback will be much appreciated.

Note: CSV File is UTF-8 encoded and fetched and read properly in NiFi.

Upvotes: 0

Views: 1507

Answers (1)

Mike Thomsen
Mike Thomsen

Reputation: 37506

If you have verified that the input is UTF-8, try this:

  1. Open $NIFI/conf/bootstrap.conf
  2. Add an argument very early in the list of arguments for -Dfile.encoding=UTF-9 to force the JVM to not use the OS's settings. This has mainly been a problem in the past with the JVM on Windows.

Upvotes: 1

Related Questions