CODEWITHSUNDEEP
jsoncsvpowerquery
user3567195
user3567195

Reputation: 449

Llimitation while converting big json into csv in Power Query Editor

I am trying to import a 150 MB JSON file into CSV. But all the rows have different number of keys. Issue is that excel find the metadata only based on the first 1000 rows and there are chances that new keys/ columns will be present after the first 1000 rows. Excel says: "Limit of 1000 scanned rows reached"

How do I handle this?

enter image description here

Upvotes: 1

Views: 1789

Answers (1)

Sergey Lossev
Sergey Lossev

Reputation: 1530

Try to solve the problem in several steps -

  1. Cut head of 0 rows and tail after 1k rows Table.FirstN/Table.Skip/Table.LastN/Table.RemoveLastN
  2. Then filter your rows
  3. Turn back to p.1 (or insert new step) and change head cut to 1k and tail to 2k
  4. Repeat

enter image description here

After all delete head and tail cuts and leave only Filter steps. It's not optimal, but works

Upvotes: 2

Related Questions