Jolt transformation combining multiple values in an array of objects when multiple objects are in input

Question

I have a JSON input :

{
  "Name": "travel.0.0",
  "Documents": [
    {
      "Id": 6732210,
      "Name": "Passport",
      "Fields": [
        {
          "Name": "First Name",
          "Type": "text"
        }
      ],
      "Variants": [
        {
          "Name": "diplomatic_passport",
          "TrainingSamples": [
            {
              "Name": "First Name",
              "Value": "VGhlIFBPU1QsIFBVVCBhbmQgUEFUQ0ggcmVxdWVzdHMgY2FuIGhhdmUgdGhlIHJlcXVlc3QgYm9keSAocGF5bG9hZCksIHN1Y2ggYXMgSlNPTiBvciBYTUwgZGF0YS4gSW4gU3dhZ2dlciB0ZXJtcywgdGhlIHJlcXVlc3QgYm9keSBpcyBjYWxsZWQgYSBib2R5IHBhcmFtZXRlci4gVGhlcmUgY2FuIGJlIG9ubHkgb25lIGJvZHkgcGFyYW1ldGVyLCBhbHRob3VnaCB0aGUgb3BlcmF0aW9uIG1heSBoYXZlIG90aGVyIHBhcmFtZXRlcnMgKHBhdGgsIHF1ZXJ5LCBoZWFkZXIpLg==",
              "BoundingBoxes": [
                {
                  "Name": "string",
                  "Dimensions": [
                    {
                      "PageIndex": 0,
                      "Left": 0,
                      "Top": 0,
                      "Right": 0,
                      "Bottom": 0
                    }
                  ]
                }
              ]
            }
          ]
        }
      ]
    }
  ]
}

My JOLT Spec is :

[
  {
    "operation": "shift",
    "spec": {
      "Name": "ProjectName",
      "Documents": {
        "*": {
          "Name": {
            "@": ["DocumentDefinitions[#].Name", "DocumentDefinitions[#].SectionDefinitions[#].Name"]
          },
          "Variants": {
            "*": {
              "Name": "DocumentDefinitions[#].SectionDefinitions[#].VarientNames[&1]",
              "TrainingSamples": {
                "0": {
                  "Name": "DocumentDefinitions[#].SectionDefinitions[#].ImageSources[#].ImageName.",
                  "Value": "DocumentDefinitions[#].SectionDefinitions[#].ImageSources[#].ImageValue."
                }
              }
            }
          },
          "Fields": {
            "*": {
              "Name": "DocumentDefinitions[#].SectionDefinitions[#].Fields[&1].Name.",
              "Type": "DocumentDefinitions[#].SectionDefinitions[#].Fields[&1].Type."
            }
          }
        }
      }
    }
  }
]

My Output is :

{
  "ProjectName" : "travel.0.0",
  "DocumentDefinitions" : [ {
    "Name" : "Passport",
    "SectionDefinitions" : [ {
      "Name" : "Passport",
      "VarientNames" : [ "diplomatic_passport" ],
      "ImageSources" : [ {
        "ImageName" : "First Name",
        "ImageValue" : "VGhlIFBPU1QsIFBVVCBhbmQgUEFUQ0ggcmVxdWVzdHMgY2FuIGhhdmUgdGhlIHJlcXVlc3QgYm9keSAocGF5bG9hZCksIHN1Y2ggYXMgSlNPTiBvciBYTUwgZGF0YS4gSW4gU3dhZ2dlciB0ZXJtcywgdGhlIHJlcXVlc3QgYm9keSBpcyBjYWxsZWQgYSBib2R5IHBhcmFtZXRlci4gVGhlcmUgY2FuIGJlIG9ubHkgb25lIGJvZHkgcGFyYW1ldGVyLCBhbHRob3VnaCB0aGUgb3BlcmF0aW9uIG1heSBoYXZlIG90aGVyIHBhcmFtZXRlcnMgKHBhdGgsIHF1ZXJ5LCBoZWFkZXIpLg=="
      } ],
      "Fields" : [ {
        "Name" : "First Name",
        "Type" : "text"
      } ]
    } ]
  } ]
}

This output looks fine , until i have only one JSON object inside my input array of documents . However , when i put another object , it looks somewhat like this which is not desired . It is clubbing all values of both objects together as below :

{
  "ProjectName" : "travel.0.0",
  "DocumentDefinitions" : [ {
    "Name" : [ "Passport", "Passport" ],
    "SectionDefinitions" : [ {
      "Name" : [ "Passport", "Passport" ],
      "VarientNames" : [ [ "diplomatic_passport", "diplomatic_passport" ] ],
      "ImageSources" : [ {
        "ImageName" : [ "First Name", "First Name" ],
        "ImageValue" : [ "VGhlIFBPU1QsIFBVVCBhbmQgUEFUQ0ggcmVxdWVzdHMgY2FuIGhhdmUgdGhlIHJlcXVlc3QgYm9keSAocGF5bG9hZCksIHN1Y2ggYXMgSlNPTiBvciBYTUwgZGF0YS4gSW4gU3dhZ2dlciB0ZXJtcywgdGhlIHJlcXVlc3QgYm9keSBpcyBjYWxsZWQgYSBib2R5IHBhcmFtZXRlci4gVGhlcmUgY2FuIGJlIG9ubHkgb25lIGJvZHkgcGFyYW1ldGVyLCBhbHRob3VnaCB0aGUgb3BlcmF0aW9uIG1heSBoYXZlIG90aGVyIHBhcmFtZXRlcnMgKHBhdGgsIHF1ZXJ5LCBoZWFkZXIpLg==", "VGhlIFBPU1QsIFBVVCBhbmQgUEFUQ0ggcmVxdWVzdHMgY2FuIGhhdmUgdGhlIHJlcXVlc3QgYm9keSAocGF5bG9hZCksIHN1Y2ggYXMgSlNPTiBvciBYTUwgZGF0YS4gSW4gU3dhZ2dlciB0ZXJtcywgdGhlIHJlcXVlc3QgYm9keSBpcyBjYWxsZWQgYSBib2R5IHBhcmFtZXRlci4gVGhlcmUgY2FuIGJlIG9ubHkgb25lIGJvZHkgcGFyYW1ldGVyLCBhbHRob3VnaCB0aGUgb3BlcmF0aW9uIG1heSBoYXZlIG90aGVyIHBhcmFtZXRlcnMgKHBhdGgsIHF1ZXJ5LCBoZWFkZXIpLg==" ]
      } ],
      "Fields" : [ {
        "Name" : [ "First Name", "First Name" ],
        "Type" : [ "text", "text" ]
      } ]
    } ]
  } ]
}

Please suggest what changes should i do in my JOLT spec , such that each transformed object in the array , get listed as a seprate object , and not get clubbed .

Answer 1

Check this spec,

[
  {
    "operation": "shift",
    "spec": {
      "Name": "ProjectName",
      "Documents": {
        "*": {
          "Name": "DocumentDefinitions[&1].Name",
          "Variants": {
            "*": {
              "Name": "DocumentDefinitions[&3].SectionDefinitions[&1].VarientNames[]",
              "TrainingSamples": {
                "*": {
                  "Name": "DocumentDefinitions[&5].SectionDefinitions[&1].ImageSources[&1].ImageName",
                  "Value": "DocumentDefinitions[&5].SectionDefinitions[&1].ImageSources[&1].ImageValue"
                }
              }
            }
          },
          "Fields": {
            "*": {
              "Name": "DocumentDefinitions[&3].SectionDefinitions[&3].Fields[&1].Name",
              "Type": "DocumentDefinitions[&3].SectionDefinitions[&3].Fields[&1].Type"
            }
          }
        }
      }
    }
  }
]