@Seaport ,   Please try the below: import json def jsonize(k, v): ret = json.loads(v) ret.update({'key': k}) return ret ... rdd = reader.map(lambda x: jsonize(*x)) ...   You need to make sure your schema includes the added key column.   Cheers, André   ... View more

@Rohan44 ,   Unfortunately, I don't think there's a way to do that. What are you using to write the files to HDFS?   Cheers, André   ... View more

@Rohan44 ,   Try creating your datafile with each JSON record in a single line, like so: {"buyer":{"legalBusinessName":"test1 Company","organisationIdentifications":[{"type":"abcd","identification":"test.bb@tesr"},{"type":"TXID","identification":"12345678"}]},"supplier":{"legalBusinessName":"test Company","organisationIdentifications":[{"type":"abcd","identification":"test28@test"}]},"paymentRecommendationId":"1234-5678-9876-2212-123456","excludedRemittanceInformation":[],"recommendedPaymentInstructions":[{"executionDate":"2022-06-12","paymentMethod":"aaaa","remittanceInformation":{"structured":[{"referredDocumentInformation":[{"type":"xxx","number":"12341234","relatedDate":"2022-06-12","paymentDueDate":"2022-06-12","referredDocumentAmount":{"remittedAmount":2600.5,"duePayableAmount":3000}}]}]}}]}   Cheers, André   ... View more