Hi @mburgess I tried the solution but it is not working for other JSON paths like $.key I tried multiple JSON paths but seems like it only works for $.cells.year. Please let me know your thoughts. I followed the exact steps you provided. ... View more

The above question and reply thread below were originally posted in the Community Help Track. On Fri May 24 03:19 UTC 2019, a member of the HCC moderation staff moved it to the Data Ingestion & Streaming Track. The Community Help Track is intended for questions about using the HCC site itself. ... View more

There's a third option: You could use the InvokeHTTP processor. In it, use the Expression Language to construct the RemoteURL, to directly build an AWS S3 web API call, to get the listing you need. AWS web API is documented here: http://docs.aws.amazon.com/AmazonS3/latest/API/Welcome.html However, as that document says, "Making REST API calls directly from your code can be cumbersome. It requires you to write the necessary code to calculate a valid signature to authenticate your requests. We recommend the following alternatives instead: \[AWS SDK or AWS CLI\]" -- which are the approaches I gave above. ... View more