I have JSON data like in the attached file and trying to extract some values and convert it to a new schema with some generated values: sampledata.txt { "id": 2920236, "sampling_rate": null, "timestamp": "2017-12-22 15:05:31", "location": { "id": 944, "latitude": "51.575", "longitude": "6.981", "country": "DE" }, "sensor": { "id": 1887, "pin": "1", "sensor_type": { "id": 14, "name": "SDS011", "manufacturer": "Nova Fitness" } }, "sensordatavalues": [ { "id": 1312395485, "value": "116.03", "value_type": "P1" }, { "id": 1312395486, "value": "38.10", "value_type": "P2" } ], "coord": { "lon": 6.98, "lat": 51.58 }, "weather": [ { "id": 741, "main": "Fog", "description": "fog", "icon": "50n" }, { "id": 701, "main": "Mist", "description": "mist", "icon": "50n" } ], "base": "stations", "main": { "temp": 281.9, "pressure": 1034, "humidity": 100, "temp_min": 281.15, "temp_max": 282.15 }, "visibility": 9000, "wind": { "speed": 2.1, "deg": 340 }, "clouds": { "all": 75 }, "dt": 1513957800, "sys": { "type": 1, "id": 4886, "message": 0.0043, "country": "DE", "sunrise": 1513928193, "sunset": 1513956338 }, "name": "Gladbeck", "cod": 200 } |-- PM10 (which is the value of sensordatavalues where value_type=P1 ) |-- timestamp (which is timestamp) |-- sensor_id (which is the id of sensordatavalues where value_type=P1 ) |-- is_rain (is endcodes as whether 1 or 0 depending on the value of weather.cod) |-- wind_deg (which is weather.wind.deg) |-- wind_speed (which is weather.wind.speed) |-- humidity (which is weather.main.humidity) |-- pressure (which is weather.main.pressure) |-- temperature (which is weather.main.temp) |-- lon (which is location.longitude) |-- lat (which is location.latitude) |-- season (which is a value between 1 and 4 depending on the month) |-- is_rushHour (which is a value 1 or 0 depending on the time) Any ideas how to transform my data? ... View more

Hi, I have some problems merging the response of a API call with InvokeHTTP to the orginal flow file. I tried to put the response as an attribute to the original file and sent it to an replace text processor. I set the Evaluation Mode to Entire Text and tried either prepend and append replacement strategy. In prepend mode the processor is just passing the attributes as new content and in append the processor is writing the original content to the flow files. Any ideas how to merge the both datasets? ... View more

I'm trying to load weather data as http API request. Therefore I need to extract the geo information from an incoming JSON flowfile. This is my JSON data { "id" : 590575476, "sampling_rate" : null, "timestamp" : "2017-12-19 13:23:20", "location" : { "id" : 1311, "latitude" : "47.967", "longitude" : "7.959", "country" : "DE" }, "sensor" : { "id" : 2602, "pin" : "1", "sensor_type" : { "id" : 14, "name" : "SDS011", "manufacturer" : "Nova Fitness" } }, "sensordatavalues" : [ { "id" : 1291686812, "value" : "25.87", "value_type" : "P1" }, { "id" : 1291686813, "value" : "15.63", "value_type" : "P2" } ] } Any idea how to access latitude and longitude as attributes for the URL in the InvokeHTTP processor? http://api.openweathermap.org/data/2.5/weather?lat=${location.latitude}&lon=${location.longitude}&APPID=myapikey ... View more