question Re: NiFi and GeoLocalization in Support Questions

NiFi and GeoLocalization

vergari — Mon, 11 Jan 2016 21:43:50 GMT

Hi all,

Does someone know if there is a way to enrich a FlowFile with geolocalization infos by querying an external GIS server like ArcGIS? I saw that in NiFi there is the GeoEnrichIP processor, but I need to get latitude and longitude from an address that is a FlowFile attribute.

Thank you,

Re: NiFi and GeoLocalization

JoeWitt — Mon, 11 Jan 2016 21:49:06 GMT

Hello Davide,

We do not have an out of the box processor to do this at this time but it would be a fairly straightforward custom processor to build. Of course querying an external service for this information offers different tradeoffs than having a local cache of data so keep that in mind. I will take a look at our existing geo enrichment processor to see what is involved in getting lat/long data as well.

Thanks

Joe

Re: NiFi and GeoLocalization

JoeWitt — Mon, 11 Jan 2016 21:55:57 GMT

Actually Davide I just checked the current GeoEnrichIP processor and it does indeed include lat/long/city/country/postalcode. It is driven by a given IP address and you control the input dataset. Maxmind, which is the dataset that processor is built around also offers a pay version for higher accuracy.

Are you looking for geo enrichment based on an IP address or another type of address?

Thanks

Joe

Re: NiFi and GeoLocalization

vergari — Mon, 11 Jan 2016 23:02:03 GMT

Hi Joe,

thanks for the response.

I'm sorry, I badly explained myself. I'm not looking for a geo enrichment based on an IP address, but on a street address. For example, in my FlowFile, I have an attribute named "address" which contains a street address eg. "1234 Main Street, SomeCity, USA" and I need to query an external GIS database to get lat and long for that address.

Thanks

Davide

Re: NiFi and GeoLocalization

sball — Tue, 12 Jan 2016 03:37:30 GMT

One means of doing this might be to use Web Services to do the enrichment. For example, you could use Arc's REST service for geocoding, and invoke this from a Get/InvokeHTTP processor, passing parameters from the FlowFile arguments.

Re: NiFi and GeoLocalization

vergari — Tue, 12 Jan 2016 16:16:43 GMT

Ok,

thank you very much, Joe. I'll try this way.