Member since
04-09-2015
6
Posts
0
Kudos Received
0
Solutions
05-31-2018
10:42 PM
Thank you for the quick response. That being said, creating a custom processor is not beyond my ability. Is this even possible? My nifi instance is running in a Linux environment.
... View more
05-31-2018
10:26 PM
Every example I've seen on GetFile processor assumes that the user running nifi has full permissions on the files and paths being read. Is there a way to provide user credentials to a nifi processor. This will allow nifi to impersonate that user so that it can have access to data on the filesystem that the nifi user doesn't have permission to read or write.
... View more
Labels:
- Labels:
-
Apache NiFi
02-12-2018
04:37 PM
Thank you for your suggestion. However, this will not work because ExecuteProcessor does not accept an incoming relationship. I have a preceding processor that has an initialize relationship as an output. Upon initialization of my dataflow a flowfile is is sent to this relationship and contains the necessary information to create the Solr Collection. The more I look at this issue the more appropriate a CreateSolrCollection processor sounds. For now I'm going to continue with my scripted processor to run the solrctl command. This just requires the nifi user to have authority to invoke the necessary api calls. Unless there's something I'm missing, I think that's the best solution for my question.
... View more
02-10-2018
06:14 AM
I'm trying to create a standard ingest flow for nifi that will process java application logs in json format and index them to Solr. I want this flow to create the necessary Solr collections if they don't already exist. I can do this with a simple API call to the /admin/collection endpoint; however, I don't know how kerberos authentication will work from the invokehttp processor. Does anyone have any knowledge on the subject to help get me going in the right direction on this? Another option would be to invoke the "solrctl" command on the OS; I'm running CDH 5.11. The main issue there is that I don't know of a way to execute a script or command while still using the nifi expression language to pass parameters from flow file attributes.
... View more
Labels:
- Labels:
-
Apache NiFi
-
Apache Solr