Member since
09-02-2016
56
Posts
6
Kudos Received
0
Solutions
11-13-2022
08:07 AM
https://lists.apache.org/thread/907n11xlvdmckp1045bspzloclthfqsh As NiFi is a pure Java/JVM application, we use Jython rather than
Python for ExecuteScript. This means that you can't import native
(CPython, e.g.) modules into your Jython scripts in ExecuteScript consider using ExecuteStreamCommand with a real Python
interpreter and script. I'm looking at Py4J to try and bridge the gap
... View more
02-06-2022
08:51 PM
@Meghna_3 as this is an older article, you would have a better chance of receiving a resolution by starting a new thread. This will also be an opportunity to provide details specific to your environment that could aid others in assisting you with a more accurate answer to your question. You can link this thread as a reference in your new post.
... View more
09-30-2019
03:19 AM
can you give the full api with other requirements which are needed
... View more
02-22-2018
06:04 PM
Thanks for replying @Abdelkrim Hadjidj @Matt Burgess. Now I have two different schemas for input and output CSV for LookupRecord. I modified Result RecordPath to /COMPANY. When I start LookupRecord it takes in 6 flow files but doesn't return anything.
... View more
12-21-2017
02:29 PM
NiFi does not replicate data. If you lose a node, then flow can be directed to a available node , flowfile queued for the failed node will either wait until the node comes up or the flowfile is manually is sent to another working node. There is feature proposal for this https://cwiki.apache.org/confluence/display/NIFI/Data+Replication
... View more
10-12-2017
09:21 AM
@spdvnz There's no specific processor for Azure SQL DB but you can use it with standard JDBC processor in NiFi. You can use a Database Connection Pooling Service with JDBC driver for Azure SQL DB and use processor like PutDatabaseRecord or any other JDBC processor to ingest data.
... View more
05-02-2017
12:57 PM
@spdvnz There is no specific configuration for an AWS cloud instance. There are best practices when configuring NiFi, they can be found in the documentation embedded with NiFi and this HCC article is a good place to start also: Best Practices for high performance NiFi instance
... View more
04-27-2017
02:06 PM
1 Kudo
@spdvnz There currently is no HDF release that is based off Apache NiFi 1.1.2. The most current HDF release as of this response if HDF 2.1.2. The HDF 2.1.x versions are all based off Apache NiFi 1.10 plus additional Apache bug fixes. The additional bug fixes included in each of these bug fixes can be found in the release notes for each HDF release. HDF 2.1.0 release notes HDF 2.1.1 release notes
HDF 2.1.2 release notes The documentation for doing an Ambari based upgrade to HDF 2.1.2 can be found here: HDF 2.1.2 Ambari based upgrade guide Thank you, Matt
... View more
02-15-2018
07:41 AM
Hi @spdvnz @Raj B , Can you let me know how were you able to grab the failures eventually? I've tried storing the bulletin board messages in hdfs using the REST API but the Json generated from there is very detailed and would require a lot of work before I can use it for monitoring purpose. Would like to know how you guys did it? Here is the link to the actual question https://community.hortonworks.com/questions/171150/monitoring-nifi-flow-file-failures-success-1.html
... View more
03-07-2017
02:19 AM
2 Kudos
@spdvnz From my experience, missing one of the pre-requisites for host settings is the cause. See this: https://docs.hortonworks.com/HDPDocuments/HDF2/HDF-2.0.1/bk_ambari-installation/content/ch_getting_ready.html Check once again all the pre-requisites mentioned in this document. It happened to me to believe that I did everything right, but going on it, I realized that it was one that I missed.
... View more