This article could be improved if settings for the emitting and receving nifi instances could be more clearly identified. ... View more

Hi,   Can you give mode details on the NiFi version, the HDFS Hadoop version. Is NiFi externally installed to HDFS. ... View more

@Vj1989  Great way to simplify it. Believe you missed a 'use $f;' from Step 2 though, otherwise you're just getting the same tables over and over.   E.g. for f in `cat /tmp/databases` do echo "Database name is $f , Table Names are as below:" hive -e "use $f; show tables;" >> /tmp/tables done   ... View more

I first set it up with executestream and was successful in getting it to work. Isn't it better to use invokescript or executescript because then there isn't a need to maintain scripts outside of NiFi? I just thought it would be better to natively pass the flowfile using flowfile = session.get(). ... View more

Hi @Vj1989 , I've used ${generatetablefetch.tableName} as expression. What did i do wrong?   ... View more

I've already checked this material before, thank you! I didn't manage to fully apply it to my case. I have xml input flowfiles and need to do some text replace and after that push them foward in the flow. ... View more

You may follow this video for the complete instruction.   https://www.youtube.com/watch?v=rUJOS6LT5Jk     ... View more

Hi Markushg,   When you want to apply condition on any number of attributes based on a pattern match. Then you may consider using anyMatchingAttribute NiFi Function.   Here is the link to the documentation: https://nifi.apache.org/docs/nifi-docs/html/expression-language-guide.html#anyattribute   In your case, You may have to do something like as below: ${anyMatchingAttribute("syslog.structuredData*os"):equals('linux69')} ... View more

NiFi Templates are stored within flow.xml.gz file, you can refer to below screenshot from NIFi Documentation.     flow.xml.gz is stored in the <</conf >>directory. In your case I can see the mount point is pointing to <</opt/nifi/nifi-current/conf >>directory   The best way to manage Templates are from "Global Menu"->Templates   ... View more

PFB the full configuration details of PutDatabaseRecord and CSVReader.   PutDatabaseRecord SS Part 1: PutDatabaseRecord SS Part 1   PutDatabaseRecord SS Part 2: PutDatabaseRecord SS Part 2:   CSVReader ss part 1: CSVReader SS part 1   CSVReader ss part 2: CSVReader ss part 2   CSVReader ss part 3: CSVReader ss part 3     Please let me know if anything else is needed, also if I need to tweak on settings or add/remove processors. ... View more

Here is a link of 5.5 hours of free Apache NiFi course.    https://www.udemy.com/course/apache-nifi-latest-course/?couponCode=LATESTNIFI ... View more

Sure.  Fortunately in this case I was able to explore answer myself. I would remember to open a new thread from next time.  ... View more

You connect to H2 database like any other database using JDB connection. Here is the link where you can find H2 driver and documentation. www.h2database.com/html/download.html   By the way, I have also uploaded a video explaining step by step process on connecting to NiFi H2 database. You may check it out here.  https://www.youtube.com/watch?v=tsAR2f4uGK4 ... View more

Do you have entries of all the nodes under /etc/hosts file? ... View more

Please run below command to setup auto startup of hive service:   sudo systemctl enable hive-server2    Do let me know the results. Thanks. ... View more

Writing this so that it can help someone in future: I was installing Hive and getting error that It hive metastore wasn't able to connect, and I successfully resolved the error by recreating the hive metastore database.   Someone the user which was created in mysql Hive metastore wasn't working properly and not able to authenticate. So I dropped metastore DB, Dropped User. Recreated Metastore DB, Recreated User, Granted all privileges and then it was working without issues. ... View more