Member since
02-19-2020
22
Posts
0
Kudos Received
2
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
1344 | 04-26-2020 05:43 AM | |
4684 | 03-14-2020 10:51 AM |
09-19-2021
05:05 AM
This article could be improved if settings for the emitting and receving nifi instances could be more clearly identified.
... View more
09-03-2020
11:04 PM
Hi, Can you give mode details on the NiFi version, the HDFS Hadoop version. Is NiFi externally installed to HDFS.
... View more
08-07-2020
03:19 PM
@Vj1989 Great way to simplify it. Believe you missed a 'use $f;' from Step 2 though, otherwise you're just getting the same tables over and over. E.g. for f in `cat /tmp/databases`
do
echo "Database name is $f , Table Names are as below:"
hive -e "use $f; show tables;" >> /tmp/tables
done
... View more
05-25-2020
08:25 PM
I first set it up with executestream and was successful in getting it to work. Isn't it better to use invokescript or executescript because then there isn't a need to maintain scripts outside of NiFi? I just thought it would be better to natively pass the flowfile using flowfile = session.get().
... View more
05-03-2020
10:20 PM
Hi @Vj1989 , I've used ${generatetablefetch.tableName} as expression. What did i do wrong?
... View more
04-29-2020
12:54 AM
I've already checked this material before, thank you! I didn't manage to fully apply it to my case. I have xml input flowfiles and need to do some text replace and after that push them foward in the flow.
... View more
04-26-2020
05:46 AM
You may follow this video for the complete instruction. https://www.youtube.com/watch?v=rUJOS6LT5Jk
... View more
04-26-2020
05:30 AM
Hi Markushg, When you want to apply condition on any number of attributes based on a pattern match. Then you may consider using anyMatchingAttribute NiFi Function. Here is the link to the documentation: https://nifi.apache.org/docs/nifi-docs/html/expression-language-guide.html#anyattribute In your case, You may have to do something like as below: ${anyMatchingAttribute("syslog.structuredData*os"):equals('linux69')}
... View more
04-26-2020
05:22 AM
NiFi Templates are stored within flow.xml.gz file, you can refer to below screenshot from NIFi Documentation. flow.xml.gz is stored in the <</conf >>directory. In your case I can see the mount point is pointing to <</opt/nifi/nifi-current/conf >>directory The best way to manage Templates are from "Global Menu"->Templates
... View more
04-13-2020
07:06 AM
PFB the full configuration details of PutDatabaseRecord and CSVReader. PutDatabaseRecord SS Part 1: PutDatabaseRecord SS Part 1 PutDatabaseRecord SS Part 2: PutDatabaseRecord SS Part 2: CSVReader ss part 1: CSVReader SS part 1 CSVReader ss part 2: CSVReader ss part 2 CSVReader ss part 3: CSVReader ss part 3 Please let me know if anything else is needed, also if I need to tweak on settings or add/remove processors.
... View more
04-10-2020
10:00 PM
Here is a link of 5.5 hours of free Apache NiFi course. https://www.udemy.com/course/apache-nifi-latest-course/?couponCode=LATESTNIFI
... View more
04-10-2020
04:02 PM
Sure. Fortunately in this case I was able to explore answer myself. I would remember to open a new thread from next time.
... View more
- Tags:
- NiFi
04-09-2020
01:29 PM
You connect to H2 database like any other database using JDB connection. Here is the link where you can find H2 driver and documentation. www.h2database.com/html/download.html By the way, I have also uploaded a video explaining step by step process on connecting to NiFi H2 database. You may check it out here. https://www.youtube.com/watch?v=tsAR2f4uGK4
... View more
03-14-2020
10:51 AM
Refer to this thread for similar question: https://community.cloudera.com/t5/Support-Questions/merge-too-csv-files-in-nifi/m-p/229259#M191116
... View more
02-25-2020
11:20 AM
@nishank_paras You can use the invokeHTTP processor to fetch your file. Here is an example: The above example fetches the Apache nifi-toolkit-1.11.3-bin.tar.gz file. You can then construct a dataflow using other processors to manipulate as you want or simply just connect to another invokeHTTP processor that instead of "GET" uses "PUT" to put your file "nn.csv" at the new http endpoint. Hope this helps you, Matt
... View more
02-19-2020
09:26 AM
Please run below command to setup auto startup of hive service: sudo systemctl enable hive-server2 Do let me know the results. Thanks.
... View more
02-19-2020
09:20 AM
Writing this so that it can help someone in future: I was installing Hive and getting error that It hive metastore wasn't able to connect, and I successfully resolved the error by recreating the hive metastore database. Someone the user which was created in mysql Hive metastore wasn't working properly and not able to authenticate. So I dropped metastore DB, Dropped User. Recreated Metastore DB, Recreated User, Granted all privileges and then it was working without issues.
... View more