Member since
07-19-2018
613
Posts
101
Kudos Received
117
Solutions
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 5095 | 01-11-2021 05:54 AM | |
| 3421 | 01-11-2021 05:52 AM | |
| 8789 | 01-08-2021 05:23 AM | |
| 8385 | 01-04-2021 04:08 AM | |
| 36687 | 12-18-2020 05:42 AM |
03-10-2020
06:02 AM
@TCloud use /etc/hosts to set the fqdn you want to the ip you want. When this host mapping and the hostname is set, then reboot and check again that everything stays as you set it after reboot when it comes back online.
... View more
03-09-2020
08:50 AM
@YerFel I think you still need to use the truststore or keystore method. Try to test jdbc connection string non ssl vs ssl with another tool until you get the right connection string, then move to NIFI Execution. At Nifi level make sure the cert file(s) are owned to nifi user. Also watch the nifi log during testing if not already. That log may provide additional hints to the client error.
... View more
03-09-2020
08:40 AM
[hiveServer2.async.multi_dest.batch_hiveServer2.async.multi_deso log file. java.net.ConnectException: Call From xxx.xxx.xxx/10.21.16.60 to localhost:8020 ed; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused
Check your permissions for Hive User: Ranger? MetaStore? Also something I try to avoid is using or letting components run as "localhost". If you can, always using the fqdn for all services. In clustered environment this fqdn is required. "Localhost" can be the wrong "host" depending on which node you are working in.
... View more
03-09-2020
08:34 AM
Have you considered creating a copy of the table as external (in new location you want) and then INSERT into NewTable SELECT * FROM OldTable?
... View more
03-05-2020
05:16 AM
You need to use the cert to create truststore files and deliver these files to all of the nifi nodes. These files needed to be owned nifi:nifi as well. Then provide the path to these files to the controller service: SSLContextService. Then configure your Processor to use this SSLContextService. An example truststore command looks like: /usr/jdk64/jdk1.8.0_112/bin/keytool -import -file /etc/nifi/ssl/file.crt -alias nifi -keystore /etc/nifi/ssl/truststore.jks
... View more
03-05-2020
05:09 AM
Look for additional errors in /var/log/hue/error.log when using the WebUI. The client sider errors within the UI may not be very helpful to trouble shoot.
... View more
03-05-2020
05:04 AM
@ahadi I would recommend to spend some time researching similar posts in this community. There are loads (search "csv" in Apache NiFi Label): https://community.cloudera.com/t5/forums/searchpage/tab/message?filter=labels&q=csv&collapse_discussion=true&labels=Apache%20NiFi Here is a good one (introduce yourself to record reader): https://community.cloudera.com/t5/Community-Articles/Convert-CSV-to-JSON-Avro-XML-using-ConvertRecord-Apache-NiFi/ta-p/246607 I also have an example (split file into lines, parse lines for values, insert) in my GitHub: https://github.com/steven-dfheinz/NiFi-Templates
... View more
02-29-2020
06:58 AM
1 Kudo
Assuming you used the same certs, or even if you user different ones; you should be able to click the lock in any SSL based UIs (Ambari, Ranger, Nifi, yarn, grafana, etc) in your browser. This will show you all details of the certs including expiration dates.
... View more
02-29-2020
06:52 AM
1 Kudo
A couple things you should do: 1) set the schedule of listfile to 1 min or 5 min. If it’s 0 sec it’s always running which isn’t necessary during testing. 2) tail /var/log/nifi/nifi-app.log while trouble shooting the flow to see errors. Address them individually. I also suspect the Nifi node does not have enough resources (ram/cores/disk) so look into 3 dedicated nifi nodes with enough core and ram and disk configure for each repository type (see documentation) to allow you to operate Nifi in a stable manner.
... View more
02-24-2020
05:54 AM
1 Kudo
I don’t think the “remote process group” is required. I do however sometimes keep listsftp in main canvas and send to input port of a Process Group(not remote). Only so I can trigger from main canvas and never go into Process Group. For testing the Sftp connections and basic flow, I would recommend just doing listsftp->fetchsftp directly. Once you know it works and you still want to move it to different grouping (or even a remote process group) then address moving things around.
... View more