Member since
07-19-2018
613
Posts
101
Kudos Received
117
Solutions
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 5099 | 01-11-2021 05:54 AM | |
| 3423 | 01-11-2021 05:52 AM | |
| 8790 | 01-08-2021 05:23 AM | |
| 8386 | 01-04-2021 04:08 AM | |
| 36699 | 12-18-2020 05:42 AM |
04-16-2020
05:42 AM
@Cl0ck I am not sure if this helps, but in the past when I have had ntp stability issues across a cluster, I configure my Master Ambari Server to the internal ntp clock server I want. Then for all the rest of the nodes, I use the Master Ambari Service hostname/ip, not the ntp servers. This allows the main machine to get the internal clock time, and share that with all rest of the nodes.
... View more
04-16-2020
05:36 AM
@bhara I don't see an actual error message in there. I just notice the result output has rows = none. Does the user you are logging into HUE with have permissions to see the database and tables? Can you share your hue.ini hive configuration lines?
... View more
04-16-2020
05:29 AM
@Soc You should go to /etc/yum.repos.d/ and clean your repo files. Delete any that you do need. Next execute: yum clean all Then try again.
... View more
04-16-2020
05:23 AM
There are many ways to get a public cert. I just recommend one I used recently. You basically just click the lock in your browser. In windows you can then download files from there. If you are not on windows, or using command line you can reference this link for some other ways to get the public cert for amazon s3 urls: https://serverfault.com/questions/661978/displaying-a-remote-ssl-certificate-details-using-cli-tools Not sure what your last question refers to?
... View more
04-14-2020
09:30 AM
For your example I would use truststore to "Trust Amazon's Cert". You get the Amazon Cert, and create truststore with it. There are many ways to get the Amazon Cert. Recently, I found that a very easy way (windows) is to use a browser. Visit an https url to your s3 host. Click the SSL link, view certificate, download, etc. On Nifi node add this cert file to /etc/nifi/ssl/ as amazon.cer. Next the truststore command looks like: /usr/jdk64/jdk1.8.0_112/bin/keytool -import -file /etc/nifi/ssl/amazon.cer -alias amazon -keystore /etc/nifi/ssl/truststore-amazon.jks Make sure the file is chown nifi:nifi (owned to nifi user) and copied to all nodes. The SSLContext controller service is then configured as:
... View more
04-14-2020
04:59 AM
@mayank_tripathi The solution here is to setup the SSL context Service for the processor. To do this you will need to create a new SSL Context Service and provide it a path to keystore and/or truststore files which contain the s3 bucket’s SSL CERT. The files should be on all nifi nodes, owned by nifi user.
... View more
04-13-2020
06:23 AM
@Eric_B Are the tables Presto cannot read owned by NiFi? The error you share seems like a permissions issue to the underlying files. Also if you can, please share screen shots of your processor configurations.
... View more
04-13-2020
06:16 AM
@ForrestGump No, out of the box NiFi should work with all Processors and Controller Services. The stock configuration of NiFi should work without any issues. You should not see any inconsistencies or stability issues unless you are exceeding resources available on the NiFi node(s). If you are seeing specific issues with "Regex, prepend, and other items" they each should give a very specific error. Sometimes the errors are not shown in the UI. You have to tail the nifi app logs in order to see full error informations.
... View more
04-13-2020
06:04 AM
@Hive_SQL The solution here is to create a hive table of New Format (|). Next Select/Insert Old Format(/t) into New Format. For example: select * from old_format INSERT INTO new_format
... View more
04-13-2020
05:54 AM
@AndyL Can you update original post or reply with screenshots of the Processor Configuration and Record Reader Configuration (including avro schemas)?
... View more