Member since
01-25-2019
75
Posts
10
Kudos Received
13
Solutions
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 3031 | 02-25-2021 02:10 AM | |
| 1694 | 02-23-2021 11:31 PM | |
| 3489 | 02-18-2021 10:18 PM | |
| 4684 | 02-11-2021 10:08 PM | |
| 18466 | 02-01-2021 01:47 PM |
02-05-2021
02:47 AM
Try to increase the heap size for nodemanager from Yarn -> Configs and see if that resolves your issue. If not then probably you will have to do a performance or query tuning. Please accept this answer if it helps you resolve your issue.
... View more
02-02-2021
11:57 PM
@tusharkathpal @MattWho Thanks, Guys for the help. I have tried it out the same using following command ``` ./tls-toolkit.sh standalone -n 'nifi-node1,nifi-node2,nifi-node3' -C 'CN=admin, OU=NIFI' --nifiDnPrefix 'CN=' --nifiDnSuffix ', C=IN' -K randompassword -P randompassword -S randompassword -B randompassword -o /tmp/5/certs/ssl --subjectAlternativeNames 'dev.example.com' ``` While deployment, It's giving me following error and killing the containers 2021-02-03 07:52:41,921 WARN [main] org.apache.nifi.web.server.JettyServer Failed to start web server... shutting down. java.lang.IllegalStateException: KeyStores with multiple certificates are not supported on the base class org.eclipse.jetty.util.ssl.SslContextFactory. (Use org.eclipse.jetty.util.ssl.SslContextFactory$Server or org.eclipse.jetty.util.ssl.SslContextFactory$Client instead) ----------------- Update ----------------- Above issue was introduced in the latest version (1.12.x): https://issues.apache.org/jira/browse/NIFI-7730 Issue resolved by adding 'dev.example.com' as an additional SAN entry and by upgrading the NiFi version to nifi-1.13.0 (dev)
... View more
02-01-2021
09:06 PM
@anujseeker and the HMS logs ?
... View more
02-01-2021
01:52 PM
hello @pphot You can migrate HMS and HS2 instances to any other hosts. So you can add another hosts for HS2 and HMS instance and remove the previous ones once the new ones are added and are functioning normally. For backend database, if you migrate then you have to update the configuration in the CM so that HMS has the updated information and access as to which host it needs to communicate in order to access its backend DB. Please note this is mandatory as Hive has all the information stored in its backend DB. Let me know if the above helps. Regards, Tushar
... View more
02-01-2021
01:34 PM
Hello @anujseeker It seems you are using the wrong path of hive. Below command works for me. hive --orcfiledump -d --rowindex 5 /warehouse/tablespace/managed/hive/tkathpal.db/orctable/delta_0000001_0000001_0000/bucket_00000 Now in my case, hive points to the actual parcel. [root@c2511-node1 ~]# which hive /usr/bin/hive [root@c2511-node1 ~]# ls -lt /usr/bin/hive lrwxrwxrwx 1 root root 22 Aug 3 2020 /usr/bin/hive -> /etc/alternatives/hive [root@c2511-node1 ~]# ls -lt /etc/alternatives/hive lrwxrwxrwx 1 root root 62 Aug 3 2020 /etc/alternatives/hive -> /opt/cloudera/parcels/CDH-7.1.1-1.cdh7.1.1.p0.3266817/bin/hive So when I run hive, ultimately the jars is being picked up from the right path. Could you please check the same on your end?
... View more
01-28-2021
01:27 AM
Thank you for the help Tushar-san , understood, we can update log4j property
... View more
11-14-2020
07:17 AM
Thanks a lot @tusharkathpal for your detailed explanation. Your suggestion has really worked.
... View more
11-12-2020
06:30 AM
IIRC, The ImpalaD process runs as the "impala". If you have sentry grants that enable access to roles the user is in any HDFL ACLs to the contrary will be ignored. The proper way to do this is to use Sentry to grant access to the roles which map to groups and users, you want to have access and then enable HDFS ACLs to sync the HDFS access.
... View more
11-08-2020
09:06 PM
Hi @tusharkathpal , thank you for the tip. I don't have Hive itself in my infra, just Impala + S3 + Kudu, but I will find time to install it and try. However please note that I am able to run other DDLs from Impala and it is able to communicate with Hive Metastore.
... View more
11-05-2020
10:32 AM
Hi Team, Thank you very much for promptly responding and providing useful solution/direction. While testing, app team reported that child dir/files are having r-x (for dir) and r--(files) for Others. Looks like ACL are not getting inherited to child dir and files. Can you confirm if ACL should inherit to child dir and files or not? Is there any other configuration that I need to check and modify? Regards, Banshi.
... View more