Cloudera Community
Tomas79
user rank
Guru

Re: Hue 3.11 user access control on S3 storage

by Guru in Support Questions
‎11-06-2018 04:22 AM
‎11-06-2018 04:22 AM
I have the same question too.. ... View more

Re: socket missing on DN

by Guru in Support Questions
‎10-29-2018 05:21 AM
‎10-29-2018 05:21 AM
The DN process was not running, so the restart of the whole HDFS resolved the issue and the directory (socket) was created on every data node ... View more

socket missing on DN

by Guru in Support Questions
‎10-29-2018 01:28 AM
‎10-29-2018 01:28 AM
Hi,  after a restart of two DN from the HDFS the Impala daemon refused to start becuase it was not able to access /var/run/hdfs-sockets/dn. I verified the directory, and the socket is not there. I checked other DN hosts and there the socket directory is created.    I had to start the Impala, so I turned off short circuit reads, but my question is how to re-create these socket directories? Just with a restart of the HDFS?  Does anybody had a similar experience? Thanks   CDH5.15 ... View more
Labels:

Re: HiveServer2 growing number of file descriptors...

by Guru in Support Questions
‎10-19-2018 03:16 PM
‎10-19-2018 03:16 PM
I had from time to time a significant increase of file descriptors (up to 20k) but it was usually because of high concurrency or very large spark jobs. The descriptors were released when the jobs finished. I also noticed that during that peak I had almost 10k open operations. (CDH5.13) ... View more

Re: spark-shell command failing

by Guru in Support Questions
‎10-17-2018 09:37 AM
1 Kudo
‎10-17-2018 09:37 AM
1 Kudo
there is a difference between spark and spark2. If you want to use spark2 then you should rub spark2-shell. And if spark 1.x theb you should deploy spark1 gateway role on the host ... View more

Re: spark-shell command failing

by Guru in Support Questions
‎10-17-2018 08:15 AM
‎10-17-2018 08:15 AM
1. Yes it does 2. You need YARN, HDFS and Spark2 gateway deployed. Something is missing on the host. ... View more

Re: How to setup mapreduce not to use yarn

by Guru in Support Questions
‎10-17-2018 08:08 AM
‎10-17-2018 08:08 AM
I am not an expert, but I thought that Mapreduce2 is an a.k.a for YARN, so the framework uses YARN resource manager and node managers. So the identification of the application is correct in Navigator. ... View more

Re: Impala unsupported set commands

by Guru in Support Questions
‎10-04-2018 11:26 PM
1 Kudo
‎10-04-2018 11:26 PM
1 Kudo
I have figured out that this is coming from the third party tool, so it has nothing to do with the Simba driver.  Thanks ... View more

Impala unsupported set commands

by Guru in Support Questions
‎10-04-2018 10:11 AM
‎10-04-2018 10:11 AM
Hi,  I noticed that SET queries generated by a third party app on the Impala cluster are constantly failing.  One example:   SET AllowSelfSignedCert=1     Is this something related to the Impala JDBC driver or are these coming from the application using this JDBC? Can I somehow turn off this annoying SET command? Thanks   Version: CDH5.15, Impala using TLS   ... View more
Labels:

Re: How to define concrete resource consumption fo...

by Guru in Support Questions
‎10-04-2018 07:13 AM
‎10-04-2018 07:13 AM
Look into the charts of Cloudera Manager, it is not exactly there, but you can quickly figure out who consumed the most cpu (vcores) and memory ... View more
Contact Me
Online
Offline
Last Visited
‎01-14-2021 05:46 AM
Community Statistics
Member Since ‎07-01-2015 06:03 AM
Last Visited ‎01-14-2021 05:46 AM
Posts 460
Kudos received 79