Member since
12-04-2015
8
Posts
0
Kudos Received
0
Solutions
07-25-2019
03:28 AM
Got it working on my cluster. Thanks Lars and Eric. Cheers, Anand
... View more
07-24-2019
04:45 AM
Hi Eric, > COORDINATOR_ONLY impala daemon will not perform data reads, rather it only coordinates query execution by distributing jobs to executors. That's my understanding as well and that's why this failure was a surprise to me. > Why do you need to enable this for COORDINATOR_ONLY impala daemons? Or is it that all your COORDINATOR_ONLY impala daemons fail with this error? Yes, only the COORDINATOR_ONLY impala daemons fails. Other work fines. > Also, have you checked whether socket /var/run/hdfs-sockets/dn exist on that impala daemon host? > /var/run/hdfs-sockets/dn does not exists on COORDINATOR_ONLY impala daemon hosts as there is no DataNode on them. Regards, Anand
... View more
07-24-2019
12:11 AM
dfs.client.read.shortcircuit was not enabled for HDFS Gateway. I enabled it and then deployed client configuration and restarted all the services in the cluster. Unfortunatley, I'm still getting the same error when starting COORDINATOR_ONLY impalad. The Short circuit reads config looks like following:
... View more
07-23-2019
04:29 AM
Hi, I'm trying to deploy a few COORDINATOR_ONLY impalad on edge nodes in my cluster (CDH 5.16.1). HDFS short-circuit read are enabled on the cluster and works fine.When starting the COORDINATOR_ONLY nodes, I'm getting following error: Invalid short-circuit reads configuration:
- Impala cannot read or execute the parent directory of dfs.domain.socket.path
Aborting Impala Server startup due to improper configuration. Impalad exiting. Is there a way to run COORDINATOR_ONLY impalad with hdfs short circuit reads enabled. Thanks in advance!
... View more
01-09-2019
09:41 PM
Hi, We recently removed three hosts from a cluster managed by Cloudera Manager 5.14.2. The IP addresses from these hosts were receycled and assigned to new hosts that does not have anything to do with the CDH cluster. Hostnames for the new hosts are different from the ones that were removed from the cluster. While disributing a parcel, we noticed that these hosts were still being contacted for parcel distribution. cloudera-flood.log:[07/Jan/2019 16:30:15 +0000] 9658 MainThread torrent INFO Save torrent: {'dht_nodes_name': [('<ip_of_removed_hosts>', 7191), ('<ip_of_removed_hosts>', 7191),('<ip_of_removed_hosts>', 7191), ('<ip_of_host_in_cluster>', 7191),...], 'ti': <libtorrent.torrent_info object at 0x7f33c8451520>, 'max_uploads': 1, 'save_path': '/opt/cloud We have checked the HOSTS table in scm databases and it does not contain any hosts with these IP addresses. Are these IPs cached somewhere or there is some configuration that is not exposed by Cloudera Manager where they might still be lingering around. Thanks in advance.
... View more
Labels:
09-29-2016
04:58 AM
Hi, I was deploying Livy on CDH 5.5 using CM by defining custom CSD and parcels for it. After upgrading to CDH 5.8, now I'm unable to deploy instances of any new services. They wizard fails with the following error: Timed out after 12000 ms. Waiting for Cloudera Manager Agents to detect release: LIVY_SERVER 1.0.0 Once the wizard fails, I'm able to start the new instances manually from the Actions menu. Did something changes in the way parcel detection works between CM 5.5 and 5.8? Thanks, Anand
... View more
- Tags:
- Parcels
09-28-2016
12:59 AM
I have setup a CDH 5.8 using CM. Oozie is installed in non-HA mode and it was running fine. Then I moved one of the ZK instances from one node to another node. After this migration, all other services are working fine but Oozie fails to start with the following error log: INFO org.apache.zookeeper.ClientCnxn SERVER[node2.mydomain] Opening socket connection to server localhost.localdomain/127.0.0.1:2181. Will not attempt to authenticate using SASL (unknown error)
WARN org.apache.zookeeper.ClientCnxn SERVER[node2.mydomain] Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect
java.net.ConnectException: Connection refused
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739)
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1081) I'm not sure why its looking for ZooKeeper even when HA is not configured.
... View more
12-07-2015
01:58 AM
Hi, Is it possible to install Livy Spark Server with Cloudera Manager 5.5. I've CDH 5.5.0 on my cluster with Spark installed. Also, I'm able to see the Spark Notebook option in Hue UI. Regards, Anand
... View more
- Tags:
- Spark