Member since
12-04-2015
8
Posts
0
Kudos Received
0
Solutions
07-25-2019
03:28 AM
Got it working on my cluster. Thanks Lars and Eric. Cheers, Anand
... View more
07-24-2019
04:45 AM
Hi Eric, > COORDINATOR_ONLY impala daemon will not perform data reads, rather it only coordinates query execution by distributing jobs to executors. That's my understanding as well and that's why this failure was a surprise to me. > Why do you need to enable this for COORDINATOR_ONLY impala daemons? Or is it that all your COORDINATOR_ONLY impala daemons fail with this error? Yes, only the COORDINATOR_ONLY impala daemons fails. Other work fines. > Also, have you checked whether socket /var/run/hdfs-sockets/dn exist on that impala daemon host? > /var/run/hdfs-sockets/dn does not exists on COORDINATOR_ONLY impala daemon hosts as there is no DataNode on them. Regards, Anand
... View more
07-24-2019
12:11 AM
dfs.client.read.shortcircuit was not enabled for HDFS Gateway. I enabled it and then deployed client configuration and restarted all the services in the cluster. Unfortunatley, I'm still getting the same error when starting COORDINATOR_ONLY impalad. The Short circuit reads config looks like following:
... View more
07-23-2019
04:29 AM
Hi, I'm trying to deploy a few COORDINATOR_ONLY impalad on edge nodes in my cluster (CDH 5.16.1). HDFS short-circuit read are enabled on the cluster and works fine.When starting the COORDINATOR_ONLY nodes, I'm getting following error: Invalid short-circuit reads configuration:
- Impala cannot read or execute the parent directory of dfs.domain.socket.path
Aborting Impala Server startup due to improper configuration. Impalad exiting. Is there a way to run COORDINATOR_ONLY impalad with hdfs short circuit reads enabled. Thanks in advance!
... View more
Labels:
- Labels:
-
Apache Impala
-
HDFS