Cloudera Community
siddesh210491
user rank
Explorer

Re: Access HDFS/MR from remote HDFS cluster

by Explorer in Support Questions
‎09-17-2018 07:20 AM
‎09-17-2018 07:20 AM
I have mentioned that, as I am reading data from Cluster 1, I am using hdfs://nameservice1:/user/abc on cluster 2.   nameservice1 is related to namenodes of cluster 1, so what is the issue?   Thanks Siddesh ... View more

Access HDFS/MR from remote HDFS cluster

by Explorer in Support Questions
‎09-17-2018 02:10 AM
‎09-17-2018 02:10 AM
Hi, I have a requirement which sounds similar to symlinking in Hadoop/HDFS.   Requirement:  There are 2 production clusters: Cluster 1 and Cluster 2 I want to read data of cluster 1 from cluster 2 without copying it. What came to my mind is, can I use hadoop fs -ls hdfs://namespace1/user/xyz on cluster 2? I understand that cluster 2 won't know what is namespace1 - but thought of putting/appending namespace ID related info in hdfs-site.xml of cluster 2. (via advanced snippet - gateway configs) Is this possible? Any other alternative? hftp? (never tried both) Thanks Siddesh ... View more
Labels:

Re: Can the impalad "idle_query_timeout" parameter...

by Explorer in Support Questions
‎02-05-2018 07:10 AM
‎02-05-2018 07:10 AM
Can this be set for queries submitted via HUE in Impala Editor?   What would be the exact config name/structure and which advanced snippet would it go in? ... View more
Contact Me
Online
Offline
Last Visited
‎10-08-2018 04:21 AM
Community Statistics
Member Since ‎08-14-2017 05:29 AM
Last Visited ‎10-08-2018 04:21 AM
Posts 5