Member since
07-21-2014
141
Posts
8
Kudos Received
3
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
1720 | 02-01-2017 04:49 PM | |
1024 | 01-15-2015 01:57 PM | |
1944 | 01-05-2015 12:59 PM |
05-02-2017
06:29 PM
Thanks, this is very useful. How would one go about getting the application name? Is it the app name or the app ID or something else? Thanks!
... View more
05-01-2017
02:54 PM
Thanks for the update. > Are you looking for support on a particular environment? Yes, looking for Debian (Wheezy or Jessie) support.
... View more
04-28-2017
12:54 PM
Trying to understand the requirements for CDSW which seems to be only available on RHEL/CentOS: https://www.cloudera.com/documentation/data-science-workbench/latest/topics/cdsw_requirements_supported_versions.html#operating_system_req But docker containers are support across other linux distributions. Are there plans to make it available on other distributions?
... View more
Labels:
04-12-2017
03:31 PM
I got 5 clusters managed by CM and everything is on the latest CDH 5.10. In order to evaluate the Java upgrade, I would like to test the upgrade on a test cluster and minimize the issues when upgrading the prod clusters.
... View more
04-12-2017
02:39 PM
Thanks for the response. Since CM host manages the clusters, I wanted to check if the hosts for one of the cluster (running the services) be running say Java 8 while CM host still be on Java 7?
... View more
04-12-2017
12:46 PM
Is it possible to have CM host running on a different version of Java compared to the Java version all the hosts of a cluster? Thanks!
... View more
Labels:
04-04-2017
11:24 AM
Can anyone weigh in on the possibility of running the cluster hosts, except the cloudera manager host, on JDK 1.8? Thanks!
... View more
03-17-2017
08:01 PM
I run into this error when I try to start the NodeManager: ~~~~ Error starting NodeManager org.apache.hadoop.yarn.exceptions.YarnRuntimeException: org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Recieved SHUTDOWN signal from Resourcemanager ,Registration of NodeManager failed, Message from ResourceManager: Disallowed NodeManager from <host>, Sending SHUTDOWN signal to the NodeManager. at org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.serviceStart(NodeStatusUpdaterImpl.java:215) at org.apache.hadoop.service.AbstractService.start(AbstractService.java:193) at org.apache.hadoop.service.CompositeService.serviceStart(CompositeService.java:120) at org.apache.hadoop.yarn.server.nodemanager.NodeManager.serviceStart(NodeManager.java:288) at org.apache.hadoop.service.AbstractService.start(AbstractService.java:193) at org.apache.hadoop.yarn.server.nodemanager.NodeManager.initAndStartNodeManager(NodeManager.java:522) at org.apache.hadoop.yarn.server.nodemanager.NodeManager.main(NodeManager.java:568) Caused by: org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Recieved SHUTDOWN signal from Resourcemanager ,Registration of NodeManager failed, Message from ResourceManager: Disallowed NodeManager from <host>, Sending SHUTDOWN signal to the NodeManager. at org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.registerWithRM(NodeStatusUpdaterImpl.java:283) at org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.serviceStart(NodeStatusUpdaterImpl.java:209) ~~~~~~ Any idea how to overcome this error and start the NodeManagers? Thanks!
... View more
Labels:
03-17-2017
10:25 AM
2 Kudos
While attempting to apply a host template, I keep running into this error/notification: Host must have a single version of CDH installed I didn't notice multiple cm agents running on the host, is there anything else I need to check? Thanks!
... View more
03-16-2017
03:35 PM
CDH and Cloudera Manager requirements are mentioned here: https://www.cloudera.com/documentation/enterprise/release-notes/topics/rn_consolidated_pcm.html "... Cloudera does not support mixed environments, all nodes in your cluster must be running the same major JDK version." If I want to run the hosts of the cluster on JDK 8, can I still have CM running on JDK 7? Thanks!
... View more
03-12-2017
11:24 PM
I currently have my CDH 5.9 cluster currently on JDK 1.7 and wanted to know if its safe to upgrade the hosts to JDK 1.8. Also, is it possible to have the Cloudera manager to be on JDK 1.7 while the cluster to be upgraded to JDK 1.8. Thanks!
... View more
Labels:
02-02-2017
12:08 PM
How does one go about deploying a Spark streaming job on a CDH cluster? Does the job need to be deployed as a CSD parcel? Thanks!
... View more
Labels:
02-01-2017
04:49 PM
Ok, I do notice the CDH 5.10 parcel and requires Cloudera Manager to be updated before updating CDH parcel.
... View more
02-01-2017
04:35 PM
Is this still the right way to configure the repo URL and get the latest CDH when available: http://archive.cloudera.com/cdh5/parcels/{latest_supported}/ I don't seem to find CDH 5.10 via Cloudera Manager. If I look at the 'latest' directory I notice the CDH version is 5.3.10: http://archive.cloudera.com/cdh5/parcels/latest/ Please let me know if the repo URL needs to be updated. Thanks!
... View more
Labels:
01-16-2017
03:48 PM
Is there a R package/parcel that is available to be installed across the CDH cluster? Thanks!
... View more
01-12-2017
04:24 PM
Given the size of the dataset, I believe the data fits in memory and its not providing any additional performance improvement. Thanks!
... View more
01-11-2017
08:20 PM
I got a table of size ~1gb and I tried to setup hdfs caching as described in this 'Using HDFS caching with Impala" doc, with replication factor of 2 I noticed that without hdfs caching the queries seem to be performing better. I'm using CDH 5.8.2. Is there anything I might be missing or can check why that is the case? Thanks!
... View more
Labels:
01-10-2017
09:14 AM
Any update on if this will be made available by Continuum or Cloudera anytime soon? Thanks!
... View more
01-04-2017
04:37 PM
I currently have this configured for the Anaconda parcel: https://repo.continuum.io/pkgs/misc/parcels/ This repo doesn't seem to have the Jessie compatible version of the parcel. Is there any other repo with the appropriate version of Anaconda parcel? Thanks!
... View more
Labels:
10-31-2016
09:47 PM
Thanks for the tutorial. Are there any workflow examples of how to handle the update and delete transactions and how to replicate it into HBase/Phoenix?
... View more
08-18-2016
01:24 AM
When using "--as-parquetfile" option to do "--hive-import", I'm running into this error: org.kitesdk.data.DatasetNotFoundException: Unknown dataset URI pattern: dataset:hive://<metastore>:9083/<table>
Check that JARs for hive datasets are on the classpath I've also passed the options to set the HIVE_HOME and HCAT_HOME: --hive-home
/opt/cloudera/parcels/CDH/lib/hive
--hcatalog-home
/opt/cloudera/parcels/CDH/lib/hive-hcatalog Is there anything else that need to be provided to the sqoop action in oozie? Thanks!
... View more
Labels:
05-23-2016
04:10 PM
Hi -- How does one go about setting limits on number of queries that a user can run, limits on number of resources (cpu cores, memory etc) a user can use via CM? Thanks!
... View more
04-26-2016
03:24 PM
I got multiple clusters and would like to move some nodes between clusters managed by Cloudera Manager. Is there any documentation on how to move node(s) from one cluster to another? Do the nodes need to be running on the same version of CDH? Thanks!
... View more
04-13-2016
05:11 PM
How does one go about installing CDH on Debian 8.0? Currently only wheezy parcels seem to be available.
... View more
04-11-2016
10:26 PM
Thanks for the info, I'm currently using CM 5.5.0. Will upgrade and verify the parcel.
... View more
04-11-2016
01:10 AM
I'm currently using CDH 5.5.1 and only notice parcel for 5.5.2 available for upgrading the cluster. I notice that there is 5.6.x and 5.7.x released but they do not show up as being available. Is there anything that needs to be configured? Thanks!
... View more
02-22-2016
02:46 PM
Thanks srowen! I did notice that I'm able to import 'spark.graphx._' but in the known issues for CDH 5.5 its marked as not supported so was checking: http://www.cloudera.com/documentation/enterprise/latest/topics/cdh_rn_spark_ki.html "GraphX not supported Cloudera does not support GraphX." It probably means its not supported in these forums 🙂
... View more
02-22-2016
02:32 PM
Is Graphx avaiable in the latest CDH distro? How to check if a specific pkg or lib is available in CDH in general? Thanks!
... View more
02-22-2016
10:51 AM
Currently using CDH 5.5.1 which has with Spark 1.5. Since there is already Spark v1.6, I wanted to know how the Cloudera community is deploying any newer versions while also handling the CDH upgrade scenarios. It will be really helpful if there is any recommended way to handle these without much hassle. Thanks!
... View more