Member since
08-16-2016
48
Posts
14
Kudos Received
9
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
364 | 02-11-2019 05:40 PM | |
2901 | 05-15-2017 03:07 PM | |
3011 | 01-26-2017 02:05 PM | |
14959 | 01-20-2017 03:17 PM | |
4006 | 01-20-2017 03:12 PM |
02-19-2019
04:22 PM
https://www.cloudera.com/documentation/enterprise/5-16-x/topics/key_hsm_setup.html#concept_nql_dfg_fr__section_bh2_25w_3r
... View more
02-11-2019
05:40 PM
1 Kudo
So the issue is that the environment you created is not a secure environment. You will need to create a new environment which is secure. It is a checkbox during environment creation.
... View more
06-29-2018
10:03 AM
You should be able to resolve the pypi mirrors. You can always download the latest bits from https://console.altus.cloudera.com/downloads/latest-cli too
... View more
06-13-2018
07:12 PM
So if you go to your subscription and then look at access control IAM. You should see a Cloudera altus application. Also, if your environment is created, you can go ahead and create the cluster and see if that succeeds. Hope this helps. Suraj
... View more
06-13-2018
08:33 AM
Hi @VamsiMN, Did you do the role assignment of Cloudera Service principle to your subscription? Here are the document on how to do it : https://www.cloudera.com/documentation/altus/topics/alt_env_setup_azure.html#role_based_access Regarding the error you see, I am sorry that we dont show a much more explicit error message. We will work on improving the error message so others dont run into the same issue again. Let me know if you have any more questions. Thanks Suraj
... View more
10-27-2017
09:50 AM
The code is available here[1]. The csds are by default preinstalled in CM though. [1]: https://github.com/cloudera/cm_csds
... View more
05-25-2017
12:50 PM
From the looks of it, the file permissions on the file : /opt/cloudera/security/CAcerts/cmhost-keystore.jks is incorrect. The process usually runs as cloudera-scm user. So check the permissions on that file.
... View more
05-15-2017
03:07 PM
Couple of things to note here: 1. You need to copy the csd to the /opt/cloudera/csd directory. This is what you want : http://archive.cloudera.com/spark2/csd/SPARK2_ON_YARN-2.1.0.cloudera1.jar 2. The parcel need not be downloaded. It should work after you make this change. Let me know if you have any troubles.
... View more
05-02-2017
07:29 AM
1 Kudo
Yes we do have support for using Cloudera and Safenet KeySecure. The product to integrate is called keyHSM https://www.cloudera.com/documentation/enterprise/latest/topics/sg_key_hsm.html Let me know if you have any further questions.
... View more
03-28-2017
07:55 AM
After it is downloaded, you will need to distribute it and unpack it too.
... View more
03-24-2017
01:25 PM
This link has the parcels present in it. http://archive.cloudera.com/cdh5/parcels/ You can enter this link in the parcel location, distribute your parcels and then you will be able to go further.
... View more
02-15-2017
12:38 PM
In your case : 2.1.0 -> Upstream version impala2.0.0 -> Clouedra specific version p0 -> Patch number 1995 ->Build number Hope that helps Doc link : https://www.cloudera.com/documentation/enterprise/release-notes/topics/cdh_vd_cdh_package_tarball.html#concept_c4n_gx3_dp
... View more
01-31-2017
02:05 PM
1 Kudo
CDH5.10.0 released with Apache Impala 2.7.0 http://www.cloudera.com/documentation/enterprise/release-notes/topics/cdh_vd_cdh_package_tarball_510.html#tarball_510x The same is here : http://archive.cloudera.com/cdh5/redhat/6/x86_64/cdh/5.10.0/RPMS/x86_64/
... View more
01-26-2017
03:35 PM
If a node dies, it will be difficult to track which one died and which ones are running. If you have installed it completely outside of CM and are using an external Management tool, then you might have to deal with how other services interact with each other . Hope this helps.
... View more
01-26-2017
02:05 PM
1 Kudo
If you are using Cloudera Manager, you can use the API present to do that. The end point you will like to use will be : /cm/service/roleCommands/restart I would not recommend to do restart outside of the CM cause the management will be difficult. Doc Link : https://cloudera.github.io/cm_api/apidocs/v12/
... View more
01-24-2017
08:25 PM
Currently Cloudera supports both 1.7 and 1.8. There is no support for Java 1.9 JAVA 1.9 is not expected to be GA till mid July.
... View more
01-20-2017
03:42 PM
This link should provide you with more information : https://www.cloudera.com/documentation/enterprise/latest/topics/cdh_admin_distcp_data_cluster_migrate.html#concept_hcs_srr_sr If you are going to secure the data over the wire, you will need to setup the truststore on both the clusters.
... View more
01-20-2017
03:26 PM
1 Kudo
If you are using VMWare Workstation then you will need to get the Port and IP you have set for the VM. You can also use straightforward drag and drop, I have attached a link in the bottom. If you want to use WinSCP, you will need to setup portforwarding on the machine to copy data in. Hope this helps. DOC link: https://www.vmware.com/support/ws5/doc/ws_running_dragndrop.html
... View more
01-20-2017
03:22 PM
1 Kudo
reference document states that Only stateless roles can be used with Spot instances can somebody explain this (sorry if this is a lame question) A stateless role is something which as the name suggests doesnt hold any state. i.e. there is no data on it and mostly works as a compute node. One of the reasons why it is recommended only to use stateless roles on SPOT instances is that the SPOT instances can go away at anytime. The data on it is also lost. If you have data on it, then you will have some dataloss and that is not an ideal situation. However, if a stateless role is lost, you can create a new one in its place and the system will continue running as long as there is minimum servers present. Regarding the 1st question, I am not sure since I dont work directly with director. Hope atleast one question is resolved.
... View more
01-20-2017
03:17 PM
1 Kudo
Cloudera Manager provides you with basic management of your cluster. It helps in starting and stopping the services and carries out other activities. If you are interested in running Hadoop without Cloudera Manager, you can use the vanilla CDH distribution present here : https://github.com/cloudera. The startup of the processes is a bit painful and you will need to follow the docs from apache to start the same. Hope this helps.
... View more
01-20-2017
03:12 PM
This will help you : http://www.cloudera.com/downloads/quickstart_vms/5-8.html The CDH5 version uses only 4GB. But if you want to run heavy workloads, you will need to more RAM.
... View more
01-20-2017
03:09 PM
We currently dont support Ubuntu 16.04. We are working on it, and will be in the upcoming releases.
... View more
01-18-2017
06:48 PM
1 Kudo
There was no version of CM 5.7.3 released to the public. We did release CDH 5.7.3. You might have had CM 5.7.4 and CDH 5.7.3 Hope that helps.
... View more
01-17-2017
05:43 PM
This is a well written blog. I had a few points to add to it: HDFS Data At Rest Encryption (EDEK) One is also able to protect the data from someone who walks away with the disk. HDFS wire Encryption Setting up wire encryption will prevent network traffic snoopers from accessing the data when it is in motion. Wire encryption along with Encryption at rest will cause end to end protection of data.
... View more
01-17-2017
05:38 PM
This command should also help you get the size of HIVE table : ANALYZE TABLE tablename [PARTITION(partcol1[=val1], partcol2[=val2], ...)] COMPUTE STATISTICS [noscan];
... View more
01-17-2017
03:30 PM
1 Kudo
Currently cloudera does not have a parcel with R present in it. If you are trying to run it with spark, here is a good discussion about it. https://community.cloudera.com/t5/Advanced-Analytics-Apache-Spark/SparkR-in-CDH-5-5/td-p/34602
... View more
01-17-2017
03:02 PM
1 Kudo
The best place to look is the code base : https://github.com/cloudera/hbase.git Seems like the issue was resolved by HBASE-16345. The commit message to fix it is : 575de1dd44a3b32f8d996f12da893a6c67721ac9 It is not present in 5.9.0 but it is present in 5.9.1. Hope that helps.
... View more
01-17-2017
01:01 PM
Eric Sammer (author of Hadoop Operations) has written a great answer about the same here: https://www.quora.com/What-is-the-best-directory-structure-to-store-different-types-of-logs-in-HDFS-over-the-time/answer/Eric-Sammer Hadoop Operations is a great book and has quite a few good tricks.
... View more
01-17-2017
12:50 PM
1 Kudo
I am not sure how you have deployed the csd and the JAR file in the cluster. Usually the location is somewhat similar to /opt/cloduera/csd/. If you put the JAR file out there and when you run the /csd/refresh link you should see the "NIFI" csd in the list. After that, you will need to install the csd at /csd/install. Do note you need to put the jar only on the CM node and dont need to install it on all the nodes. Doc link : http://github.mtv.cloudera.com/Starship/cm_ext/wiki/CSD-Developer-Tricks-and-Tools Hope it helps.
... View more
01-17-2017
12:36 PM
You might want to remove the firewall for internal communication. Might allow port 9000/9001 on the hosts. This document has some more port information : http://www.cloudera.com/documentation/enterprise/latest/topics/cm_ig_ports_cm.html#xd_583c10bfdbd326ba-3ca24a24-13d80143249--7eec
... View more