Re: SDX Managed Namespace (Beta) with Data Warehou...

surajacharya · ‎02-11-2019

So the issue is that the environment you created is not a secure environment. You will need to create a new environment which is secure. It is a checkbox during environment creation.

surajacharya · ‎06-29-2018

You should be able to resolve the pypi mirrors. You can always download the latest bits from https://console.altus.cloudera.com/downloads/latest-cli too

surajacharya · ‎06-13-2018

So if you go to your subscription and then look at access control IAM. You should see a Cloudera altus application. Also, if your environment is created, you can go ahead and create the cluster and see if that succeeds. Hope this helps. Suraj

surajacharya · ‎06-13-2018

Hi @VamsiMN, Did you do the role assignment of Cloudera Service principle to your subscription? Here are the document on how to do it : https://www.cloudera.com/documentation/altus/topics/alt_env_setup_azure.html#role_based_access Regarding the error you see, I am sorry that we dont show a much more explicit error message. We will work on improving the error message so others dont run into the same issue again. Let me know if you have any more questions. Thanks Suraj

surajacharya · ‎10-27-2017

The code is available here[1]. The csds are by default preinstalled in CM though. [1]: https://github.com/cloudera/cm_csds

surajacharya · ‎05-25-2017

From the looks of it, the file permissions on the file : /opt/cloudera/security/CAcerts/cmhost-keystore.jks is incorrect. The process usually runs as cloudera-scm user. So check the permissions on that file.

surajacharya · ‎05-15-2017

Couple of things to note here: 1. You need to copy the csd to the /opt/cloudera/csd directory. This is what you want : http://archive.cloudera.com/spark2/csd/SPARK2_ON_YARN-2.1.0.cloudera1.jar 2. The parcel need not be downloaded. It should work after you make this change. Let me know if you have any troubles.

surajacharya · ‎03-28-2017

After it is downloaded, you will need to distribute it and unpack it too.

surajacharya · ‎03-24-2017

This link has the parcels present in it. http://archive.cloudera.com/cdh5/parcels/ You can enter this link in the parcel location, distribute your parcels and then you will be able to go further.

surajacharya · ‎01-31-2017

CDH5.10.0 released with Apache Impala 2.7.0 http://www.cloudera.com/documentation/enterprise/release-notes/topics/cdh_vd_cdh_package_tarball_510.html#tarball_510x The same is here : http://archive.cloudera.com/cdh5/redhat/6/x86_64/cdh/5.10.0/RPMS/x86_64/

surajacharya · ‎01-26-2017

If a node dies, it will be difficult to track which one died and which ones are running. If you have installed it completely outside of CM and are using an external Management tool, then you might have to deal with how other services interact with each other . Hope this helps.

surajacharya · ‎01-26-2017

If you are using Cloudera Manager, you can use the API present to do that. The end point you will like to use will be : /cm/service/roleCommands/restart I would not recommend to do restart outside of the CM cause the management will be difficult. Doc Link : https://cloudera.github.io/cm_api/apidocs/v12/

surajacharya · ‎01-24-2017

Currently Cloudera supports both 1.7 and 1.8. There is no support for Java 1.9 JAVA 1.9 is not expected to be GA till mid July.

surajacharya · ‎01-20-2017

reference document states that Only stateless roles can be used with Spot instances can somebody explain this (sorry if this is a lame question) A stateless role is something which as the name suggests doesnt hold any state. i.e. there is no data on it and mostly works as a compute node. One of the reasons why it is recommended only to use stateless roles on SPOT instances is that the SPOT instances can go away at anytime. The data on it is also lost. If you have data on it, then you will have some dataloss and that is not an ideal situation. However, if a stateless role is lost, you can create a new one in its place and the system will continue running as long as there is minimum servers present. Regarding the 1st question, I am not sure since I dont work directly with director. Hope atleast one question is resolved.

surajacharya · ‎01-20-2017

Cloudera Manager provides you with basic management of your cluster. It helps in starting and stopping the services and carries out other activities. If you are interested in running Hadoop without Cloudera Manager, you can use the vanilla CDH distribution present here : https://github.com/cloudera. The startup of the processes is a bit painful and you will need to follow the docs from apache to start the same. Hope this helps.

surajacharya · ‎01-20-2017

This will help you : http://www.cloudera.com/downloads/quickstart_vms/5-8.html The CDH5 version uses only 4GB. But if you want to run heavy workloads, you will need to more RAM.

surajacharya · ‎01-18-2017

There was no version of CM 5.7.3 released to the public. We did release CDH 5.7.3. You might have had CM 5.7.4 and CDH 5.7.3 Hope that helps.

surajacharya · ‎01-17-2017

This command should also help you get the size of HIVE table : ANALYZE TABLE tablename [PARTITION(partcol1[=val1], partcol2[=val2], ...)] COMPUTE STATISTICS [noscan];

surajacharya · ‎01-17-2017

Currently cloudera does not have a parcel with R present in it. If you are trying to run it with spark, here is a good discussion about it. https://community.cloudera.com/t5/Advanced-Analytics-Apache-Spark/SparkR-in-CDH-5-5/td-p/34602

surajacharya · ‎01-17-2017

The best place to look is the code base : https://github.com/cloudera/hbase.git Seems like the issue was resolved by HBASE-16345. The commit message to fix it is : 575de1dd44a3b32f8d996f12da893a6c67721ac9 It is not present in 5.9.0 but it is present in 5.9.1. Hope that helps.

surajacharya · ‎01-17-2017

Eric Sammer (author of Hadoop Operations) has written a great answer about the same here: https://www.quora.com/What-is-the-best-directory-structure-to-store-different-types-of-logs-in-HDFS-over-the-time/answer/Eric-Sammer Hadoop Operations is a great book and has quite a few good tricks.

surajacharya · ‎01-17-2017

I am not sure how you have deployed the csd and the JAR file in the cluster. Usually the location is somewhat similar to /opt/cloduera/csd/. If you put the JAR file out there and when you run the /csd/refresh link you should see the "NIFI" csd in the list. After that, you will need to install the csd at /csd/install. Do note you need to put the jar only on the CM node and dont need to install it on all the nodes. Doc link : http://github.mtv.cloudera.com/Starship/cm_ext/wiki/CSD-Developer-Tricks-and-Tools Hope it helps.

surajacharya · ‎01-17-2017

From the description I would like to say that the csd may not be installed on the CM in question. A quick way to check this is : http://CLOUDERA_MANAGER:7180/csd/refresh. Check if you can see the CSD present and is installed. If not you will need to install the CSD and after that you will be able to see the service.

Online	Offline
Last Visited	‎02-19-2019 07:43 PM

Date Registered	‎08-16-2016 04:36 PM
Last Visited	‎02-19-2019 07:43 PM
Total Messages Posted	48
Total Kudos Received	13

Re: SDX Managed Namespace (Beta) with Data Warehou...

Re: Not able to load CSD

Re: Restart Solr from command line

Re: Firefox can't establish a connection to the se...

Re: Cloudera QuickStart VM - Mac

Re: SDX Managed Namespace (Beta) with Data Warehou...

Re: windows altucli installation issue

Re: Getting An internal error while Linking Altus ...

Re: Getting An internal error while Linking Altus ...

Re: Not able to load CSD

Re: keystore permission denied error when trying t...

Re: Not able to load CSD

Re: Error when install Cloudera manager 5.10 on Ce...

Re: Error when install Cloudera manager 5.10 on Ce...

Re: CDH5.10 redhat repo doesn't have Impala 2.8 RP...

Re: Restart Solr from command line

Re: Restart Solr from command line

Re: using latest Java 1.8 or 1.9?

Re: Cloudera cluster on AWS spot instance

Re: Firefox can't establish a connection to the se...

Re: Cloudera QuickStart VM - Mac

Re: Cloudera Manager 5.7.3 archive missing

Re: Can we check size of Hive tables? If so - how?

Re: Installing R package on CDH cluster

Re: Does cdh 5.9 applied the patches for HBASE-161...

Re: HDFS Directory Structure Best Practices

Re: Installing Nifi with cloudera

Re: Installing Nifi with cloudera