About surajacharya

surajacharya · ‎02-19-2019

https://www.cloudera.com/documentation/enterprise/5-16-x/topics/key_hsm_setup.html#concept_nql_dfg_fr__section_bh2_25w_3r

surajacharya · ‎02-11-2019

So the issue is that the environment you created is not a secure environment. You will need to create a new environment which is secure. It is a checkbox during environment creation.

surajacharya · ‎06-29-2018

You should be able to resolve the pypi mirrors. You can always download the latest bits from https://console.altus.cloudera.com/downloads/latest-cli too

surajacharya · ‎06-13-2018

So if you go to your subscription and then look at access control IAM. You should see a Cloudera altus application. Also, if your environment is created, you can go ahead and create the cluster and see if that succeeds. Hope this helps. Suraj

surajacharya · ‎06-13-2018

Hi @VamsiMN, Did you do the role assignment of Cloudera Service principle to your subscription? Here are the document on how to do it : https://www.cloudera.com/documentation/altus/topics/alt_env_setup_azure.html#role_based_access Regarding the error you see, I am sorry that we dont show a much more explicit error message. We will work on improving the error message so others dont run into the same issue again. Let me know if you have any more questions. Thanks Suraj

surajacharya · ‎10-27-2017

The code is available here[1]. The csds are by default preinstalled in CM though. [1]: https://github.com/cloudera/cm_csds

surajacharya · ‎05-25-2017

From the looks of it, the file permissions on the file : /opt/cloudera/security/CAcerts/cmhost-keystore.jks is incorrect. The process usually runs as cloudera-scm user. So check the permissions on that file.

surajacharya · ‎05-15-2017

Couple of things to note here: 1. You need to copy the csd to the /opt/cloudera/csd directory. This is what you want : http://archive.cloudera.com/spark2/csd/SPARK2_ON_YARN-2.1.0.cloudera1.jar 2. The parcel need not be downloaded. It should work after you make this change. Let me know if you have any troubles.

surajacharya · ‎05-02-2017

Yes we do have support for using Cloudera and Safenet KeySecure. The product to integrate is called keyHSM https://www.cloudera.com/documentation/enterprise/latest/topics/sg_key_hsm.html Let me know if you have any further questions.

surajacharya · ‎03-28-2017

After it is downloaded, you will need to distribute it and unpack it too.

surajacharya · ‎03-24-2017

This link has the parcels present in it. http://archive.cloudera.com/cdh5/parcels/ You can enter this link in the parcel location, distribute your parcels and then you will be able to go further.

surajacharya · ‎02-15-2017

In your case : 2.1.0 -> Upstream version impala2.0.0 -> Clouedra specific version p0 -> Patch number 1995 ->Build number Hope that helps Doc link : https://www.cloudera.com/documentation/enterprise/release-notes/topics/cdh_vd_cdh_package_tarball.html#concept_c4n_gx3_dp

surajacharya · ‎01-31-2017

CDH5.10.0 released with Apache Impala 2.7.0 http://www.cloudera.com/documentation/enterprise/release-notes/topics/cdh_vd_cdh_package_tarball_510.html#tarball_510x The same is here : http://archive.cloudera.com/cdh5/redhat/6/x86_64/cdh/5.10.0/RPMS/x86_64/

surajacharya · ‎01-26-2017

If a node dies, it will be difficult to track which one died and which ones are running. If you have installed it completely outside of CM and are using an external Management tool, then you might have to deal with how other services interact with each other . Hope this helps.

surajacharya · ‎01-26-2017

If you are using Cloudera Manager, you can use the API present to do that. The end point you will like to use will be : /cm/service/roleCommands/restart I would not recommend to do restart outside of the CM cause the management will be difficult. Doc Link : https://cloudera.github.io/cm_api/apidocs/v12/

surajacharya · ‎01-24-2017

Currently Cloudera supports both 1.7 and 1.8. There is no support for Java 1.9 JAVA 1.9 is not expected to be GA till mid July.

surajacharya · ‎01-20-2017

This link should provide you with more information : https://www.cloudera.com/documentation/enterprise/latest/topics/cdh_admin_distcp_data_cluster_migrate.html#concept_hcs_srr_sr If you are going to secure the data over the wire, you will need to setup the truststore on both the clusters.

surajacharya · ‎01-20-2017

If you are using VMWare Workstation then you will need to get the Port and IP you have set for the VM. You can also use straightforward drag and drop, I have attached a link in the bottom. If you want to use WinSCP, you will need to setup portforwarding on the machine to copy data in. Hope this helps. DOC link: https://www.vmware.com/support/ws5/doc/ws_running_dragndrop.html

surajacharya · ‎01-20-2017

reference document states that Only stateless roles can be used with Spot instances can somebody explain this (sorry if this is a lame question) A stateless role is something which as the name suggests doesnt hold any state. i.e. there is no data on it and mostly works as a compute node. One of the reasons why it is recommended only to use stateless roles on SPOT instances is that the SPOT instances can go away at anytime. The data on it is also lost. If you have data on it, then you will have some dataloss and that is not an ideal situation. However, if a stateless role is lost, you can create a new one in its place and the system will continue running as long as there is minimum servers present. Regarding the 1st question, I am not sure since I dont work directly with director. Hope atleast one question is resolved.

surajacharya · ‎01-20-2017

Cloudera Manager provides you with basic management of your cluster. It helps in starting and stopping the services and carries out other activities. If you are interested in running Hadoop without Cloudera Manager, you can use the vanilla CDH distribution present here : https://github.com/cloudera. The startup of the processes is a bit painful and you will need to follow the docs from apache to start the same. Hope this helps.

surajacharya · ‎01-20-2017

This will help you : http://www.cloudera.com/downloads/quickstart_vms/5-8.html The CDH5 version uses only 4GB. But if you want to run heavy workloads, you will need to more RAM.

surajacharya · ‎01-20-2017

We currently dont support Ubuntu 16.04. We are working on it, and will be in the upcoming releases.

surajacharya · ‎01-18-2017

There was no version of CM 5.7.3 released to the public. We did release CDH 5.7.3. You might have had CM 5.7.4 and CDH 5.7.3 Hope that helps.

surajacharya · ‎01-17-2017

This is a well written blog. I had a few points to add to it: HDFS Data At Rest Encryption (EDEK) One is also able to protect the data from someone who walks away with the disk. HDFS wire Encryption Setting up wire encryption will prevent network traffic snoopers from accessing the data when it is in motion. Wire encryption along with Encryption at rest will cause end to end protection of data.

surajacharya · ‎01-17-2017

This command should also help you get the size of HIVE table : ANALYZE TABLE tablename [PARTITION(partcol1[=val1], partcol2[=val2], ...)] COMPUTE STATISTICS [noscan];

surajacharya · ‎01-17-2017

Currently cloudera does not have a parcel with R present in it. If you are trying to run it with spark, here is a good discussion about it. https://community.cloudera.com/t5/Advanced-Analytics-Apache-Spark/SparkR-in-CDH-5-5/td-p/34602

surajacharya · ‎01-17-2017

The best place to look is the code base : https://github.com/cloudera/hbase.git Seems like the issue was resolved by HBASE-16345. The commit message to fix it is : 575de1dd44a3b32f8d996f12da893a6c67721ac9 It is not present in 5.9.0 but it is present in 5.9.1. Hope that helps.

surajacharya · ‎01-17-2017

Eric Sammer (author of Hadoop Operations) has written a great answer about the same here: https://www.quora.com/What-is-the-best-directory-structure-to-store-different-types-of-logs-in-HDFS-over-the-time/answer/Eric-Sammer Hadoop Operations is a great book and has quite a few good tricks.

surajacharya · ‎01-17-2017

I am not sure how you have deployed the csd and the JAR file in the cluster. Usually the location is somewhat similar to /opt/cloduera/csd/. If you put the JAR file out there and when you run the /csd/refresh link you should see the "NIFI" csd in the list. After that, you will need to install the csd at /csd/install. Do note you need to put the jar only on the CM node and dont need to install it on all the nodes. Doc link : http://github.mtv.cloudera.com/Starship/cm_ext/wiki/CSD-Developer-Tricks-and-Tools Hope it helps.

surajacharya · ‎01-17-2017

You might want to remove the firewall for internal communication. Might allow port 9000/9001 on the hosts. This document has some more port information : http://www.cloudera.com/documentation/enterprise/latest/topics/cm_ig_ports_cm.html#xd_583c10bfdbd326ba-3ca24a24-13d80143249--7eec

Online	Offline
Last Visited	‎02-19-2019 07:43 PM

Date Registered	‎08-16-2016 04:36 PM
Last Visited	‎02-19-2019 07:43 PM
Total Messages Posted	48
Total Kudos Received	14

Re: SDX Managed Namespace (Beta) with Data Warehou...

Re: Not able to load CSD

Re: Restart Solr from command line

Re: Firefox can't establish a connection to the se...

Re: Cloudera QuickStart VM - Mac

Re: safe net key secure

Re: SDX Managed Namespace (Beta) with Data Warehou...

Re: windows altucli installation issue

Re: Getting An internal error while Linking Altus ...

Re: Getting An internal error while Linking Altus ...

Re: Not able to load CSD

Re: keystore permission denied error when trying t...

Re: Not able to load CSD

Re: safe net key secure

Re: Error when install Cloudera manager 5.10 on Ce...

Re: Error when install Cloudera manager 5.10 on Ce...

Re: what is

Re: CDH5.10 redhat repo doesn't have Impala 2.8 RP...

Re: Restart Solr from command line

Re: Restart Solr from command line

Re: using latest Java 1.8 or 1.9?

Re: Securing Distcp between two CDH5 clusters

Re: WinSCP and Cloudera Quickstart

Re: Cloudera cluster on AWS spot instance

Re: Firefox can't establish a connection to the se...

Re: Cloudera QuickStart VM - Mac

Re: Cloudera installation on Ubuntu 16.04.1 LTS

Re: Cloudera Manager 5.7.3 archive missing

Re: Hadoop Security for beginners

Re: Can we check size of Hive tables? If so - how?

Re: Installing R package on CDH cluster

Re: Does cdh 5.9 applied the patches for HBASE-161...

Re: HDFS Directory Structure Best Practices

Re: Installing Nifi with cloudera

Re: Error while setting up single node cluster usi...