About nmaheshwari

nmaheshwari · ‎12-20-2017

Today the HDFS balancer doesn't balance disks within a DataNode This is a pretty known and talked about issue with HDFS balancer. See apache jira - https://issues.apache.org/jira/browse/HDFS-1312 The apache documentation is - https://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-hdfs/HDFSDiskbalancer.html This tracks and resolve this issue.

nmaheshwari · ‎07-27-2017

@ashutosh bajpai-Sorry to hear that your experience was not good. I would recommend for answers specific to your particular exam, please send email to certification@hortonworks.com

nmaheshwari · ‎06-29-2017

@Saurab Dahal - As in the other answers the change in hdfs-site.xml will only affect the newly created files with the new replication factor. If you want to change replication factor for already existing files. You can run the hdfs cli commands like below: hdfs dfs -setrep -w 1 /myfile hdfs dfs -setrep -w 1 /mydir Hope this helps !

nmaheshwari · ‎06-21-2017

Yes, that is correct

nmaheshwari · ‎06-21-2017

Ping @ssathish

nmaheshwari · ‎06-21-2017

You can simply run hdfs cli commands to delete objects on S3 hdfs dfs -rm -r -f -skipTrash s3a://S3_BUCKET_NAME/S3_PATH This however will only works if you have specified S3 properties (fs.s3a.access.key, fs.s3a.secret.key) in core-site.xml

nmaheshwari · ‎06-21-2017

Ping @Arpit Agarwal

nmaheshwari · ‎06-20-2017

Ping @Kshitij Badani

nmaheshwari · ‎06-20-2017

Ping @Kshitij Badani

nmaheshwari · ‎06-20-2017

@Kareem Amin - Sorry to hear that your experience was not good. There are few below threads related to your experience: https://community.hortonworks.com/questions/33690/hdpcd-exam-network-issues.html#answer-33724 https://community.hortonworks.com/questions/82013/hdpcd-spark-when-can-i-expect-result.html#answer-82024 Also, for answers specific to your particular exam, please send email to certification@hortonworks.com

nmaheshwari · ‎06-20-2017

The below post also talks about similar issue: https://community.hortonworks.com/questions/75377/zeppelin-livy-interpreter-not-working-with-kerbero.html Please see if this helps.

nmaheshwari · ‎06-16-2017

@mayki wogno - I think you accidentally posted the same question twice: https://community.hortonworks.com/questions/107715/nifi-130-getftp-read-timed-out.htm

nmaheshwari · ‎06-16-2017

@mayki wogno - I think you accidentally posted the same question twice: https://community.hortonworks.com/questions/107715/nifi-130-getftp-read-timed-out.htm

nmaheshwari · ‎06-16-2017

@mayki wogno - I think you accidentally posted the same question twice: https://community.hortonworks.com/questions/107715/nifi-130-getftp-read-timed-out.htm

nmaheshwari · ‎06-16-2017

There is currently no practice exam for the Spark exam. If you need experience writing Spark applications on HDP using Python or Scala, I recommend downloading the Sandbox and working through the Hortonworks Spark tutorials. Also below threads have good details: https://community.hortonworks.com/questions/45535/hdpcd-spark-environment.html https://community.hortonworks.com/questions/70180/hdpcd-spark-exam.html https://community.hortonworks.com/questions/64278/hdpcd-spark-certification.html

nmaheshwari · ‎06-16-2017

Ping @Raghav Kumar Gautam

nmaheshwari · ‎06-12-2017

@Ivan Majnaric - I think you accidentally posted the same question twice: https://community.hortonworks.com/questions/107268/yarn-threshold-error.html

nmaheshwari · ‎06-12-2017

@Ivan Majnaric- I think you accidentally posted the same question twice: https://community.hortonworks.com/questions/107268/yarn-threshold-error.html

nmaheshwari · ‎06-08-2017

Please see below post on how to remove old HDP version: https://community.hortonworks.com/questions/21876/how-to-remove-an-old-hdp-version.html

nmaheshwari · ‎06-08-2017

Below are couple of good blogs: https://elitedatascience.com/r-vs-python-for-data-science http://www.kdnuggets.com/2015/05/r-vs-python-data-science.html Go through these, and see if you can come to a conclusion. My preference is however Python.

nmaheshwari · ‎06-08-2017

@shivanand khobanna - I think you accidentally asked the same question twice: https://community.hortonworks.com/questions/106919/error-with-insert-statement-in-puthiveql-processor-1.html Can you please close this one.

nmaheshwari · ‎06-06-2017

@Xiong Duan - Looks like you accidentally posted the same question twice: https://community.hortonworks.com/questions/106117/hihow-to-make-hadoop-to-read-the-configuration-fil-1.html Can you please close this one

nmaheshwari · ‎06-02-2017

@Aneesh Ramadoss - I think you asked the same question twice: https://community.hortonworks.com/questions/105715/how-to-select-a-specific-aws-amisrhel-71-for-creat-1.html Can you please close this one

nmaheshwari · ‎06-02-2017

@Naveen Keshava - Please read the documentation related to Storage Connectors: https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.6.1/bk_cloud-data-access/content/intro.html Using these you should be able to read / write data from S3 However, please note that this is a new feature released with HDP 2.6.1, so make sure to use the latest HDP version.

nmaheshwari · ‎06-02-2017

I have never seen Checkpoint/Backup node being used in practice and these should be considered deprecated. I recommend using NameNode HA which eliminates the single point of failure. More details in below post: https://community.hortonworks.com/questions/85184/checkpoint-node-vs-secondary-namenode.html

nmaheshwari · ‎06-02-2017

Can you please do ps -ef | grep namenode On the cluster, and see what all processes comes back. It looks like there is a Namenode process already running, and when you try to start that again it fails to start another one (which is the correct behavior). I will recommend to stop all the processes returned by the above command, and then restarting the Namenode again.

nmaheshwari · ‎06-02-2017

@Shyam Shaw - As @Dominika Bialek also mentioned, this feature was introduced in HDP 2.6.1 I have confirmed this with HDFS Development team and this is not part of HDP 2.5.3 Please upgrade your cluster to the latest HDP version (HDP 2.6.1) to use this feature. Hope this clarifies your issue.

nmaheshwari · ‎06-02-2017

@Pulak Nath - The questions will not change, as that is a sample exam intended for practice purposes. I will recommend to go through all the topics before appearing for the exam. Hope this clarifies!

nmaheshwari · ‎06-02-2017

Below posts might help: https://community.hortonworks.com/questions/63761/sqoop-import-to-hive-again-stroing-repeted-recorde.html https://community.hortonworks.com/questions/51508/sqoop-imported-more-records-than-source.html

nmaheshwari · ‎05-30-2017

Below are couple of posts which might help: https://community.hortonworks.com/articles/102728/installing-anaconda-python-on-hdp-cluster-using-cl.html https://community.hortonworks.com/articles/75551/installing-and-exploring-spark-20-with-jupyter-not.html

Online	Offline
Last Visited	‎09-24-2018 04:24 AM

Date Registered	‎09-15-2015 06:18 PM
Last Visited	‎09-24-2018 04:24 AM
Total Messages Posted	294
Total Kudos Received	739

Re: certification

Re: Replication factor not changed in HDFS from hd...

Re: Does anyone know how to execute aws cli fomman...

Re: HPCPD Exam Results not Received

Re: [NIFI 1.3.0] getFTP : Read timed out

Re: HDFS is not rebalancing after adding new DataN...

Re: certification

Re: Replication factor not changed in HDFS from hd...

Re: Does anyone know how to execute aws cli fomman...

Re: After upgrading to HDP 2.6.1 the system is not...

Re: Does anyone know how to execute aws cli fomman...

Re: Best practice to connect to remote HA hdfs clu...

Re: Is there a limit on the number of joins that c...

Re: auto save and note.json issues in Zeppelin

Re: HPCPD Exam Results not Received

Re: Livy Zeppelin Interpreter 'Cannot Start Spark'

Re: [NIFI 1.3.0] getFTP : Read timed out

Re: [NIFI 1.3.0] getFTP : Read timed out

Re: [NIFI 1.3.0] getFTP : Read timed out

Re: HDPCD- Spark Exam details

Re: SAM fail to get schema from Schema Registry

Re: Yarn Threshold error

Re: Yarrn RM trashold error

Re: Install, Start and Test : directory not exist

Re: R vs Python

Re: error with insert statement in puthiveql proce...

Re: Hi,How to make hadoop to read the configuratio...

Re: how to select a Specific AWS AMI's(RHEL 7.1) f...

Re: Is it possible to perform processing on s3 buc...

Re: Secondary NameNode, CheckpointNode or BackupNo...

Re: NameNode keeps going down

Re: Issue while configuring Encryption (SSE-KMS) f...

Re: In HDPCD practice exam in AWS same sets of 10 ...

Re: How to deal with duplicate values while import...

Re: Need Documentation on installing Anaconda Spyd...