@sai venkatesh Any updates? ... View more

please find the output [root@edge conf]# /usr/bin/hdp-select | grep hdfs hadoop-hdfs-datanode - 2.4.3.0-227 hadoop-hdfs-journalnode - 2.4.3.0-227 hadoop-hdfs-namenode - 2.4.3.0-227 hadoop-hdfs-nfs3 - 2.4.3.0-227 hadoop-hdfs-portmap - 2.4.3.0-227 hadoop-hdfs-secondarynamenode - 2.4.3.0-227 [root@node1 ~]# /usr/bin/hdp-select | grep hdfs hadoop-hdfs-datanode - 2.4.3.0-227 hadoop-hdfs-journalnode - 2.4.3.0-227 hadoop-hdfs-namenode - 2.4.3.0-227 hadoop-hdfs-nfs3 - 2.4.3.0-227 hadoop-hdfs-portmap - 2.4.3.0-227 hadoop-hdfs-secondarynamenode - 2.4.3.0-227 [root@node1 ~]# [root@edge conf]# yum info hadoop-yarn^C [root@edge conf]# yum info hadoop-hdfs Loaded plugins: fastestmirror, security Repository HDP-UTILS-1.1.0.20 is listed more than once in the configuration Loading mirror speeds from cached hostfile Available Packages Name : hadoop-hdfs Arch : noarch Version : 2.7.1.2.4.3.0 Release : 227.el6 Size : 2.5 k Repo : HDP-2.4 Summary : hadoop-hdfs Distro virtual package License : APL2 Description : hadoop-hdfs-2.7.1.2.4.3.0 virtual package ... View more

@sai venkatesh Here is a good start, because of every cluster environment is different so one can't give you a configuration that will work optimally on your cluster. Please read and understand the Distribution of Executors, Cores and Memory for a Spark Application ... View more

@sai venkatesh Correct me if I am wrong, you are importing data from Teradata to HDFS/Hive using Sqoop. If yes, then please note that Hive by default treats newline characters as row delimiters which would affect the data reads. ... View more

Can some one advice the below issue???? ... View more

Hi, I am using the Cloudera Quickstart VM (CDH 5.8) on both Mac OS and Windows without a problem.   Some things to check and general questions: 1. Did you download the VMWare version of the VM? (you would select VMWare from the pulldown menu)   2. Did you confirm that the entire zip file downloaded successfully? - check the file size and checksum against those posted on the website   3. If you are on Windows, have you enabled virtualization (this has to be done when booting up the host). (If you need steps for doing this, I can provide them.)   4. When you say Centos booted but the VM did not boot up - do you mean that the VM started, Centos booted, and then nothing happened after that - the VM looks like it stopped running?   5. How much memory is in your machine - the website says that at least 4GB of memory are required just for the VM, so if your machine only has 4GB of physical memory, the VM will not run. I have seen the VM work in 3GB of memory, so you could try that, but it will be a bit slow.   This may also be helpful: How to setup Cloudera Quickstart Virtual Machine   ... View more