Member since
07-16-2016
22
Posts
0
Kudos Received
3
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
1942 | 08-17-2017 03:33 AM | |
1880 | 08-10-2017 06:40 AM | |
1379 | 12-23-2016 02:07 AM |
09-01-2017
05:25 AM
@csguna wrote: we its not madatory that you need have your qucikstart vm , as long your HDFS looks good in your cluster , you should be able to follow that tutorial and execute the Mapreduce Thanks! It works! I think cloudera shoud modify the tutorials because are not valid. Many thanks for your time csguna
... View more
08-31-2017
05:58 AM
I don't have either quickstar vm @csguna wrote: I dont have quickstart vm , so I assume this jar will have your wordcount.java if you extract . hadoop-mapreduce-examples-2.6.0-cdh5.12.0.jar -
under this directory opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/ I really recommend you to take a look in to the below link that walkthrough as how to run the sample wordcount java in quickstart http://www.joshuaburkholder.com/blog/2014/05/15/how-to-run-ava-mrv2-using-hadoop/
... View more
08-30-2017
02:26 PM
Sorry for the delay david@clusterb1:~$ ls -ltr /opt/cloudera/parcels/CDH/lib/hadoop/
total 140
lrwxrwxrwx 1 root root 37 jun 29 13:26 parquet-format-sources.jar -> ../parquet/parquet-format-sources.jar
lrwxrwxrwx 1 root root 37 jun 29 13:26 parquet-format-javadoc.jar -> ../parquet/parquet-format-javadoc.jar
lrwxrwxrwx 1 root root 29 jun 29 13:26 parquet-format.jar -> ../parquet/parquet-format.jar
lrwxrwxrwx 1 root root 28 jun 29 13:33 parquet-tools.jar -> ../parquet/parquet-tools.jar
lrwxrwxrwx 1 root root 29 jun 29 13:33 parquet-thrift.jar -> ../parquet/parquet-thrift.jar
lrwxrwxrwx 1 root root 35 jun 29 13:33 parquet-test-hadoop2.jar -> ../parquet/parquet-test-hadoop2.jar
lrwxrwxrwx 1 root root 35 jun 29 13:33 parquet-scrooge_2.10.jar -> ../parquet/parquet-scrooge_2.10.jar
lrwxrwxrwx 1 root root 33 jun 29 13:33 parquet-scala_2.10.jar -> ../parquet/parquet-scala_2.10.jar
lrwxrwxrwx 1 root root 31 jun 29 13:33 parquet-protobuf.jar -> ../parquet/parquet-protobuf.jar
lrwxrwxrwx 1 root root 26 jun 29 13:33 parquet-pig.jar -> ../parquet/parquet-pig.jar
lrwxrwxrwx 1 root root 33 jun 29 13:33 parquet-pig-bundle.jar -> ../parquet/parquet-pig-bundle.jar
lrwxrwxrwx 1 root root 30 jun 29 13:33 parquet-jackson.jar -> ../parquet/parquet-jackson.jar
lrwxrwxrwx 1 root root 29 jun 29 13:33 parquet-hadoop.jar -> ../parquet/parquet-hadoop.jar
lrwxrwxrwx 1 root root 36 jun 29 13:33 parquet-hadoop-bundle.jar -> ../parquet/parquet-hadoop-bundle.jar
lrwxrwxrwx 1 root root 32 jun 29 13:33 parquet-generator.jar -> ../parquet/parquet-generator.jar
lrwxrwxrwx 1 root root 31 jun 29 13:33 parquet-encoding.jar -> ../parquet/parquet-encoding.jar
lrwxrwxrwx 1 root root 29 jun 29 13:33 parquet-common.jar -> ../parquet/parquet-common.jar
lrwxrwxrwx 1 root root 29 jun 29 13:33 parquet-column.jar -> ../parquet/parquet-column.jar
lrwxrwxrwx 1 root root 32 jun 29 13:33 parquet-cascading.jar -> ../parquet/parquet-cascading.jar
lrwxrwxrwx 1 root root 27 jun 29 13:33 parquet-avro.jar -> ../parquet/parquet-avro.jar
drwxr-xr-x 2 root root 4096 jun 29 13:39 cloudera
drwxr-xr-x 2 root root 4096 jun 29 13:59 sbin
-rw-r--r-- 1 root root 14978 jun 29 13:59 NOTICE.txt
-rw-r--r-- 1 root root 85063 jun 29 13:59 LICENSE.txt
drwxr-xr-x 2 root root 4096 jun 29 14:00 bin
lrwxrwxrwx 1 root root 30 jun 29 14:00 hadoop-nfs.jar -> hadoop-nfs-2.6.0-cdh5.12.0.jar
lrwxrwxrwx 1 root root 39 jun 29 14:00 hadoop-common-tests.jar -> hadoop-common-2.6.0-cdh5.12.0-tests.jar
lrwxrwxrwx 1 root root 33 jun 29 14:00 hadoop-common.jar -> hadoop-common-2.6.0-cdh5.12.0.jar
lrwxrwxrwx 1 root root 41 jun 29 14:00 hadoop-azure-datalake.jar -> hadoop-azure-datalake-2.6.0-cdh5.12.0.jar
lrwxrwxrwx 1 root root 30 jun 29 14:00 hadoop-aws.jar -> hadoop-aws-2.6.0-cdh5.12.0.jar
lrwxrwxrwx 1 root root 31 jun 29 14:00 hadoop-auth.jar -> hadoop-auth-2.6.0-cdh5.12.0.jar
lrwxrwxrwx 1 root root 38 jun 29 14:00 hadoop-annotations.jar -> hadoop-annotations-2.6.0-cdh5.12.0.jar
drwxr-xr-x 2 root root 4096 jun 29 15:17 client-0.20
drwxr-xr-x 2 root root 12288 jun 29 15:17 client
drwxr-xr-x 2 root root 4096 jun 29 15:17 etc
drwxr-xr-x 2 root root 4096 jun 29 15:22 libexec
lrwxrwxrwx 1 root root 50 jun 29 15:23 hadoop-common-2.6.0-cdh5.12.0-tests.jar -> ../../jars/hadoop-common-2.6.0-cdh5.12.0-tests.jar
lrwxrwxrwx 1 root root 52 jun 29 15:23 hadoop-azure-datalake-2.6.0-cdh5.12.0.jar -> ../../jars/hadoop-azure-datalake-2.6.0-cdh5.12.0.jar
lrwxrwxrwx 1 root root 42 jun 29 15:23 hadoop-auth-2.6.0-cdh5.12.0.jar -> ../../jars/hadoop-auth-2.6.0-cdh5.12.0.jar
drwxr-xr-x 3 root root 4096 jun 29 15:23 lib
lrwxrwxrwx 1 root root 41 jun 29 15:23 hadoop-nfs-2.6.0-cdh5.12.0.jar -> ../../jars/hadoop-nfs-2.6.0-cdh5.12.0.jar
lrwxrwxrwx 1 root root 44 jun 29 15:23 hadoop-common-2.6.0-cdh5.12.0.jar -> ../../jars/hadoop-common-2.6.0-cdh5.12.0.jar
lrwxrwxrwx 1 root root 41 jun 29 15:23 hadoop-aws-2.6.0-cdh5.12.0.jar -> ../../jars/hadoop-aws-2.6.0-cdh5.12.0.jar
lrwxrwxrwx 1 root root 49 jun 29 15:23 hadoop-annotations-2.6.0-cdh5.12.0.jar -> ../../jars/hadoop-annotations-2.6.0-cdh5.12.0.jar
david@clusterb1:~$ ls -ltr /opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/
total 140
drwxr-xr-x 2 root root 4096 jun 29 13:59 sbin
-rw-r--r-- 1 root root 14978 jun 29 13:59 NOTICE.txt
-rw-r--r-- 1 root root 85063 jun 29 13:59 LICENSE.txt
drwxr-xr-x 2 root root 4096 jun 29 13:59 cloudera
lrwxrwxrwx 1 root root 25 jun 29 14:00 logs -> /var/log/hadoop-mapreduce
lrwxrwxrwx 1 root root 36 jun 29 14:00 hadoop-streaming.jar -> hadoop-streaming-2.6.0-cdh5.12.0.jar
lrwxrwxrwx 1 root root 30 jun 29 14:00 hadoop-sls.jar -> hadoop-sls-2.6.0-cdh5.12.0.jar
lrwxrwxrwx 1 root root 32 jun 29 14:00 hadoop-rumen.jar -> hadoop-rumen-2.6.0-cdh5.12.0.jar
lrwxrwxrwx 1 root root 36 jun 29 14:00 hadoop-openstack.jar -> hadoop-openstack-2.6.0-cdh5.12.0.jar
lrwxrwxrwx 1 root root 45 jun 29 14:00 hadoop-mapreduce-examples.jar -> hadoop-mapreduce-examples-2.6.0-cdh5.12.0.jar
lrwxrwxrwx 1 root root 51 jun 29 14:00 hadoop-mapreduce-client-shuffle.jar -> hadoop-mapreduce-client-shuffle-2.6.0-cdh5.12.0.jar
lrwxrwxrwx 1 root root 54 jun 29 14:00 hadoop-mapreduce-client-nativetask.jar -> hadoop-mapreduce-client-nativetask-2.6.0-cdh5.12.0.jar
lrwxrwxrwx 1 root root 59 jun 29 14:00 hadoop-mapreduce-client-jobclient-tests.jar -> hadoop-mapreduce-client-jobclient-2.6.0-cdh5.12.0-tests.jar
lrwxrwxrwx 1 root root 46 jun 29 14:00 hadoop-mapreduce-client-hs.jar -> hadoop-mapreduce-client-hs-2.6.0-cdh5.12.0.jar
lrwxrwxrwx 1 root root 50 jun 29 14:00 hadoop-mapreduce-client-common.jar -> hadoop-mapreduce-client-common-2.6.0-cdh5.12.0.jar
lrwxrwxrwx 1 root root 47 jun 29 14:00 hadoop-mapreduce-client-app.jar -> hadoop-mapreduce-client-app-2.6.0-cdh5.12.0.jar
lrwxrwxrwx 1 root root 34 jun 29 14:00 hadoop-gridmix.jar -> hadoop-gridmix-2.6.0-cdh5.12.0.jar
lrwxrwxrwx 1 root root 32 jun 29 14:00 hadoop-azure.jar -> hadoop-azure-2.6.0-cdh5.12.0.jar
lrwxrwxrwx 1 root root 31 jun 29 14:00 hadoop-auth.jar -> hadoop-auth-2.6.0-cdh5.12.0.jar
lrwxrwxrwx 1 root root 35 jun 29 14:00 hadoop-archives.jar -> hadoop-archives-2.6.0-cdh5.12.0.jar
lrwxrwxrwx 1 root root 26 jun 29 14:00 zookeeper.jar -> ../zookeeper/zookeeper.jar
lrwxrwxrwx 1 root root 53 jun 29 14:00 hadoop-mapreduce-client-jobclient.jar -> hadoop-mapreduce-client-jobclient-2.6.0-cdh5.12.0.jar
lrwxrwxrwx 1 root root 54 jun 29 14:00 hadoop-mapreduce-client-hs-plugins.jar -> hadoop-mapreduce-client-hs-plugins-2.6.0-cdh5.12.0.jar
lrwxrwxrwx 1 root root 48 jun 29 14:00 hadoop-mapreduce-client-core.jar -> hadoop-mapreduce-client-core-2.6.0-cdh5.12.0.jar
lrwxrwxrwx 1 root root 33 jun 29 14:00 hadoop-extras.jar -> hadoop-extras-2.6.0-cdh5.12.0.jar
lrwxrwxrwx 1 root root 33 jun 29 14:00 hadoop-distcp.jar -> hadoop-distcp-2.6.0-cdh5.12.0.jar
lrwxrwxrwx 1 root root 35 jun 29 14:00 hadoop-datajoin.jar -> hadoop-datajoin-2.6.0-cdh5.12.0.jar
lrwxrwxrwx 1 root root 39 jun 29 14:00 hadoop-archive-logs.jar -> hadoop-archive-logs-2.6.0-cdh5.12.0.jar
lrwxrwxrwx 1 root root 30 jun 29 14:00 hadoop-ant.jar -> hadoop-ant-2.6.0-cdh5.12.0.jar
lrwxrwxrwx 1 root root 16 jun 29 14:00 avro.jar -> ../avro/avro.jar
drwxr-xr-x 2 root root 4096 jun 29 14:00 bin
lrwxrwxrwx 1 root root 25 jun 29 15:23 okio-1.4.0.jar -> ../../jars/okio-1.4.0.jar
lrwxrwxrwx 1 root root 65 jun 29 15:23 hadoop-mapreduce-client-nativetask-2.6.0-cdh5.12.0.jar -> ../../jars/hadoop-mapreduce-client-nativetask-2.6.0-cdh5.12.0.jar
lrwxrwxrwx 1 root root 21 jun 29 15:23 xz-1.0.jar -> ../../jars/xz-1.0.jar
lrwxrwxrwx 1 root root 26 jun 29 15:23 xmlenc-0.52.jar -> ../../jars/xmlenc-0.52.jar
lrwxrwxrwx 1 root root 28 jun 29 15:23 paranamer-2.3.jar -> ../../jars/paranamer-2.3.jar
lrwxrwxrwx 1 root root 37 jun 29 15:23 jackson-databind-2.2.3.jar -> ../../jars/jackson-databind-2.2.3.jar
lrwxrwxrwx 1 root root 29 jun 29 15:23 httpcore-4.2.5.jar -> ../../jars/httpcore-4.2.5.jar
lrwxrwxrwx 1 root root 47 jun 29 15:23 hadoop-openstack-2.6.0-cdh5.12.0.jar -> ../../jars/hadoop-openstack-2.6.0-cdh5.12.0.jar
lrwxrwxrwx 1 root root 57 jun 29 15:23 hadoop-mapreduce-client-hs-2.6.0-cdh5.12.0.jar -> ../../jars/hadoop-mapreduce-client-hs-2.6.0-cdh5.12.0.jar
lrwxrwxrwx 1 root root 58 jun 29 15:23 hadoop-mapreduce-client-app-2.6.0-cdh5.12.0.jar -> ../../jars/hadoop-mapreduce-client-app-2.6.0-cdh5.12.0.jar
lrwxrwxrwx 1 root root 42 jun 29 15:23 hadoop-auth-2.6.0-cdh5.12.0.jar -> ../../jars/hadoop-auth-2.6.0-cdh5.12.0.jar
lrwxrwxrwx 1 root root 30 jun 29 15:23 commons-net-3.1.jar -> ../../jars/commons-net-3.1.jar
lrwxrwxrwx 1 root root 34 jun 29 15:23 commons-math3-3.1.1.jar -> ../../jars/commons-math3-3.1.1.jar
lrwxrwxrwx 1 root root 36 jun 29 15:23 commons-logging-1.1.3.jar -> ../../jars/commons-logging-1.1.3.jar
lrwxrwxrwx 1 root root 29 jun 29 15:23 commons-io-2.4.jar -> ../../jars/commons-io-2.4.jar
lrwxrwxrwx 1 root root 40 jun 29 15:23 commons-collections-3.2.2.jar -> ../../jars/commons-collections-3.2.2.jar
lrwxrwxrwx 1 root root 32 jun 29 15:23 jersey-server-1.9.jar -> ../../jars/jersey-server-1.9.jar
lrwxrwxrwx 1 root root 34 jun 29 15:23 java-xmlbuilder-0.4.jar -> ../../jars/java-xmlbuilder-0.4.jar
lrwxrwxrwx 1 root root 36 jun 29 15:23 jasper-runtime-5.5.23.jar -> ../../jars/jasper-runtime-5.5.23.jar
lrwxrwxrwx 1 root root 31 jun 29 15:23 jackson-xc-1.8.8.jar -> ../../jars/jackson-xc-1.8.8.jar
lrwxrwxrwx 1 root root 40 jun 29 15:23 jackson-annotations-2.2.3.jar -> ../../jars/jackson-annotations-2.2.3.jar
lrwxrwxrwx 1 root root 70 jun 29 15:23 hadoop-mapreduce-client-jobclient-2.6.0-cdh5.12.0-tests.jar -> ../../jars/hadoop-mapreduce-client-jobclient-2.6.0-cdh5.12.0-tests.jar
lrwxrwxrwx 1 root root 44 jun 29 15:23 hadoop-extras-2.6.0-cdh5.12.0.jar -> ../../jars/hadoop-extras-2.6.0-cdh5.12.0.jar
lrwxrwxrwx 1 root root 44 jun 29 15:23 hadoop-distcp-2.6.0-cdh5.12.0.jar -> ../../jars/hadoop-distcp-2.6.0-cdh5.12.0.jar
lrwxrwxrwx 1 root root 36 jun 29 15:23 curator-recipes-2.7.1.jar -> ../../jars/curator-recipes-2.7.1.jar
lrwxrwxrwx 1 root root 31 jun 29 15:23 commons-lang-2.6.jar -> ../../jars/commons-lang-2.6.jar
lrwxrwxrwx 1 root root 37 jun 29 15:23 commons-httpclient-3.1.jar -> ../../jars/commons-httpclient-3.1.jar
lrwxrwxrwx 1 root root 35 jun 29 15:23 commons-digester-1.8.jar -> ../../jars/commons-digester-1.8.jar
lrwxrwxrwx 1 root root 37 jun 29 15:23 commons-compress-1.4.1.jar -> ../../jars/commons-compress-1.4.1.jar
lrwxrwxrwx 1 root root 22 jun 29 15:23 asm-3.2.jar -> ../../jars/asm-3.2.jar
lrwxrwxrwx 1 root root 38 jun 29 15:23 apacheds-i18n-2.0.0-M15.jar -> ../../jars/apacheds-i18n-2.0.0-M15.jar
lrwxrwxrwx 1 root root 34 jun 29 15:23 snappy-java-1.0.4.1.jar -> ../../jars/snappy-java-1.0.4.1.jar
lrwxrwxrwx 1 root root 27 jun 29 15:23 jsr305-3.0.0.jar -> ../../jars/jsr305-3.0.0.jar
lrwxrwxrwx 1 root root 26 jun 29 15:23 jsp-api-2.1.jar -> ../../jars/jsp-api-2.1.jar
lrwxrwxrwx 1 root root 38 jun 29 15:23 jetty-6.1.26.cloudera.4.jar -> ../../jars/jetty-6.1.26.cloudera.4.jar
lrwxrwxrwx 1 root root 27 jun 29 15:23 jettison-1.1.jar -> ../../jars/jettison-1.1.jar
lrwxrwxrwx 1 root root 27 jun 29 15:23 jets3t-0.9.0.jar -> ../../jars/jets3t-0.9.0.jar
lrwxrwxrwx 1 root root 37 jun 29 15:23 jackson-core-asl-1.8.8.jar -> ../../jars/jackson-core-asl-1.8.8.jar
lrwxrwxrwx 1 root root 44 jun 29 15:23 htrace-core4-4.0.1-incubating.jar -> ../../jars/htrace-core4-4.0.1-incubating.jar
lrwxrwxrwx 1 root root 32 jun 29 15:23 hamcrest-core-1.3.jar -> ../../jars/hamcrest-core-1.3.jar
lrwxrwxrwx 1 root root 43 jun 29 15:23 hadoop-rumen-2.6.0-cdh5.12.0.jar -> ../../jars/hadoop-rumen-2.6.0-cdh5.12.0.jar
lrwxrwxrwx 1 root root 62 jun 29 15:23 hadoop-mapreduce-client-shuffle-2.6.0-cdh5.12.0.jar -> ../../jars/hadoop-mapreduce-client-shuffle-2.6.0-cdh5.12.0.jar
lrwxrwxrwx 1 root root 64 jun 29 15:23 hadoop-mapreduce-client-jobclient-2.6.0-cdh5.12.0.jar -> ../../jars/hadoop-mapreduce-client-jobclient-2.6.0-cdh5.12.0.jar
lrwxrwxrwx 1 root root 43 jun 29 15:23 hadoop-azure-2.6.0-cdh5.12.0.jar -> ../../jars/hadoop-azure-2.6.0-cdh5.12.0.jar
lrwxrwxrwx 1 root root 50 jun 29 15:23 hadoop-archive-logs-2.6.0-cdh5.12.0.jar -> ../../jars/hadoop-archive-logs-2.6.0-cdh5.12.0.jar
lrwxrwxrwx 1 root root 30 jun 29 15:23 servlet-api-2.5.jar -> ../../jars/servlet-api-2.5.jar
drwxr-xr-x 2 root root 4096 jun 29 15:23 lib
lrwxrwxrwx 1 root root 26 jun 29 15:23 jsch-0.1.42.jar -> ../../jars/jsch-0.1.42.jar
lrwxrwxrwx 1 root root 32 jun 29 15:23 jaxb-impl-2.2.3-1.jar -> ../../jars/jaxb-impl-2.2.3-1.jar
lrwxrwxrwx 1 root root 37 jun 29 15:23 jasper-compiler-5.5.23.jar -> ../../jars/jasper-compiler-5.5.23.jar
lrwxrwxrwx 1 root root 61 jun 29 15:23 hadoop-mapreduce-client-common-2.6.0-cdh5.12.0.jar -> ../../jars/hadoop-mapreduce-client-common-2.6.0-cdh5.12.0.jar
lrwxrwxrwx 1 root root 29 jun 29 15:23 commons-el-1.0.jar -> ../../jars/commons-el-1.0.jar
lrwxrwxrwx 1 root root 43 jun 29 15:23 commons-beanutils-core-1.8.0.jar -> ../../jars/commons-beanutils-core-1.8.0.jar
lrwxrwxrwx 1 root root 29 jun 29 15:23 stax-api-1.0-2.jar -> ../../jars/stax-api-1.0-2.jar
lrwxrwxrwx 1 root root 32 jun 29 15:23 mockito-all-1.8.5.jar -> ../../jars/mockito-all-1.8.5.jar
lrwxrwxrwx 1 root root 55 jun 29 15:23 microsoft-windowsazure-storage-sdk-0.6.0.jar -> ../../jars/microsoft-windowsazure-storage-sdk-0.6.0.jar
lrwxrwxrwx 1 root root 33 jun 29 15:23 metrics-core-3.0.2.jar -> ../../jars/metrics-core-3.0.2.jar
lrwxrwxrwx 1 root root 30 jun 29 15:23 jersey-json-1.9.jar -> ../../jars/jersey-json-1.9.jar
lrwxrwxrwx 1 root root 29 jun 29 15:23 jaxb-api-2.2.2.jar -> ../../jars/jaxb-api-2.2.2.jar
lrwxrwxrwx 1 root root 34 jun 29 15:23 jackson-jaxrs-1.8.8.jar -> ../../jars/jackson-jaxrs-1.8.8.jar
lrwxrwxrwx 1 root root 33 jun 29 15:23 jackson-core-2.2.3.jar -> ../../jars/jackson-core-2.2.3.jar
lrwxrwxrwx 1 root root 31 jun 29 15:23 httpclient-4.2.5.jar -> ../../jars/httpclient-4.2.5.jar
lrwxrwxrwx 1 root root 41 jun 29 15:23 hadoop-sls-2.6.0-cdh5.12.0.jar -> ../../jars/hadoop-sls-2.6.0-cdh5.12.0.jar
lrwxrwxrwx 1 root root 59 jun 29 15:23 hadoop-mapreduce-client-core-2.6.0-cdh5.12.0.jar -> ../../jars/hadoop-mapreduce-client-core-2.6.0-cdh5.12.0.jar
lrwxrwxrwx 1 root root 41 jun 29 15:23 hadoop-ant-2.6.0-cdh5.12.0.jar -> ../../jars/hadoop-ant-2.6.0-cdh5.12.0.jar
lrwxrwxrwx 1 root root 30 jun 29 15:23 commons-cli-1.2.jar -> ../../jars/commons-cli-1.2.jar
lrwxrwxrwx 1 root root 33 jun 29 15:23 api-util-1.0.0-M20.jar -> ../../jars/api-util-1.0.0-M20.jar
lrwxrwxrwx 1 root root 48 jun 29 15:23 apacheds-kerberos-codec-2.0.0-M15.jar -> ../../jars/apacheds-kerberos-codec-2.0.0-M15.jar
lrwxrwxrwx 1 root root 34 jun 29 15:23 protobuf-java-2.5.0.jar -> ../../jars/protobuf-java-2.5.0.jar
lrwxrwxrwx 1 root root 27 jun 29 15:23 log4j-1.2.17.jar -> ../../jars/log4j-1.2.17.jar
lrwxrwxrwx 1 root root 43 jun 29 15:23 jetty-util-6.1.26.cloudera.4.jar -> ../../jars/jetty-util-6.1.26.cloudera.4.jar
lrwxrwxrwx 1 root root 30 jun 29 15:23 jersey-core-1.9.jar -> ../../jars/jersey-core-1.9.jar
lrwxrwxrwx 1 root root 47 jun 29 15:23 hadoop-streaming-2.6.0-cdh5.12.0.jar -> ../../jars/hadoop-streaming-2.6.0-cdh5.12.0.jar
lrwxrwxrwx 1 root root 56 jun 29 15:23 hadoop-mapreduce-examples-2.6.0-cdh5.12.0.jar -> ../../jars/hadoop-mapreduce-examples-2.6.0-cdh5.12.0.jar
lrwxrwxrwx 1 root root 65 jun 29 15:23 hadoop-mapreduce-client-hs-plugins-2.6.0-cdh5.12.0.jar -> ../../jars/hadoop-mapreduce-client-hs-plugins-2.6.0-cdh5.12.0.jar
lrwxrwxrwx 1 root root 45 jun 29 15:23 hadoop-gridmix-2.6.0-cdh5.12.0.jar -> ../../jars/hadoop-gridmix-2.6.0-cdh5.12.0.jar
lrwxrwxrwx 1 root root 46 jun 29 15:23 hadoop-datajoin-2.6.0-cdh5.12.0.jar -> ../../jars/hadoop-datajoin-2.6.0-cdh5.12.0.jar
lrwxrwxrwx 1 root root 46 jun 29 15:23 hadoop-archives-2.6.0-cdh5.12.0.jar -> ../../jars/hadoop-archives-2.6.0-cdh5.12.0.jar
lrwxrwxrwx 1 root root 27 jun 29 15:23 guava-11.0.2.jar -> ../../jars/guava-11.0.2.jar
lrwxrwxrwx 1 root root 25 jun 29 15:23 gson-2.2.4.jar -> ../../jars/gson-2.2.4.jar
lrwxrwxrwx 1 root root 35 jun 29 15:23 curator-client-2.7.1.jar -> ../../jars/curator-client-2.7.1.jar
lrwxrwxrwx 1 root root 40 jun 29 15:23 commons-configuration-1.6.jar -> ../../jars/commons-configuration-1.6.jar
lrwxrwxrwx 1 root root 37 jun 29 15:23 api-asn1-api-1.0.0-M20.jar -> ../../jars/api-asn1-api-1.0.0-M20.jar
lrwxrwxrwx 1 root root 29 jun 29 15:23 activation-1.1.jar -> ../../jars/activation-1.1.jar
lrwxrwxrwx 1 root root 27 jun 29 15:23 okhttp-2.4.0.jar -> ../../jars/okhttp-2.4.0.jar
lrwxrwxrwx 1 root root 25 jun 29 15:23 junit-4.11.jar -> ../../jars/junit-4.11.jar
lrwxrwxrwx 1 root root 39 jun 29 15:23 jackson-mapper-asl-1.8.8.jar -> ../../jars/jackson-mapper-asl-1.8.8.jar
lrwxrwxrwx 1 root root 38 jun 29 15:23 curator-framework-2.7.1.jar -> ../../jars/curator-framework-2.7.1.jar
lrwxrwxrwx 1 root root 32 jun 29 15:23 commons-codec-1.4.jar -> ../../jars/commons-codec-1.4.jar
lrwxrwxrwx 1 root root 38 jun 29 15:23 commons-beanutils-1.9.2.jar -> ../../jars/commons-beanutils-1.9.2.jar
... View more
08-30-2017
06:39 AM
I've reintalled cloudera manager and same error. cloudera usar not exits and javac -cp /opt/cloudera/parcels/CDH/lib/hadoop/*:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/* WordCount.java -d build -Xlint
javac: file not found: WordCount.java
... View more
08-28-2017
06:05 AM
If I try with new user (hduser): hduser@clusterb1:~$ javac -cp /opt/cloudera/parcels/CDH/lib/hadoop/*:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/* WordCount.java -d build -Xlint
javac: file not found: WordCount.java
Usage: javac <options> <source files>
... View more
08-28-2017
05:28 AM
No, is not a quickstart root@clusterb1:~# id -u cloudera
id: «cloudera»: no existe ese usuario
... View more
08-28-2017
04:59 AM
Hi, I'm trying to make the first example: https://www.cloudera.com/documentation/other/tutorial/CDH5/topics/ht_usage.html When it says me: sudo su cloudera it gives me: sudo su cloudera
No existe clave de entrada para el usuario «cloudera» it seems that cloudera user not exits. What user should I use? Thanks!
... View more
Labels:
08-18-2017
03:35 AM
Hi, I'm tryng to do the first tutorial of hadoop (wordcount) with these tutorial https://www.cloudera.com/documentation/other/tutorial/CDH5/topics/ht_usage.html But I can't see WordCount.java in these path hdfs@clusterb1:/opt/cloudera/parcels/CDH/lib$ find . -name "*Word*" hdfs@clusterb1:/opt/cloudera/parcels/CDH/lib$ Please how could I follow the tutorial? Thanks and sorry for my English!
... View more
Labels:
08-17-2017
03:33 AM
I've reinstalled Hive and it's solved! Thanks
... View more
08-17-2017
03:32 AM
Hi, I have installed cloudera mangaer 5.12 but I dont have maven. How could I install it? sudo apt-get install maven
Leyendo lista de paquetes... Hecho
Creando árbol de dependencias
Leyendo la información de estado... Hecho
Tal vez quiera ejecutar «apt-get -f install» para corregirlo:
Los siguientes paquetes tienen dependencias incumplidas:
libmagickwand-6.q16-2 : Depende: imagemagick-common (= 8:6.8.9.9-7ubuntu5.9) pero 8:6.8.9.9-7ubuntu5.3 va a ser instalado
maven : Depende: default-jre-headless (>= 2:1.7) pero no va a instalarse o
java7-runtime-headless
Depende: libmaven3-core-java (= 3.3.9-3) pero no va a instalarse Thanks!
... View more
Labels:
08-16-2017
05:15 AM
Hi, I've installed cloudera manager with Hive but when I'm trying to start the role, it gives me: PSQLException: FATAL: password authentication failed for user "hive" How fix it? Thanks and sorry for my English!
... View more
Labels:
08-14-2017
02:52 AM
Hi, I can't understand why capactiy is 0: afe mode is ON
Configured Capacity: 0 (0 B)
Present Capacity: 0 (0 B)
DFS Remaining: 0 (0 B)
DFS Used: 0 (0 B)
DFS Used%: NaN%
Under replicated blocks: 0
Blocks with corrupt replicas: 0
Missing blocks: 0
Missing blocks (with replication factor 1): 0
-------------------------------------------------
report: Access denied for user root. Superuser privilege is required
root@clusterb1:/var/log/hadoop-mapreduce# sudo -u hdfs dfsadmin -report
sudo: dfsadmin: orden no encontrada
root@clusterb1:/var/log/hadoop-mapreduce# sudo -u hdfs hdfs dfsadmin -report
Safe mode is ON
Configured Capacity: 0 (0 B)
Present Capacity: 0 (0 B)
DFS Remaining: 0 (0 B)
DFS Used: 0 (0 B)
DFS Used%: NaN%
Under replicated blocks: 0
Blocks with corrupt replicas: 0
Missing blocks: 0
Missing blocks (with replication factor 1): 0
-------------------------------------------------
Dead datanodes (4):
Name: 192.168.1.114:50010 (clusterb4.dummy.es)
Hostname: clusterb4.dummy.es
Decommission Status : Normal
Configured Capacity: 0 (0 B)
DFS Used: 0 (0 B)
Non DFS Used: 0 (0 B)
DFS Remaining: 0 (0 B)
DFS Used%: 100.00%
DFS Remaining%: 0.00%
Configured Cache Capacity: 0 (0 B)
Cache Used: 0 (0 B)
Cache Remaining: 0 (0 B)
Cache Used%: 100.00%
Cache Remaining%: 0.00%
Xceivers: 0
Last contact: Thu Jan 01 01:00:00 CET 1970
Name: 192.168.1.115:50010 (clusterb5.dummy.es)
Hostname: clusterb5.dummy.es
Decommission Status : Normal
Configured Capacity: 0 (0 B)
DFS Used: 0 (0 B)
Non DFS Used: 0 (0 B)
DFS Remaining: 0 (0 B)
DFS Used%: 100.00%
DFS Remaining%: 0.00%
Configured Cache Capacity: 0 (0 B)
Cache Used: 0 (0 B)
Cache Remaining: 0 (0 B)
Cache Used%: 100.00%
Cache Remaining%: 0.00%
Xceivers: 0
Last contact: Thu Jan 01 01:00:00 CET 1970
Name: 192.168.1.112:50010 (clusterb2.dummy.es)
Hostname: clusterb2.dummy.es
Decommission Status : Normal
Configured Capacity: 0 (0 B)
DFS Used: 0 (0 B)
Non DFS Used: 0 (0 B)
DFS Remaining: 0 (0 B)
DFS Used%: 100.00%
DFS Remaining%: 0.00%
Configured Cache Capacity: 0 (0 B)
Cache Used: 0 (0 B)
Cache Remaining: 0 (0 B)
Cache Used%: 100.00%
Cache Remaining%: 0.00%
Xceivers: 0
Last contact: Thu Jan 01 01:00:00 CET 1970
Name: 192.168.1.113:50010 (clusterb3.dummy.es)
Hostname: clusterb3.dummy.es
Decommission Status : Normal
Configured Capacity: 0 (0 B)
DFS Used: 0 (0 B)
Non DFS Used: 0 (0 B)
DFS Remaining: 0 (0 B)
DFS Used%: 100.00%
DFS Remaining%: 0.00%
Configured Cache Capacity: 0 (0 B)
Cache Used: 0 (0 B)
Cache Remaining: 0 (0 B)
Cache Used%: 100.00%
Cache Remaining%: 0.00%
Xceivers: 0
Last contact: Thu Jan 01 01:00:00 CET 1970
Someone knows why is 0? I'm using lxc but I think that is not a problem. Thanks!
... View more
Labels:
08-11-2017
08:33 AM
Hi, I'm trying to install cloudera manager and when I assgins roles and Cloudera begin to install shows me an error: Any help please?
... View more
Labels:
08-11-2017
02:55 AM
Hi, I'm trying to install cloudera manager in my localhost and it gives me an error "Failed to recevie heartbeat from agent" In log I see: >>error: [Errno 111] Connection refused
>>[11/Aug/2017 11:41:08 +0000] 1598 MainThread heartbeat_tracker INFO HB stats (seconds): num:40 LIFE_MIN:0.00 min:0.00 mean:0.01 max:0.04 LIFE_MAX:0.18
>>[11/Aug/2017 11:41:53 +0000] 1598 MainThread agent ERROR Heartbeating to 127.0.0.1:7182 failed Someone could help to fix these? My /etc/hosts is: 127.0.0.1 localhost
# The following lines are desirable for IPv6 capable hosts
::1 ip6-localhost ip6-loopback
fe00::0 ip6-localnet
ff00::0 ip6-mcastprefix
ff02::1 ip6-allnodes
ff02::2 ip6-allrouters
192.168.1.111 clusterb1 clusterb1.dummy.es My config hostname root@clusterb1:~# hostname -f
clusterb1
root@clusterb1:~# hostname
clusterb1
root@clusterb1:~# python -c 'import socket; print socket.getfqdn(), socket.gethostbyname(socket.getfqdn())'
localhost 192.168.1.111 Thanks!
... View more
Labels:
08-10-2017
06:05 AM
Hi, I'm trying to install cloudera manager with lxc. I've set up 4 nodes and my local node. When I'm trying to install software from cloudera wizard it says me: Authentication error. "Exhausted available authentication methods"
... View more
Labels:
12-23-2016
02:07 AM
Solved! the problem was that I clone lxc container and the /etc/hosts was the same in all machines. I've modified the /etc/hosts and all ok
... View more
12-23-2016
01:32 AM
Hi, I'm trying to instal cloudera manager in some host virutalized with lxc. In one installation is completed but in the rest of host failed with these error: Error en la instalación. Error al recibir el latido del agente. •Asegúrese de que el nombre del host está configurado correctamente.
•Asegúrese de que el puerto 7182 es accesible en Cloudera Manager Server (compruebe las reglas del firewall).
•Asegúrese de que los puertos 9000 y 9001 no están en uso para el host que se va a agregar.
•Compruebe los registros de agente en /var/log/cloudera-scm-agent/ en el host que va a agregar. (Algunos registros se pueden encontrar en los detalles de instalación).
•Si la opción Utilizar el cifrado de TLS para los agentes está activada en Cloudera Manager (Administración -> Ajustes -> Seguridad), compruebe que /etc/cloudera-scm-agent/config.ini tiene use_tls=1 en el host que se agrega. Reinicie el agente correspondiente y haga clic en el vínculo Reintentar aquí. Someone could help me please? Thanks!
... View more
Labels:
07-16-2016
01:19 PM
Hi I would like to certificate in ccah 500. I would like install virtual machine to can investigate more. I see cloudera virtual machine needs 8gb ram. My pc have only 8gb. There are other possibilities? Many thanks and sorry for my English
... View more