Karasten
Karasten
Explorer
My Accepted Solutions
Show All

Connecting RServer and CDH using Hive

by Explorer Karasten in Support Questions
‎07-11-2014 06:10 AM
‎07-11-2014 06:10 AM
Hi guys,   I installed a 3 data nodes CDH 5.0.1 cluster, everything is OK in my Cloudera console.   I need to connect to my Hive data using R Server rHive package   Is anyone has any experience doing that?   My rHive connect operator give me an Java class not found and I'm getting mad on this! I think it' a libpath issue, but didn't succeed in finding the good path to add!   Here's my jar config on R:   hadoop home: /appli/cloudera/parcels/CDH/bin/hadoop-hdfs hadoop conf: /etc/hadoop/conf hive home: /appli/cloudera/parcels/CDH/lib/hive/bin user name: admcap user home: /appli/admcap temp dir: /tmp/admcap classpath: /usr/lib64/R/library/RHive/java/rhive_udf.jar /appli/cloudera/parcels/CDH/lib/hadoop-hdfs/lib/asm-3.2.jar /appli/cloudera/parcels/CDH/lib/hadoop-hdfs/lib/commons-cli-1.2.jar /appli/cloudera/parcels/CDH/lib/hadoop-hdfs/lib/commons-codec-1.4.jar /appli/cloudera/parcels/CDH/lib/hadoop-hdfs/lib/commons-daemon-1.0.13.jar /appli/cloudera/parcels/CDH/lib/hadoop-hdfs/lib/commons-el-1.0.jar /appli/cloudera/parcels/CDH/lib/hadoop-hdfs/lib/commons-io-2.4.jar /appli/cloudera/parcels/CDH/lib/hadoop-hdfs/lib/commons-lang-2.6.jar /appli/cloudera/parcels/CDH/lib/hadoop-hdfs/lib/commons-logging-1.1.3.jar /appli/cloudera/parcels/CDH/lib/hadoop-hdfs/lib/guava-11.0.2.jar /appli/cloudera/parcels/CDH/lib/hadoop-hdfs/lib/jackson-core-asl-1.8.8.jar /appli/cloudera/parcels/CDH/lib/hadoop-hdfs/lib/jackson-mapper-asl-1.8.8.jar /appli/cloudera/parcels/CDH/lib/hadoop-hdfs/lib/jasper-runtime-5.5.23.jar /appli/cloudera/parcels/CDH/lib/hadoop-hdfs/lib/jersey-core-1.9.jar /appli/cloudera/parcels/CDH/lib/hadoop-hdfs/lib/jersey-server-1.9.jar /appli/cloudera/parcels/CDH/lib/hadoop-hdfs/lib/jetty-6.1.26.jar /appli/cloudera/parcels/CDH/lib/hadoop-hdfs/lib/jetty-util-6.1.26.jar /appli/cloudera/parcels/CDH/lib/hadoop-hdfs/lib/jsp-api-2.1.jar /appli/cloudera/parcels/CDH/lib/hadoop-hdfs/lib/jsr305-1.3.9.jar /appli/cloudera/parcels/CDH/lib/hadoop-hdfs/lib/log4j-1.2.17.jar /appli/cloudera/parcels/CDH/lib/hadoop-hdfs/lib/netty-3.6.2.Final.jar /appli/cloudera/parcels/CDH/lib/hadoop-hdfs/lib/protobuf-java-2.5.0.jar /appli/cloudera/parcels/CDH/lib/hadoop-hdfs/lib/servlet-api-2.5.jar /appli/cloudera/parcels/CDH/lib/hadoop-hdfs/lib/xmlenc-0.52.jar /appli/cloudera/parcels/CDH/lib/hive/lib/ST4-4.0.4.jar /appli/cloudera/parcels/CDH/lib/hive/lib/ant-1.9.1.jar /appli/cloudera/parcels/CDH/lib/hive/lib/ant-launcher-1.9.1.jar /appli/cloudera/parcels/CDH/lib/hive/lib/antlr-2.7.7.jar /appli/cloudera/parcels/CDH/lib/hive/lib/antlr-runtime-3.4.jar /appli/cloudera/parcels/CDH/lib/hive/lib/avro.jar /appli/cloudera/parcels/CDH/lib/hive/lib/bonecp-0.7.1.RELEASE.jar /appli/cloudera/parcels/CDH/lib/hive/lib/commons-beanutils-1.7.0.jar /appli/cloudera/parcels/CDH/lib/hive/lib/commons-cli-1.2.jar /appli/cloudera/parcels/CDH/lib/hive/lib/commons-codec-1.4.jar /appli/cloudera/parcels/CDH/lib/hive/lib/commons-collections-3.2.1.jar /appli/cloudera/parcels/CDH/lib/hive/lib/commons-compress-1.4.1.jar /appli/cloudera/parcels/CDH/lib/hive/lib/commons-httpclient-3.0.1.jar /appli/cloudera/parcels/CDH/lib/hive/lib/commons-io-2.4.jar /appli/cloudera/parcels/CDH/lib/hive/lib/commons-lang-2.4.jar /appli/cloudera/parcels/CDH/lib/hive/lib/commons-lang-2.6.jar /appli/cloudera/parcels/CDH/lib/hive/lib/commons-logging-1.1.3.jar /appli/cloudera/parcels/CDH/lib/hive/lib/datanucleus-api-jdo-3.2.1.jar /appli/cloudera/parcels/CDH/lib/hive/lib/datanucleus-core-3.2.2.jar /appli/cloudera/parcels/CDH/lib/hive/lib/datanucleus-rdbms-3.2.1.jar /appli/cloudera/parcels/CDH/lib/hive/lib/derby-10.4.2.0.jar /appli/cloudera/parcels/CDH/lib/hive/lib/groovy-all-2.1.6.jar /appli/cloudera/parcels/CDH/lib/hive/lib/guava-11.0.2.jar /appli/cloudera/parcels/CDH/lib/hive/lib/hamcrest-core-1.1.jar /appli/cloudera/parcels/CDH/lib/hive/lib/hbase-client.jar /appli/cloudera/parcels/CDH/lib/hive/lib/hbase-common.jar /appli/cloudera/parcels/CDH/lib/hive/lib/hbase-hadoop-compat.jar /appli/cloudera/parcels/CDH/lib/hive/lib/hbase-hadoop2-compat.jar /appli/cloudera/parcels/CDH/lib/hive/lib/hbase-protocol.jar /appli/cloudera/parcels/CDH/lib/hive/lib/hbase-server.jar /appli/cloudera/parcels/CDH/lib/hive/lib/hive-ant-0.12.0-cdh5.0.1.jar /appli/cloudera/parcels/CDH/lib/hive/lib/hive-ant.jar /appli/cloudera/parcels/CDH/lib/hive/lib/hive-beeline-0.12.0-cdh5.0.1.jar /appli/cloudera/parcels/CDH/lib/hive/lib/hive-beeline.jar /appli/cloudera/parcels/CDH/lib/hive/lib/hive-cli-0.12.0-cdh5.0.1.jar /appli/cloudera/parcels/CDH/lib/hive/lib/hive-cli.jar /appli/cloudera/parcels/CDH/lib/hive/lib/hive-common-0.12.0-cdh5.0.1.jar /appli/cloudera/parcels/CDH/lib/hive/lib/hive-common.jar /appli/cloudera/parcels/CDH/lib/hive/lib/hive-contrib-0.12.0-cdh5.0.1.jar /appli/cloudera/parcels/CDH/lib/hive/lib/hive-contrib.jar /appli/cloudera/parcels/CDH/lib/hive/lib/hive-exec-0.12.0-cdh5.0.1.jar /appli/cloudera/parcels/CDH/lib/hive/lib/hive-exec.jar /appli/cloudera/parcels/CDH/lib/hive/lib/hive-hbase-handler-0.12.0-cdh5.0.1.jar /appli/cloudera/parcels/CDH/lib/hive/lib/hive-hbase-handler.jar /appli/cloudera/parcels/CDH/lib/hive/lib/hive-hwi-0.12.0-cdh5.0.1.jar /appli/cloudera/parcels/CDH/lib/hive/lib/hive-hwi.jar /appli/cloudera/parcels/CDH/lib/hive/lib/hive-jdbc-0.12.0-cdh5.0.1.jar /appli/cloudera/parcels/CDH/lib/hive/lib/hive-jdbc.jar /appli/cloudera/parcels/CDH/lib/hive/lib/hive-metastore-0.12.0-cdh5.0.1.jar /appli/cloudera/parcels/CDH/lib/hive/lib/hive-metastore.jar /appli/cloudera/parcels/CDH/lib/hive/lib/hive-serde-0.12.0-cdh5.0.1.jar /appli/cloudera/parcels/CDH/lib/hive/lib/hive-serde.jar /appli/cloudera/parcels/CDH/lib/hive/lib/hive-service-0.12.0-cdh5.0.1.jar /appli/cloudera/parcels/CDH/lib/hive/lib/hive-service.jar /appli/cloudera/parcels/CDH/lib/hive/lib/hive-shims-0.12.0-cdh5.0.1.jar /appli/cloudera/parcels/CDH/lib/hive/lib/hive-shims-0.23-0.12.0-cdh5.0.1.jar /appli/cloudera/parcels/CDH/lib/hive/lib/hive-shims-common-0.12.0-cdh5.0.1.jar /appli/cloudera/parcels/CDH/lib/hive/lib/hive-shims-common-secure-0.12.0-cdh5.0.1.jar /appli/cloudera/parcels/CDH/lib/hive/lib/hive-shims-common-secure.jar /appli/cloudera/parcels/CDH/lib/hive/lib/hive-shims-common.jar /appli/cloudera/parcels/CDH/lib/hive/lib/hive-shims.jar /appli/cloudera/parcels/CDH/lib/hive/lib/hive-testutils-0.12.0-cdh5.0.1.jar /appli/cloudera/parcels/CDH/lib/hive/lib/hive-testutils.jar /appli/cloudera/parcels/CDH/lib/hive/lib/htrace-core.jar /appli/cloudera/parcels/CDH/lib/hive/lib/httpclient-4.2.5.jar /appli/cloudera/parcels/CDH/lib/hive/lib/httpcore-4.2.5.jar /appli/cloudera/parcels/CDH/lib/hive/lib/jdo-api-3.0.1.jar /appli/cloudera/parcels/CDH/lib/hive/lib/jetty-6.1.26.cloudera.2.jar /appli/cloudera/parcels/CDH/lib/hive/lib/jetty-util-6.1.26.cloudera.2.jar /appli/cloudera/parcels/CDH/lib/hive/lib/jline-0.9.94.jar /appli/cloudera/parcels/CDH/lib/hive/lib/jsr305-1.3.9.jar /appli/cloudera/parcels/CDH/lib/hive/lib/jta-1.1.jar /appli/cloudera/parcels/CDH/lib/hive/lib/junit-4.10.jar /appli/cloudera/parcels/CDH/lib/hive/lib/libfb303-0.9.0.jar /appli/cloudera/parcels/CDH/lib/hive/lib/libthrift-0.9.0.cloudera.2.jar /appli/cloudera/parcels/CDH/lib/hive/lib/log4j-1.2.16.jar /appli/cloudera/parcels/CDH/lib/hive/lib/oro-2.0.8.jar /appli/cloudera/parcels/CDH/lib/hive/lib/paranamer-2.3.jar /appli/cloudera/parcels/CDH/lib/hive/lib/parquet-hadoop-bundle.jar /appli/cloudera/parcels/CDH/lib/hive/lib/sentry-binding-hive-1.2.0-cdh5.0.1.jar /appli/cloudera/parcels/CDH/lib/hive/lib/sentry-binding-solr-1.2.0-cdh5.0.1.jar /appli/cloudera/parcels/CDH/lib/hive/lib/sentry-core-common-1.2.0-cdh5.0.1.jar /appli/cloudera/parcels/CDH/lib/hive/lib/sentry-core-model-db-1.2.0-cdh5.0.1.jar /appli/cloudera/parcels/CDH/lib/hive/lib/sentry-core-model-search-1.2.0-cdh5.0.1.jar /appli/cloudera/parcels/CDH/lib/hive/lib/sentry-policy-common-1.2.0-cdh5.0.1.jar /appli/cloudera/parcels/CDH/lib/hive/lib/sentry-policy-db-1.2.0-cdh5.0.1.jar /appli/cloudera/parcels/CDH/lib/hive/lib/sentry-policy-search-1.2.0-cdh5.0.1.jar /appli/cloudera/parcels/CDH/lib/hive/lib/sentry-provider-common-1.2.0-cdh5.0.1.jar /appli/cloudera/parcels/CDH/lib/hive/lib/sentry-provider-file-1.2.0-cdh5.0.1.jar /appli/cloudera/parcels/CDH/lib/hive/lib/servlet-api-2.5-20081211.jar /appli/cloudera/parcels/CDH/lib/hive/lib/shiro-core-1.2.1.jar /appli/cloudera/parcels/CDH/lib/hive/lib/slf4j-api-1.7.5.jar /appli/cloudera/parcels/CDH/lib/hive/lib/snappy-java-1.0.4.1.jar /appli/cloudera/parcels/CDH/lib/hive/lib/stax-api-1.0.1.jar /appli/cloudera/parcels/CDH/lib/hive/lib/stringtemplate-3.2.1.jar /appli/cloudera/parcels/CDH/lib/hive/lib/tempus-fugit-1.1.jar /appli/cloudera/parcels/CDH/lib/hive/lib/velocity-1.5.jar /appli/cloudera/parcels/CDH/lib/hive/lib/xz-1.0.jar /appli/cloudera/parcels/CDH/lib/hive/lib/zookeeper.jar /etc/hadoop/conf > rhive.connect(host="sd061572-app-01", port=10000, user="<user>", password="<Password>") Error: java.lang.ClassNotFoundException ... View more

Re: Cloudmanager execution (Path A)

by Explorer Karasten in Support Questions
‎06-06-2014 06:13 AM
‎06-06-2014 06:13 AM
My directory issue was due to write rights not present on /usr/shar and not enough place in /opt. ... View more

Re: CDH 5 Cloudera Manager Installation on CentOS ...

by Explorer Karasten in Support Questions
‎06-06-2014 01:25 AM
‎06-06-2014 01:25 AM
All my issues were linked to rights on folders /usr/shar, /opt and file system storage shortage.   My cluster is up and running, thank you to all who helped. ... View more

Re: CDH 5 Cloudera Manager Installation on CentOS ...

by Explorer Karasten in Support Questions
‎06-03-2014 05:31 AM
‎06-03-2014 05:31 AM
Dear community,   I checked /var/log/clouderamanager, I got only one file in the directory: 0.check-selinux.log. I ran the sestatus command and my selinux is disabled.   Nothing special in /tmp ... View more

Re: CDH 5 Cloudera Manager Installation on CentOS ...

by Explorer Karasten in Support Questions
‎06-02-2014 08:47 AM
‎06-02-2014 08:47 AM
Hi community,   Does anyone has any idea to share on this issue? I'm really disappointed due to my inability to install the cluster via Cloudera Manager as it "should be" very simple to deploy but I must admit that I didn't find any clue neither log file to help me understand and solve the problem.   Thanx in advance,   Edmond, ... View more

CDH 5 Cloudera Manager Installation on CentOS 6.4 ...

by Explorer Karasten in Support Questions
‎05-30-2014 02:09 AM
‎05-30-2014 02:09 AM
Hi community,   I have the following notice : "NOTICE: Directory creation failed" at the beginning of Path A Installation using root user.   Didn't find any explanation so still stuck on this. I cannot find any log of the installation to get further understanding.   Any idea is welcome, ... View more

Re: Cloudmanager execution (Path A)

by Explorer Karasten in Support Questions
‎05-29-2014 08:50 AM
‎05-29-2014 08:50 AM
I searched for the cause of "NOTICE: Directory creation failed" at the beginning of Path Installation using root. Didn't find any explanation. Any idea? ... View more

Re: Cloudmanager execution (Path A)

by Explorer Karasten in Support Questions
‎05-29-2014 08:17 AM
‎05-29-2014 08:17 AM
Thank you, it went fine, I'm stuck with directory creation for Java, trying to look at this... ... View more

Re: Cloudmanager execution (Path A)

by Explorer Karasten in Support Questions
‎05-29-2014 06:17 AM
‎05-29-2014 06:17 AM
Addtional information on my case :   [root@sd061572-app-01 binaires]# chmod u+x cloudera-manager-installer.bin [root@sd061572-app-01 binaires]# whoami root [root@sd061572-app-01 binaires]# ls -l total 500 -rwxr--r-- 1 admcap admcap 510587 May 29 15:16 cloudera-manager-installer.bin [root@sd061572-app-01 binaires]# ./cloudera-manager-installer.bin Cloudera Manager 5 NOTICE: The umask 0077 is too restrictive. It must be 0022 at most for this installer to work. [hit enter] Incomplete installation. We will revert any changes we made. [root@sd061572-app-01 binaires]# ... View more

Cloudmanager execution (Path A)

by Explorer Karasten in Support Questions
‎05-29-2014 06:01 AM
‎05-29-2014 06:01 AM
Hi community,   I'm doing my first Path A installation, downloaded the cloudera manager binairy, sent it to a folder on my target server, changed the rights doing chmod u+x. And when I want to start doing "./cloudera-manager-installer.bin", I got the following message :   "Cloudera Manager 5 NOTICE: The umask 0077 is too restrictive. It must be 0022 at most for this installer to work. [hit enter]"   Has anybody went to this? I tried other rights combinations without success.   I need to setup this small cluster for my development team.   Any help would be appreciated! ... View more
Contact Me
Online
Offline
Last Visited
‎08-06-2014 05:36 AM
Public Statistics
Date Registered ‎05-29-2014 05:49 AM
Last Visited ‎08-06-2014 05:36 AM
Total Messages Posted 10