Member since
05-16-2016
785
Posts
114
Kudos Received
39
Solutions
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 2328 | 06-12-2019 09:27 AM | |
| 3579 | 05-27-2019 08:29 AM | |
| 5725 | 05-27-2018 08:49 AM | |
| 5243 | 05-05-2018 10:47 PM | |
| 3113 | 05-05-2018 07:32 AM |
06-26-2017
07:02 PM
if you read my previous reply , thats exactly I told that your fs.default should be same across all the nodes more over same version of core-site.xml . to be more precies This is used to specify the default file system it needs be set to a HDFS address. this is need for client configuration as well so your local configuration file should include this element. hdfs://192.168.1.200:9000/. Here 9000 denotes port on which datanode will send heartbeat to namenode
... View more
06-26-2017
05:28 AM
Since I dont know what are the exact configurations are I am na ask this question to you . Where you able to connect Hive metastore using Hive-shell or Beeline to pull the tables.? I see the screenshot that you supplied the credentials and other parameters but did you place the msql-jdbc jar manually if so where did you place ?
... View more
06-24-2017
07:19 AM
[cloudera-cdh5]
# Packages for Cloudera's Distribution for Hadoop, Version 5, on RedHat or CentOS 7 x86_64
name=Cloudera's Distribution for Hadoop, Version 5
baseurl=https://archive.cloudera.com/cdh5/redhat/7/x86_64/cdh/5/
gpgkey =https://archive.cloudera.com/cdh5/redhat/7/x86_64/cdh/RPM-GPG-KEY-cloudera
gpgcheck = 1 [cloudera-impala]
name=Impala
baseurl=http://archive.cloudera.com/impala/redhat/6/x86_64/impala/1/
gpgkey = http://archive.cloudera.com/impala/redhat/6/x86_64/impala/RPM-GPG-KEY-cloudera
gpgcheck = 1 we used this on our Centos 7 but it was for Centos 6 only Refer this link https://www.cloudera.com/documentation/enterprise/latest/topics/cdh_ig_cdh5_install.html#topic_4_4_1__p_32 Hi above link for Centos 7 $ sudo yum install impala
$ sudo yum install impala-server
$ sudo yum install impala-state-store
$ sudo yum install impala-catalog
... View more
06-24-2017
04:03 AM
were did you palce the mysql jdbc jar ? are you manahing the cluster using Cloduera manager
... View more
06-24-2017
04:02 AM
for hive metastore configuration . /etc/hive/conf /hive-site.xml below is the property that you should look for . <property>
<name>javax.jdo.option.ConnectionURL</name>
<value>jdbc:derby:memory:${test.tmp.dir}/junit_metastore_db;create=true</value>
</property>
<property>
<name>javax.jdo.option.ConnectionDriverName</name>
<value>org.apache.derby.jdbc.EmbeddedDriver</value>
</property> are you using HIVE ON SPARK or YARN ON Spark In couldera manager.
... View more
06-24-2017
03:54 AM
How many namenodes do you have in your cluster ? I see one namenode in master and one namenode in slave . are you trying to confIigure High availabilty . That is to make one namenode active and while the other in stand by ? if not remove the namenode it from node2. is the below is same in master and other slave node ? Why mention it as "node2 " change to the node were master resides i,e namenode or to avoid fruther confustion . just copy the whole conf directory from master to the newly added slave . /etc/hadoop/conf / * to the node2 /etc/hadoop/conf/ <configuration>
<property>
<name>fs.default.name</name>
<value>hadoop://node2:9000</value>
</property> .
... View more
06-23-2017
09:09 PM
Did you in check the slave nodes as to see all the necessary hadoop liberaries and hadoop conf are in palce ? also could you paste the namenode,datanodes logs
... View more
06-23-2017
07:59 PM
if you got to the below path in your terminal /home/student/Installations/hadoop-1.2.1/bin/ perform an ls - command . could you let me know if you are seeing this file hadoop-daemon.sh looks like you are missing based on the error
... View more
06-22-2017
10:03 PM
1 Kudo
@mbigelowi agree with you on this. Could you check your Metastore / HS2 status sudo service hive-metastore status sudo service hive-server2 status
... View more
06-22-2017
10:00 AM
Did you get a chance to checkout these paremeters to see how it has been configured in your cluster yarn.nodemanager.resource.memory-mb
yarn.nodemanager.pmem-check-enabled
yarn.nodemanager.vmem-pmem-ratio
yarn.nodemanager.resource.cpu-vcores
yarn.scheduler.minimum-allocation-vcores
... View more