About vtpcnk

vtpcnk · ‎04-05-2017

Any idea how to execute hive cli or hbase shell against a specific queue ? In one of our clusters the default queue is stopped and there are two other queues. But by default hive cli it is going against the default queue and failing. So how to use other queues - say q1, q2 - with hive cli or hbase shell. Appreciate the feedback.

vtpcnk · ‎04-04-2017

I have a hbase table with 3 rows. I export the table. Then I delete 1 row. Then I import from the exported data from step 1. There are still only 2 rows in the table. ???

vtpcnk · ‎04-04-2017

Some questions regarding import/export in HBASE : I used below command to export a table : /usr/bin/hbase org.apache.hadoop.hbase.mapreduce.Export emp /tmp/emp But could not find the output anywhere on the host - but finally found it within hdfs. What is the way to export to file system directory? Will import work only if the table is empty of data? So truncate table (to delete all data in table) needs to precede import command? Or is there an overwrite option in import (to overwrite existing data in table)? Is it possible to append data with import ie table already has some data and we want to add more data with import. Also is there any way to extract the table schemas including 'create table' from hbase - or is 'describe <table>' the only way? Appreciate the insights.

vtpcnk · ‎04-03-2017

Thanks for the response. In Ambari -> Zookeeper : I can see three entries for zookeeper server and 2 zookeeper clients installed. Not sure about server ip mapping and myid match - can you give more detail pls? [root@hdtesting1 etc]# netstat -tlpn | grep 2181 tcp 0 0 0.0.0.0:2181 0.0.0.0:* LISTEN 11297/java zoo.cfg : maxClientCnxns=50 # The number of milliseconds of each tick tickTime=2000 # The number of ticks that the initial # synchronization phase can take initLimit=10 # The number of ticks that can pass between # sending a request and getting an acknowledgement syncLimit=5 # the directory where the snapshot is stored. dataDir=/var/lib/zookeeper # the port at which the clients will connect clientPort=2181

vtpcnk · ‎03-31-2017

When I run zkCli.sh -server <hostname>:2181 I get repeated : 2017-03-31 13:42:05,992 - INFO [main-SendThread(hdtesting2.com.local:2181):ClientCnxn$SendThread@1142] - Unable to read additional data from server sessionid 0x0, likely server has closed socket, closing socket connection and attempting reconnect

vtpcnk · ‎03-30-2017

Yes, already restarted zookeeper and resource manager. did not help. thanks.

vtpcnk · ‎03-30-2017

Resource manager is down due to below error : 2017-03-28 13:32:05,609 FATAL resourcemanager.ResourceManager (ResourceManager.java:main(1229)) - Error starting ResourceManager org.apache.hadoop.service.ServiceStateException: org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss for /rmstore I saw something earlier about formatting/removing /rmstore - but can't locate that now. Appreciate if somebody could provide a detailed answer to fix this issue.

vtpcnk · ‎03-28-2017

I am aware of both distcp and falcon - but I am NOT talking about either of those. I am talking about recovery/restore with a MySQL dump (hive database) and hive table files.

vtpcnk · ‎03-28-2017

I have a MySQL dump file (which is an ascii file filled with sql commands like create database, create table, insert etc) and the table files directly copied from hive directory (these I believe are the actual table data files from hive). In the MYSQL dump file there are two places where the hostname of the source hivemetastore/hiveserver2/MySQL (all on same host) is mentioned. I don't see any mention of host which hosts the namenode name in this file. So were you referring to the Hive host where you said : "edit dump file to point to new clusters NameNode location" I think we can simply point the file to the MYSQL and it will run as SQL commands and create the database, tables, data etc. But after that how to get the data in from the hive data files? Appreciate the insights.

vtpcnk · ‎03-28-2017

We have a hive database in one cluster. I want to have a copy of that database in a different cluster. So what is the process to do this? Appreciate a detailed step by step reply.

Online	Offline
Last Visited	‎05-05-2021 09:04 AM

Member Since	‎11-24-2015 05:10 AM
Last Visited	‎05-05-2021 09:04 AM
Posts	223
Kudos received	10

Cloudera Community

Hive CLI against specific queue

Re: HBASE import/export questions

HBASE import/export questions

Re: Resource Manager down - /rmstore error

Re: Resource Manager down - /rmstore error

Re: Resource Manager down - /rmstore error

Resource Manager down - /rmstore error

Re: HIVE - backup and restore

Re: HIVE - backup and restore

HIVE - backup and restore