Member since
01-28-2018
11
Posts
1
Kudos Received
0
Solutions
04-13-2019
05:46 PM
Had figured out a solution, and shared it on my blog.. https://tips-to-code.blogspot.com/2018/07/automated-bash-script-to-export-all.html
... View more
07-28-2018
03:29 PM
The script in the blog scans through all the databases on the Hive system, and routes all 'Create' Table statements to a file.. https://tips-to-code.blogspot.com/2018/07/automated-bash-script-to-export-all.html
... View more
01-28-2018
11:23 PM
Need to execute few hive scripts one after the other placed in a unix folder.. Looks like need to have a shell script in place which connects to Hive. Any input will be appreciated. Thanks
... View more
Labels:
- Labels:
-
Hive
08-28-2017
06:54 AM
Didn't work.. Got the same error again hive-error.jpg
... View more
08-28-2017
06:41 AM
Hi @Jay SenSharma.. I have not confgured Hive locally in my machine. It is installed as part of the sandbox. So I am not sure if echo-ing these variables would return a value? I had tried to run hive CLI in the DEBUG mode that time itself. Got the following result: 17/08/28 05:45:56 [IPC Client (605101809) connection to sandbox.hortonworks.com/<MyIPaddress>:8020 from root]: DEBUG ipc.Client: IPC Client (605101809) connection to sandbox.hortonworks.com/<MyIPaddress>:8020 from root got value #99 17/08/28 05:45:56 [pool-1-thread-1]: DEBUG ipc.ProtobufRpcEngine: Call: delete took 10ms 17/08/28 05:45:56 [IPC Parameter Sending Thread #1]: DEBUG ipc.Client: IPC Client (605101809) connection to sandbox.hortonworks.com/<MyIPaddress>:8020 from root sending #100 17/08/28 05:45:56 [IPC Client (605101809) connection to sandbox.hortonworks.com/<MyIPaddress>:8020 from root]: DEBUG ipc.Client: IPC Client (605101809) connection to sandbox.hortonworks.com/<MyIPaddress>:8020 from root got value #100 17/08/28 05:45:56 [pool-1-thread-1]: DEBUG ipc.ProtobufRpcEngine: Call: getFileInfo took 13ms 17/08/28 05:45:56 [IPC Parameter Sending Thread #1]: DEBUG ipc.Client: IPC Client (605101809) connection to sandbox.hortonworks.com/<MyIPaddress>:8020 from root sending #101 17/08/28 05:45:56 [IPC Client (605101809) connection to sandbox.hortonworks.com/<MyIPaddress>:8020 from root]: DEBUG ipc.Client: IPC Client (605101809) connection to sandbox.hortonworks.com/<MyIPaddress>:8020 from root got value #101 17/08/28 05:45:56 [pool-1-thread-1]: DEBUG ipc.ProtobufRpcEngine: Call: getFileInfo took 6ms 17/08/28 05:45:56 [IPC Parameter Sending Thread #1]: DEBUG ipc.Client: IPC Client (605101809) connection to sandbox.hortonworks.com/<MyIPaddress>:8020 from root sending #102 17/08/28 05:45:56 [IPC Client (605101809) connection to sandbox.hortonworks.com/<MyIPaddress>:8020 from root]: DEBUG ipc.Client: IPC Client (605101809) connection to sandbox.hortonworks.com/<MyIPaddress>:8020 from root got value #102 17/08/28 05:45:56 [pool-1-thread-1]: DEBUG ipc.ProtobufRpcEngine: Call: delete took 30ms 17/08/28 05:45:56 [pool-1-thread-1]: DEBUG ipc.Client: stopping client from cache: org.apache.hadoop.ipc.Client@906d29b 17/08/28 05:45:56 [pool-1-thread-1]: DEBUG ipc.Client: stopping client from cache: org.apache.hadoop.ipc.Client@906d29b 17/08/28 05:45:56 [pool-1-thread-1]: DEBUG hdfs.DFSClient: DFSClient writeChunk allocating new packet seqno=1, src=/ats/active/application_1503897758632_0002/appattempt_1503897758632_0002_000001/domainlog-appattempt_1503897758632_0002_000001, packetSize=65016, chunksPerPacket=126, bytesCurBlock=0 17/08/28 05:45:56 [pool-1-thread-1]: DEBUG hdfs.DFSClient: Queued packet 1 17/08/28 05:45:56 [pool-1-thread-1]: DEBUG hdfs.DFSClient: Queued packet 2 17/08/28 05:45:56 [pool-1-thread-1]: DEBUG hdfs.DFSClient: Waiting for ack for: 2 17/08/28 05:45:56 [DataStreamer for file /ats/active/application_1503897758632_0002/appattempt_1503897758632_0002_000001/domainlog-appattempt_1503897758632_0002_000001 block BP-1464254149-<MyIPaddress>-1477381671113:blk_1073744260_3500]: DEBUG hdfs.DFSClient: DataStreamer block BP-1464254149-<MyIPaddress>-1477381671113:blk_1073744260_3500 sending packet packet seqno: 1 offsetInBlock: 0 lastPacketInBlock: false lastByteOffsetInBlock: 78 17/08/28 05:45:56 [ResponseProcessor for block BP-1464254149-<MyIPaddress>-1477381671113:blk_1073744260_3500]: DEBUG hdfs.DFSClient: DFSClient seqno: 1 reply: SUCCESS downstreamAckTimeNanos: 0 flag: 0 17/08/28 05:45:56 [DataStreamer for file /ats/active/application_1503897758632_0002/appattempt_1503897758632_0002_000001/domainlog-appattempt_1503897758632_0002_000001 block BP-1464254149-<MyIPaddress>-1477381671113:blk_1073744260_3500]: DEBUG hdfs.DFSClient: DataStreamer block BP-1464254149-<MyIPaddress>-1477381671113:blk_1073744260_3500 sending packet packet seqno: 2 offsetInBlock: 78 lastPacketInBlock: true lastByteOffsetInBlock: 78 17/08/28 05:45:56 [ResponseProcessor for block BP-1464254149-<MyIPaddress>-1477381671113:blk_1073744260_3500]: DEBUG hdfs.DFSClient: DFSClient seqno: 2 reply: SUCCESS downstreamAckTimeNanos: 0 flag: 0 17/08/28 05:45:56 [IPC Parameter Sending Thread #1]: DEBUG ipc.Client: IPC Client (605101809) connection to sandbox.hortonworks.com/<MyIPaddress>:8020 from root sending #103 17/08/28 05:45:56 [DataStreamer for file /ats/active/application_1503897758632_0002/appattempt_1503897758632_0002_000001/domainlog-appattempt_1503897758632_0002_000001 block BP-1464254149-<MyIPaddress>-1477381671113:blk_1073744260_3500]: DEBUG hdfs.DFSClient: Closing old block BP-1464254149-<MyIPaddress>-1477381671113:blk_1073744260_3500 17/08/28 05:45:56 [IPC Client (605101809) connection to sandbox.hortonworks.com/<MyIPaddress>:8020 from root]: DEBUG ipc.Client: IPC Client (605101809) connection to sandbox.hortonworks.com/<MyIPaddress>:8020 from root got value #103 17/08/28 05:45:56 [pool-1-thread-1]: DEBUG ipc.ProtobufRpcEngine: Call: complete took 29ms 17/08/28 05:45:56 [pool-1-thread-1]: DEBUG ipc.Client: stopping client from cache: org.apache.hadoop.ipc.Client@906d29b 17/08/28 05:45:56 [Thread-0]: DEBUG util.ShutdownHookManager: ShutdownHookManger complete shutdown.
... View more
08-28-2017
06:08 AM
Hi.. I am not able to launch the 'hive' session. The error which I get is as below: "[root@sandbox ~]# hive Logging initialized using configuration in file:/etc/hive/2.5.0.0-1245/0/hive-log4j.properties Query returned non-zero code: 1, cause: hive configuration hive.log.dir does not exists." I had earlier run a command which I think didn't allow me to connect to hive from the next login: hive> set hive.log.dir; hive.log.dir is undefined I have Hortonworks sandbox installed in my laptop since 6 months now. I had closed the previous hive session and the sandbox as well a few hours back. I reconnected using ssh command as I do on usual days for practicing. I am able to connect to hdfs, launch spark-shell, even access 'hive' tables through sqlContext.sql("select * from <dbName>.<tableName>") etc as usual, but don't know why I am not able to launch hive from anywhere: cmd /cygwin / port 4200 I tried to change the hive.log.dir parameter in /etc/hive/2.5.0.0-1245/0/hive-log4j.properties to a folder '/root/vishal' and also provided a sticky bit to it by issuing 'chmod 1777 <dirName> ' command (as per few discussion portals), but that too didn't work. Kindly help. Regards, Vishal.
... View more
- Tags:
- configuration
- Hive
Labels:
- Labels:
-
Apache Hive
04-09-2017
12:16 PM
Yeah @Emanuele Parente.. I went through the URLs. Also went through youtube tutorials for each topic. Not sure if it is legal to share the questions..
... View more
04-06-2017
09:13 AM
1 Kudo
Hi @Arkaprova Saha.. I cleared the HCA paper today. Instead of going through some book, I picked up the topics from HCA Exam Objectives pdf and went through the hyperlinks embedded within the same document. Thank you Hortonworks for a free voucher and @Lester Martin for your answers by the way 🙂 I'll go for HDPCD in 2-3 months from now.
... View more
03-28-2017
12:15 AM
Hi Lester.. Is the 1-day Hadoop essential course free to go through now ?? If yes, kindly share the link. Thanks.
... View more