Member since
04-25-2016
579
Posts
609
Kudos Received
111
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
1986 | 02-12-2020 03:17 PM | |
1370 | 08-10-2017 09:42 AM | |
10125 | 07-28-2017 03:57 AM | |
2156 | 07-19-2017 02:43 AM | |
1671 | 07-13-2017 11:42 AM |
09-17-2016
04:56 PM
3 Kudos
@Jayadeep Jayaraman Please see my inline comments. 1. If I want to use separate tez configurations for hive is changing hive-site.xml sufficient? take advantage to hive session level property settings or use --hiveconf to set the session level param to override the default hive/tez params 2. How to setup tez on this new node? install tez-client on this new node 3. How will hive or any other application know about tez that has been newly setup on this node? I am trying to basically understand how an application (hive, pig etc) is aware of tez. tez.lib.uris point to tez jars on hdfs which tells hive client to use tez library at runtime. to see this location you can use set tez.lib.uris; from your client
... View more
09-17-2016
04:35 AM
7 Kudos
@Sunile Manjeethis is the one which I created recently for 1.2.1
... View more
09-13-2016
10:57 PM
@Sami Ahmad can you post lsof -i:10000 # it should be return the process id of you hiveserver2 telnet hadoop2.tolls.dot.state.fl.us 10000 netstat -talnp| grep <hive server2 pid>
... View more
09-13-2016
05:38 PM
2 Kudos
are you able to reach this hadoop2.tolls.dot.state.fl.us and port 10000 from the node where you are running beeline?
... View more
09-13-2016
06:02 AM
did you try this? https://github.com/colinmarc/zerowing
... View more
09-13-2016
04:25 AM
1 Kudo
on RM node and restart the RM.
... View more
09-13-2016
04:21 AM
@Arun A K it does take effect after setting yarn.resourcemanager.scheduler.class value to org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler using ambari but there is no property in ambari with the name of yarn.scheduler.fair.allocation.file so you need to define the custom property with the name of yarn.scheduler.fair.allocation.file and set it to fair-scheduler.xml.
... View more
09-13-2016
03:51 AM
1 Kudo
HDP dont support Fair Scheduler, it support only capacity scheduler, you can check the following documents to configure pre-emption in capacity scheduler http://hortonworks.com/blog/better-slas-via-resource-preemption-in-yarns-capacityscheduler/
... View more
09-13-2016
02:33 AM
2 Kudos
did you tried these steps https://community.microstrategy.com/t5/Database/TN46462-How-to-configure-Hortonworks-ODBC-connector-on-Linux-for/ta-p/196119 http://hortonworks.com/hadoop-tutorial/microstrategy-apache-hive-and-the-hortonworks-sandbox/
... View more
09-11-2016
04:46 PM
4 Kudos
will be interested to know but with my best knowledge there is no datastorage schema in pig who can support consuming message from kafka. pig is well suited for data in rest not for data in motion or streaming. for publishing data into kafka you can leverages kafka bridge https://github.com/kafka-dev/kafka/tree/master/contrib/hadoop-producer
... View more