Member since
05-26-2016
37
Posts
5
Kudos Received
3
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
636 | 07-01-2016 09:18 AM | |
571 | 07-01-2016 09:07 AM | |
335 | 06-09-2016 03:21 AM |
07-12-2017
07:29 AM
Hi Team , Currently our Kafka message size is 1 MB .We are planning to increase it to 5 MB to accommodate new transaction data. Any impact on existing topics do we have to change any thing . Anybody have tried this before Thanks in advance .
... View more
Labels:
03-08-2017
04:43 AM
Hi All, How fast is Drill actually .Is it good for interactive queries . Our current environment is HDP 2.4 ,Hive 1.0 with TEZ execution engine .Interactive queries are quite slow . Are we going to get any significant improvement by moving in to Drill or HDP 2.5 with Hive 2.0 would be a better option . Please give me your valuable inputs.
... View more
Labels:
01-16-2017
07:05 AM
Hi Team , we are planning to upgrade Hive server 1.2 to 2.0 basically we are migrating from HDP 2.4.2 to HDP 2.5 Are there any compatability issues ,any pit falls whihc we should take care . Any data limits. they are talking about 25 X faster !! really ? Please let me know your inputs .. Regards Shihab
... View more
01-12-2017
06:54 AM
Falcon webUi not working From http://xxxxx.com:15000 in 0.000s (HTTP Error 503: Service Unavailable). Service check fails with SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
ERROR: Unable to initialize Falcon Client object falcon admin -version command also fails with the same error . Any help appreciated .
... View more
08-05-2016
01:34 PM
Just removed the extra directories expect the current and other one it worked
... View more
08-05-2016
01:33 PM
This worked for me
... View more
07-14-2016
12:20 PM
We ran into the same issue using Ambari 2.2.2.2.It stops at 35%.Says another instance is running and exiting. when you restart form Ambari or from the command line .Fix is :go to your name node run ps -aef|grep balancer kill -9 all the balancer process except the irq balancer (Linux native).Start the balancer from cmd line using # sudo -u hdfs hdfs balancer it works !!!
... View more
07-14-2016
12:18 PM
We ran into the same issue using Ambari 2.2.2.2.It stops at 35%.Says another instance is running when you restart form Ambari or from the command line .Fix is :go to your name node run ps -aef|grep balancer kill -9 all the balancer process except the irq balancer (Linux native).Start the balancer from cmd line using # sudo -u hdfs hdfs balancer it works !!! Looks like a Bug in Ambari https://community.hortonworks.com/articles/4595/balancer-not-working-in-hdfs-ha.html
... View more
07-11-2016
11:44 AM
Hi All, Hiveserver2 is creating huge log files sometime TB size.Perflogger is enabled .Also level of logging in INFO. . How do i disable Perflog and make logging level to WARN or ERROR
... View more
Labels:
07-01-2016
09:29 AM
Hi @s sandeep I have faced this issue before.Restart Ambari and Hive the error will go away.
... View more
07-01-2016
09:18 AM
Hi @Takahiko Saito @@vpoornalingam There where multiple instances of Metastores running .When Ambari crashed we tried to start the service manually and created one extra instance and it was consuming the port number .Manually stopped the other instance and rstarted Hive every thing came back to normal . Thanks for the support
... View more
07-01-2016
09:07 AM
Hi Solved this issue .there was left over from a failed kerbors implementation.So Kafka was trying to get authorised from Kerbors hence the AuthorizationException removed it and restarted Kafka .Every thing works fine.
... View more
07-01-2016
03:39 AM
Hi We are getting this error while running Kafak producer.Any inputs sh kafka-console-producer.sh --broker-list xxxxxxxxx.com:6667 --topic test1 Throwing following error
[2016-06-30 12:40:25,122] WARN Error while fetching metadata [{TopicMetadata for topic test1 ->
No partition metadata for topic test1 due to kafka.common.TopicAuthorizationException}] for topic [test1]: class
... View more
Labels:
06-29-2016
10:48 AM
Hi All, Looks like only my Hive Cli is not working .I am able to access Hive through beeline works fine .Because the CLI is hanging Ambari is showing metastore critical.We dont have an option to use beeline cz all our code is written to use hive cli . Any inputs
... View more
Labels:
06-29-2016
10:46 AM
Hi All, Looks like only my Hive Cli is not working .I am able to access Hive through beeline works file .Because the CLI is hanging Ambari is showing metastore critical.We dont have an option to use beeline cz all our code is written to use hive cli . Any inputs. @Rajkumar Singh @Laurent Edel
... View more
06-29-2016
08:18 AM
Hi Hive metastore is giving error.Tried restarting the Metsatore,Hive and the cluster also .Still the error is there . Metastore on hklpaprad12.hk.xxxxxxxx.com failed (Traceback (most recent call last): File "/var/lib/ambari-agent/cache/common-services/HIVE/0.12.0.2.0/package/alerts/alert_hive_metastore.py", line 190, in execute timeout=int(check_command_timeout) ) File "/usr/lib/python2.6/site-packages/resource_management/core/base.py", line 154, in __init__ self.env.run() File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 160, in run self.run_action(resource, action) File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 124, in run_action provider_action() File "/usr/lib/python2.6/site-packages/resource_management/core/providers/system.py", line 238, in action_run tries=self.resource.tries, try_sleep=self.resource.try_sleep) File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 70, in inner result = function(command, **kwargs) File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 92, in checked_call tries=tries, try_sleep=try_sleep) File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 140, in _call_wrapper result = _call(command, **kwargs_copy) File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 285, in _call raise ExecuteTimeoutException(err_msg) ExecuteTimeoutException: Execution of 'ambari-sudo.sh su ambari-qa -l -s /bin/bash -c 'export PATH='"'"'/usr/sbin:/sbin:/usr/lib/ambari-server/*:/usr/lib64/qt-3.3/bin:/usr/local/sbin:/usr/local/bin:/sbin:/bin:/usr/sbin:/usr/bin:/opt/tss/bin:/opt/tss/itrs:/opt/tss/post.d:/opt/VRTSvcs/bin:/opt/dell/srvadmin/bin:/opt/dell/srvadmin/sbin:/root/bin:/var/lib/ambari-agent:/bin/:/usr/bin/:/usr/sbin/:/usr/hdp/current/hive-metastore/bin'"'"' ; export HIVE_CONF_DIR='"'"'/usr/hdp/current/hive-metastore/conf/conf.server'"'"' ; hive --hiveconf hive.metastore.uris=thrift://hklpaprad12.hk.xxxxxxxx.com:9083 --hiveconf hive.metastore.client.connect.retry.delay=1 --hiveconf hive.metastore.failure.retries=1 --hiveconf hive.metastore.connect.retries=1 --hiveconf hive.metastore.client.socket.timeout=14 --hiveconf hive.execution.engine=mr -e '"'"'show databases;'"'"''' was killed due timeout after 60 seconds ) Any help appreciated Thanks inadvance
... View more
Labels:
06-27-2016
09:00 AM
Hi is this resolution out already.We are facing the issue on Ambari 2.2.2.2
... View more
06-27-2016
08:54 AM
Any fix for this yet .We are using Ambari 2.2.2.2 and facing the same issue @Ancil McBarnett
... View more
06-27-2016
08:49 AM
1 Kudo
We are getting the following error in Hive query editor.This error occurs inconsistently.Select queries are working fine.We are using Ambari 2.2.2.2.
... View more
Labels:
06-17-2016
08:32 AM
Hi All, Hive throws error while creating new database.But after giving this error it is creating the Data Base . create database test_1;
FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTa sk. Database test_1 already exists It is also giving error while dropping the database . drop database test_1;
FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTa sk. MetaException(message:java.lang.NullPointerException) Any help appreciated . Thanks in advance .
... View more
Labels:
06-15-2016
06:47 AM
1 Kudo
Hi All, We are using LVM on the Data nodes HDFS Volumes .Is this going to create latency in Read/Write . We have observed that local to HDFS files copies are taking too much of time .especially when doing multiple copies. Any thoughts on this .. Shihab
... View more
Labels:
06-14-2016
11:58 AM
1 Kudo
Hi All Hive is creating GB size files in /tmp we are facing size issue because of this. 15.3 G /tmp/hive/hive/e9f9943b-8b35-466a-9d61-17e8a86339f1/hive_2016-06-09_19-00-01_169_2126725244382661354-1/-mr-10001/.hive-staging_hive_2016-06-09_19-00-01_169_2126725244382661354-1/-ext-10002/000074_0 15.3 G /tmp/hive/hive/e9f9943b-8b35-466a-9d61-17e8a86339f1/hive_2016-06-09_19-00-01_169_2126725244382661354-1/-mr-10001/.hive-staging_hive_2016-06-09_19-00-01_169_2126725244382661354-1/-ext-10002/000075_0 15.2 G /tmp/hive/hive/e9f9943b-8b35-466a-9d61-17e8a86339f1/hive_2016-06-09_19-00-01_169_2126725244382661354-1/-mr-10001/.hive-staging_hive_2016-06-09_19-00-01_169_2126725244382661354-1/-ext-10002/000076_0 15.2 G /tmp/hive/hive/e9f9943b-8b35-466a-9d61-17e8a86339f1/hive_2016-06-09_19-00-01_169_2126725244382661354-1/-mr-10001/.hive-staging_hive_2016-06-09_19-00-01_169_2126725244382661354-1/-ext-10002/000077_0 15.4 G /tmp/hive/hive/e9f9943b-8b35-466a-9d61-17e8a86339f1/hive_2016-06-09_19-00-01_169_2126725244382661354-1/-mr-10001/.hive-staging_hive_2016-06-09_19-00-01_169_2126725244382661354-1/-ext-10002/000078_0 Any help is appreciated . Thanks in advance
... View more
Labels:
06-10-2016
04:05 AM
Thanks that clears a lot 🙂
... View more
06-10-2016
03:53 AM
Hi All, We currently have the following data node directories /data01,/data02,/data03 of 10 TB each .Now we have adding new file systems data04,data05,data06 16 TB each. Is the size different going to create any performance issues? Do we need to shrink the file system to match our existing ones? Any inputs would be appreciated.
... View more
Labels:
06-09-2016
03:21 AM
Hi All fixed the issue /var/log was full .mysql was giving errors cz of this . Port 8080 was not listening .Cleared the /var and restarted Ambari everything started working 🙂 Thanks for your support
... View more
06-08-2016
06:57 AM
Hi All, Ambari server started hanging .After restart it is not listening any more on port 8080 .It gives the following log while starting. # service ambari-server start -v -g
Using python /usr/bin/python
Starting ambari-server
INFO: Loading properties from /etc/ambari-server/conf/ambari.properties
INFO: Loading properties from /etc/ambari-server/conf/ambari.properties
INFO: Loading properties from /etc/ambari-server/conf/ambari.properties
INFO: Ambari Server is not running...
INFO: Loading properties from /etc/ambari-server/conf/ambari.properties
INFO: Loading properties from /etc/ambari-server/conf/ambari.properties
Ambari Server running with administrator privileges.
INFO: Loading properties from /etc/ambari-server/conf/ambari.properties
Organizing resource files at /var/lib/ambari-server/resources...
INFO: Loading properties from /etc/ambari-server/conf/ambari.properties
INFO: AMBARI_SERVER_LIB is not set, using default /usr/lib/ambari-server
INFO: Loading properties from /etc/ambari-server/conf/ambari.properties
INFO: Loading properties from /etc/ambari-server/conf/ambari.properties
INFO: Running server: ['/bin/sh', '-c', "ulimit -n 10000 ; /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.45-28.b13.el6_6.x86_64/bin/java -server -XX:NewRatio=2 -XX:+UseConcMarkSweepGC -Xms8192m -Xmx16384m -Djava.security.auth.login.config=/etc/ambari-server/conf/krb5JAASLogin.conf -Djava.security.krb5.conf=/etc/krb5.conf -Djavax.security.auth.useSubjectCredsOnly=false -Xdebug -Xrunjdwp:transport=dt_socket,address=5005,server=y,suspend=n -cp '/etc/ambari-server/conf:/usr/lib/ambari-server/*:/usr/share/java/mysql-connector-java.jar' org.apache.ambari.server.controller.AmbariServer > /var/log/ambari-server/ambari-server.out 2>&1 || echo $? > /var/run/ambari-server/ambari-server.exitcode &"]
Server PID at: /var/run/ambari-server/ambari-server.pid
Server out at: /var/log/ambari-server/ambari-server.out
Server log at: /var/log/ambari-server/ambari-server.log
Waiting for server start....................
Ambari Server 'start' completed successfully. Please help
... View more
Labels:
06-07-2016
04:00 AM
1 Kudo
Restart Amabri.it worked for me
... View more
06-07-2016
03:59 AM
Restart Ambari Server .It worked for me
... View more
06-07-2016
03:57 AM
Ambari server and Hive restart worked for me
... View more