Hi Team , Currently our Kafka message size is 1 MB .We are planning to increase it to 5 MB to accommodate new transaction data. Any impact on existing topics do we have to change any thing . Anybody have tried this before Thanks in advance . ... View more

Hi All, How fast is Drill actually .Is it good for interactive queries . Our current environment is HDP 2.4 ,Hive 1.0 with TEZ execution engine .Interactive queries are quite slow . Are we going to get any significant improvement by moving in to Drill or HDP 2.5 with Hive 2.0 would be a better option . Please give me your valuable inputs. ... View more

Hi Team , we are planning to upgrade Hive server 1.2 to 2.0 basically we are migrating from HDP 2.4.2 to HDP 2.5 Are there any compatability issues ,any pit falls whihc we should take care . Any data limits. they are talking about 25 X faster !! really ? Please let me know your inputs .. Regards Shihab ... View more

Hi Hive metastore is giving error.Tried restarting the Metsatore,Hive and the cluster also .Still the error is there . Metastore on hklpaprad12.hk.xxxxxxxx.com failed (Traceback (most recent call last): File "/var/lib/ambari-agent/cache/common-services/HIVE/0.12.0.2.0/package/alerts/alert_hive_metastore.py", line 190, in execute timeout=int(check_command_timeout) ) File "/usr/lib/python2.6/site-packages/resource_management/core/base.py", line 154, in __init__ self.env.run() File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 160, in run self.run_action(resource, action) File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 124, in run_action provider_action() File "/usr/lib/python2.6/site-packages/resource_management/core/providers/system.py", line 238, in action_run tries=self.resource.tries, try_sleep=self.resource.try_sleep) File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 70, in inner result = function(command, **kwargs) File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 92, in checked_call tries=tries, try_sleep=try_sleep) File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 140, in _call_wrapper result = _call(command, **kwargs_copy) File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 285, in _call raise ExecuteTimeoutException(err_msg) ExecuteTimeoutException: Execution of 'ambari-sudo.sh su ambari-qa -l -s /bin/bash -c 'export PATH='"'"'/usr/sbin:/sbin:/usr/lib/ambari-server/*:/usr/lib64/qt-3.3/bin:/usr/local/sbin:/usr/local/bin:/sbin:/bin:/usr/sbin:/usr/bin:/opt/tss/bin:/opt/tss/itrs:/opt/tss/post.d:/opt/VRTSvcs/bin:/opt/dell/srvadmin/bin:/opt/dell/srvadmin/sbin:/root/bin:/var/lib/ambari-agent:/bin/:/usr/bin/:/usr/sbin/:/usr/hdp/current/hive-metastore/bin'"'"' ; export HIVE_CONF_DIR='"'"'/usr/hdp/current/hive-metastore/conf/conf.server'"'"' ; hive --hiveconf hive.metastore.uris=thrift://hklpaprad12.hk.xxxxxxxx.com:9083 --hiveconf hive.metastore.client.connect.retry.delay=1 --hiveconf hive.metastore.failure.retries=1 --hiveconf hive.metastore.connect.retries=1 --hiveconf hive.metastore.client.socket.timeout=14 --hiveconf hive.execution.engine=mr -e '"'"'show databases;'"'"''' was killed due timeout after 60 seconds ) Any help appreciated Thanks inadvance ... View more

Hi All, Hive throws error while creating new database.But after giving this error it is creating the Data Base . create database test_1; FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTa sk. Database test_1 already exists It is also giving error while dropping the database . drop database test_1; FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTa sk. MetaException(message:java.lang.NullPointerException) Any help appreciated . Thanks in advance . ... View more