Member since
03-22-2018
27
Posts
0
Kudos Received
0
Solutions
04-26-2018
02:38 PM
@Geoffrey Shelton Okot Thanks for your comment. beeline does work for me. I just want to understand, Do you mean the hive CLI is no more? I should use beeline instead of hive command and on which user ID I should set the value export USE_DEPRECATED_CLI=false
... View more
04-19-2018
02:10 PM
@Harald Berghoff I'm running the hive command from hive user ID. And yes it has full permission for hive user. [~] $ ls -l /usr/hdp/2.6.1.0-129/tez/lib/tez.tar.gz -rwxrwxr-x 1 hive hadoop 51303070 May 31 2017 /usr/hdp/2.6.1.0-129/tez/lib/tez.tar.gz
... View more
04-19-2018
01:31 PM
Hi Folks, I receive an error while running hive command. All the hive services are running fine. Please see the log below and help me to fix this issue. Note : tez.lib.uris of tez and hive are same. $ hive
log4j:WARN No such property [maxFileSize] in org.apache.log4j.DailyRollingFileAppender.
Logging initialized using configuration in file:/etc/hive/2.6.1.0-129/0/hive-log4j.properties
Exception in thread "main" java.lang.RuntimeException: java.io.FileNotFoundException: File does not exist: /usr/hdp/2.6.1.0-129/tez/lib/tez.tar.gz
at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:560)
at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:681)
at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:625)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.hadoop.util.RunJar.run(RunJar.java:233)
at org.apache.hadoop.util.RunJar.main(RunJar.java:148)
Caused by: java.io.FileNotFoundException: File does not exist: /usr/hdp/2.6.1.0-129/tez/lib/tez.tar.gz
at org.apache.hadoop.hdfs.DistributedFileSystem$26.doCall(DistributedFileSystem.java:1446)
at org.apache.hadoop.hdfs.DistributedFileSystem$26.doCall(DistributedFileSystem.java:1438)
at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81)
at org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:1438)
at org.apache.hadoop.fs.FileSystem.resolvePath(FileSystem.java:770)
at org.apache.tez.client.TezClientUtils.getLRFileStatus(TezClientUtils.java:130)
at org.apache.tez.client.TezClientUtils.setupTezJarsLocalResources(TezClientUtils.java:181)
at org.apache.tez.client.TezClient.getTezJarResources(TezClient.java:831)
at org.apache.tez.client.TezClient.start(TezClient.java:355)
at org.apache.hadoop.hive.ql.exec.tez.TezSessionState.open(TezSessionState.java:197)
at org.apache.hadoop.hive.ql.exec.tez.TezSessionState.open(TezSessionState.java:116)
at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:557)
... 8 more $ locate /usr/hdp/2.6.1.0-129/tez/lib/tez.tar.gz /usr/hdp/2.6.1.0-129/tez/lib/tez.tar.gz
... View more
Labels:
- Labels:
-
Apache Hive
-
Apache Tez
04-06-2018
08:20 PM
@Geoffrey Shelton Okot Thanks for your comment and it helps. Please could you share the manual steps to make the change of blocksize of stored dataset in existing cluster if you have handy. would be really helpful for practice.
... View more
04-06-2018
07:39 PM
Hi, I've setup the hadoop cluster and I've data in it. Its default data blocksize is 128MB and now I want to change the blocksize as 256MB. My question is, how to get the existing dataset overwritten from 128MB to 256MB.
... View more
Labels:
- Labels:
-
Apache Hadoop
03-28-2018
01:15 PM
@adash thanks for your comment. Why these particular services are getting connected with DB. pls could you explain in detail like what happens exactly when we are using Hive, Oozie, and Ranger.
... View more
03-28-2018
09:47 AM
Hi All, I had setup HDP cluster using ambari UI. Here I'm using postgres DB and would need to know why the DB to be configured for particular services only like hive, oozie and so on. Please experts clarify more. Thanks in advance.
... View more
Labels:
- Labels:
-
Apache Ambari
-
Apache Hive
-
Apache Oozie
03-28-2018
09:34 AM
@Jay Kumar SenSharma Thanks for heads up. Ambari agents are running as Non root (hadoop) user the directory was created when we tried to srart the spark2 service and the owner was assigned as spark user. Now I've changed the owner as hadoop user and the service came up. thanks a lot 🙂
... View more
03-28-2018
05:25 AM
@Jay Kumar SenSharma Can I have your advise on my post please..
... View more
03-27-2018
02:20 PM
Please see the error messsage below and help to start the Spark2 history server. Traceback (most recent call last):
File "/var/lib/ambari-agent/cache/common-services/SPARK2/2.0.0/package/scripts/job_history_server.py", line 103, in <module>
JobHistoryServer().execute()
File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 329, in execute
method(env)
File "/var/lib/ambari-agent/cache/common-services/SPARK2/2.0.0/package/scripts/job_history_server.py", line 56, in start
spark_service('jobhistoryserver', upgrade_type=upgrade_type, action='start')
File "/var/lib/ambari-agent/cache/common-services/SPARK2/2.0.0/package/scripts/spark_service.py", line 65, in spark_service
make_tarfile(tmp_archive_file, source_dir)
File "/var/lib/ambari-agent/cache/common-services/SPARK2/2.0.0/package/scripts/spark_service.py", line 44, in make_tarfile
os.chmod(parent_dir, 0711) OSError: [Errno 1] Operation not permitted: '/tmp/spark2'
... View more
Labels:
- « Previous
-
- 1
- 2
- Next »