Member since
08-05-2018
17
Posts
0
Kudos Received
0
Solutions
01-07-2019
12:01 PM
We are using HDP 3.0.0 and it upgraded from 2.6.5. And we faced some issues while doing this upgrade and we did some manually clean in Ambari database. Now we are trying to upgrade from 3.0.0 to 3.0.1. And seems it still have some issues and it show some steps listed in upgrade 2.6.5 to 3.0.0. How can I let the environment ready to upgrade to 3.0.1? I mean how can I do a clean for previous upgrade so that we can do new upgrade? Thanks.
... View more
Labels:
10-09-2018
11:10 AM
I got same errors and at last I found there are some non-compliable jar files in spark lib directory. Please check your spark lib path to see if there are some additional jars you added.
... View more
09-14-2018
01:02 AM
Is it possible to install TEZ UI on HDP3.0 manually? It is really not convenience without TEZ UI to analysis query.
... View more
- Tags:
- Hadoop Core
- tezui
Labels:
- Labels:
-
Apache Tez
08-11-2018
05:20 AM
If I mark upgrade request/stage/command as 'COMPLETED', the upgrade will be as completed automatically? Or I must set to complete somewhere? If yes, where can I set to 'completed' in database.
... View more
08-08-2018
08:07 AM
There are four 'ABORTED', 'COMPLETED', 'FAILED', 'SKIPPED_FAILED' status in ambari db. But not see HOLDING or HOLDING_TIMEOUT. When I try to trigger resume upgrade, the log show those message. Any suggestion, Thanks. ERROR [ambari-client-thread-481] TaskStatusListener:138 - Received update for a task 20232 which is not being tracked as running task
ERROR [ambari-client-thread-481] TaskStatusListener:138 - Received update for a task 20233 which is not being tracked as running task
ERROR [ambari-client-thread-481] TaskStatusListener:138 - Received update for a task 20234 which is not being tracked as running task
... View more
08-08-2018
07:05 AM
Thanks akhil. I will try to let task continue per your suggestion. Can you tell me which table/row need to mark as complete to let upgrade complete?
... View more
08-08-2018
06:31 AM
Thanks for your reply. I removed 'Move Hive Tables' since it failed when I upgrade the HDP 3.0. I manually did run the command to finish this task. Another question, can we manually finalize the cluster and make upgrade as complete. Since I have upgrade all componets and most of components are working now. I want to mark upgrade as complete and fix components one bye one if it has issue.
... View more
08-07-2018
02:06 AM
Seems it related with hcatalog event lister. I removed setting for 'hive.metastore.event.listeners' and the exception gone. Three are no any issue when I try to connect through beeline. Not sure if there are any misconfiguration.
... View more
08-06-2018
08:17 AM
I was upgrade the HDP to 3.0 and it is not finilized yet. When I try to run hive command, it get such message: 'while processing statement: FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.MoveTask. Unable to alter table. java.lang.IllegalStateException: Invalid attempt to overwrite a read-only parameter: DB_NOTIFICATION_EVENT_ID_KEY_NAME (state=08S01,code=1)' The operation seems done. but always get this exception. Any suggestion.
... View more
- Tags:
- Data Processing
- Hive
Labels:
- Labels:
-
Apache Hive
08-05-2018
02:50 PM
HDP upgrade ui always show 'Waiting to execute the next task'. When I do upgradtion, it failed on 'Move hive tables' step, so I tried to remove row in ambari db for this task. And after roll back the database, the upgrade can't continue, anyone can help me?
... View more
Labels:
08-05-2018
05:08 AM
I upgrade ambari server to 2.7.0.0-897 and got those message when I try to restart any component: Seems it is rerlated with solr group info. I checked all nodes and see it both have solr user and right group. Anyone can help me? Thanks Traceback (most recent call last):
File "/var/lib/ambari-agent/cache/stack-hooks/before-ANY/scripts/hook.py", line 35, in <module>
BeforeAnyHook().execute()
File "/usr/lib/ambari-agent/lib/resource_management/libraries/script/script.py", line 353, in execute
method(env)
File "/var/lib/ambari-agent/cache/stack-hooks/before-ANY/scripts/hook.py", line 29, in hook
setup_users()
File "/var/lib/ambari-agent/cache/stack-hooks/before-ANY/scripts/shared_initialization.py", line 50, in setup_users
groups = params.user_to_groups_dict[user],
KeyError: u'solr'
Error: Error: Unable to run the custom hook script ['/usr/bin/python', '/var/lib/ambari-agent/cache/stack-hooks/before-ANY/scripts/hook.py', 'ANY', '/var/lib/ambari-agent/data/command-19443.json', '/var/lib/ambari-agent/cache/stack-hooks/before-ANY', '/var/lib/ambari-agent/data/structured-out-19443.json', 'INFO', '/var/lib/ambari-agent/tmp', 'PROTOCOL_TLSv1_2', '']Error: Error: Unable to run the custom hook script ['/usr/bin/python', '/var/lib/ambari-agent/cache/stack-hooks/before-START/scripts/hook.py', 'START', '/var/lib/ambari-agent/data/command-19443.json', '/var/lib/ambari-agent/cache/stack-hooks/before-START', '/var/lib/ambari-agent/data/structured-out-19443.json', 'INFO', '/var/lib/ambari-agent/tmp', 'PROTOCOL_TLSv1_2', '']
... View more
Labels:
- Labels:
-
Apache Ambari