Re: How can I get a clean upgrade env?

luckyxu · ‎01-16-2019

Anyone can help me?

luckyxu · ‎01-07-2019

We are using HDP 3.0.0 and it upgraded from 2.6.5. And we faced some issues while doing this upgrade and we did some manually clean in Ambari database. Now we are trying to upgrade from 3.0.0 to 3.0.1. And seems it still have some issues and it show some steps listed in upgrade 2.6.5 to 3.0.0. How can I let the environment ready to upgrade to 3.0.1? I mean how can I do a clean for previous upgrade so that we can do new upgrade? Thanks.

luckyxu · ‎10-09-2018

I got same errors and at last I found there are some non-compliable jar files in spark lib directory. Please check your spark lib path to see if there are some additional jars you added.

luckyxu · ‎09-14-2018

Is 'DAS' open source and free to use?

luckyxu · ‎09-14-2018

Is it possible to install TEZ UI on HDP3.0 manually? It is really not convenience without TEZ UI to analysis query.

luckyxu · ‎08-11-2018

If I mark upgrade request/stage/command as 'COMPLETED', the upgrade will be as completed automatically? Or I must set to complete somewhere? If yes, where can I set to 'completed' in database.

luckyxu · ‎08-08-2018

There are four 'ABORTED', 'COMPLETED', 'FAILED', 'SKIPPED_FAILED' status in ambari db. But not see HOLDING or HOLDING_TIMEOUT. When I try to trigger resume upgrade, the log show those message. Any suggestion, Thanks. ERROR [ambari-client-thread-481] TaskStatusListener:138 - Received update for a task 20232 which is not being tracked as running task ERROR [ambari-client-thread-481] TaskStatusListener:138 - Received update for a task 20233 which is not being tracked as running task ERROR [ambari-client-thread-481] TaskStatusListener:138 - Received update for a task 20234 which is not being tracked as running task

luckyxu · ‎08-08-2018

Thanks akhil. I will try to let task continue per your suggestion. Can you tell me which table/row need to mark as complete to let upgrade complete?

luckyxu · ‎08-08-2018

Thanks for your reply. I removed 'Move Hive Tables' since it failed when I upgrade the HDP 3.0. I manually did run the command to finish this task. Another question, can we manually finalize the cluster and make upgrade as complete. Since I have upgrade all componets and most of components are working now. I want to mark upgrade as complete and fix components one bye one if it has issue.

luckyxu · ‎08-07-2018

Seems it related with hcatalog event lister. I removed setting for 'hive.metastore.event.listeners' and the exception gone. Three are no any issue when I try to connect through beeline. Not sure if there are any misconfiguration.

luckyxu · ‎08-06-2018

I was upgrade the HDP to 3.0 and it is not finilized yet. When I try to run hive command, it get such message: 'while processing statement: FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.MoveTask. Unable to alter table. java.lang.IllegalStateException: Invalid attempt to overwrite a read-only parameter: DB_NOTIFICATION_EVENT_ID_KEY_NAME (state=08S01,code=1)' The operation seems done. but always get this exception. Any suggestion.

luckyxu · ‎08-05-2018

HDP upgrade ui always show 'Waiting to execute the next task'. When I do upgradtion, it failed on 'Move hive tables' step, so I tried to remove row in ambari db for this task. And after roll back the database, the upgrade can't continue, anyone can help me?

luckyxu · ‎08-05-2018

I upgrade ambari server to 2.7.0.0-897 and got those message when I try to restart any component: Seems it is rerlated with solr group info. I checked all nodes and see it both have solr user and right group. Anyone can help me? Thanks Traceback (most recent call last): File "/var/lib/ambari-agent/cache/stack-hooks/before-ANY/scripts/hook.py", line 35, in <module> BeforeAnyHook().execute() File "/usr/lib/ambari-agent/lib/resource_management/libraries/script/script.py", line 353, in execute method(env) File "/var/lib/ambari-agent/cache/stack-hooks/before-ANY/scripts/hook.py", line 29, in hook setup_users() File "/var/lib/ambari-agent/cache/stack-hooks/before-ANY/scripts/shared_initialization.py", line 50, in setup_users groups = params.user_to_groups_dict[user], KeyError: u'solr' Error: Error: Unable to run the custom hook script ['/usr/bin/python', '/var/lib/ambari-agent/cache/stack-hooks/before-ANY/scripts/hook.py', 'ANY', '/var/lib/ambari-agent/data/command-19443.json', '/var/lib/ambari-agent/cache/stack-hooks/before-ANY', '/var/lib/ambari-agent/data/structured-out-19443.json', 'INFO', '/var/lib/ambari-agent/tmp', 'PROTOCOL_TLSv1_2', '']Error: Error: Unable to run the custom hook script ['/usr/bin/python', '/var/lib/ambari-agent/cache/stack-hooks/before-START/scripts/hook.py', 'START', '/var/lib/ambari-agent/data/command-19443.json', '/var/lib/ambari-agent/cache/stack-hooks/before-START', '/var/lib/ambari-agent/data/structured-out-19443.json', 'INFO', '/var/lib/ambari-agent/tmp', 'PROTOCOL_TLSv1_2', '']

Online	Offline
Last Visited	‎03-01-2019 04:24 AM

Date Registered	‎08-05-2018 05:01 AM
Last Visited	‎03-01-2019 04:24 AM
Total Messages Posted	17

Re: How can I get a clean upgrade env?

How can I get a clean upgrade env?

Re: Yarn cannot start AM on some nodes after updat...

Re: Is it possible to deploy tez ui on HDP 3.0

Is it possible to deploy tez ui on HDP 3.0

Re: Upgrade to HDP 3.0. it show 'Waiting to execut...

Re: Upgrade to HDP 3.0. it show 'Waiting to execut...

Re: Upgrade to HDP 3.0. it show 'Waiting to execut...

Re: Upgrade to HDP 3.0. it show 'Waiting to execut...

Re: Hive get exception when try to do insert/creat...

Hive get exception when try to do insert/create op...

Upgrade to HDP 3.0. it show 'Waiting to execute th...

Failed to start service after upgade to Ambari 2.7...