Created 05-26-2018 05:59 PM
I completed the installation of a 4 node HDP cluster. Almost everything is up and running except for Hive Server. when I try to start the hive server. I get an error
Traceback (most recent call last):
File "/var/lib/ambari-agent/cache/common-services/HIVE/0.12.0.2.0/package/scripts/hive_server.py", line 161, in <module>
HiveServer().execute()
File "/usr/lib/ambari-agent/lib/resource_management/libraries/script/script.py", line 375, in execute
method(env)
File "/var/lib/ambari-agent/cache/common-services/HIVE/0.12.0.2.0/package/scripts/hive_server.py", line 77, in start
self.configure(env) # FOR SECURITY
File "/usr/lib/ambari-agent/lib/resource_management/libraries/script/script.py", line 120, in locking_configure
original_configure(obj, *args, **kw)
File "/var/lib/ambari-agent/cache/common-services/HIVE/0.12.0.2.0/package/scripts/hive_server.py", line 51, in configure
hive(name='hiveserver2')
File "/usr/lib/ambari-agent/lib/ambari_commons/os_family_impl.py", line 89, in thunk
return fn(*args, **kwargs)
File "/var/lib/ambari-agent/cache/common-services/HIVE/0.12.0.2.0/package/scripts/hive.py", line 310, in hive
jdbc_connector(params.hive_jdbc_target, params.hive_previous_jdbc_jar)
File "/var/lib/ambari-agent/cache/common-services/HIVE/0.12.0.2.0/package/scripts/hive.py", line 527, in jdbc_connector
content = DownloadSource(params.driver_curl_source))
File "/usr/lib/ambari-agent/lib/resource_management/core/base.py", line 166, in __init__
self.env.run()
File "/usr/lib/ambari-agent/lib/resource_management/core/environment.py", line 160, in run
self.run_action(resource, action)
File "/usr/lib/ambari-agent/lib/resource_management/core/environment.py", line 124, in run_action
provider_action()
File "/usr/lib/ambari-agent/lib/resource_management/core/providers/system.py", line 123, in action_create
content = self._get_content()
File "/usr/lib/ambari-agent/lib/resource_management/core/providers/system.py", line 160, in _get_content
return content()
File "/usr/lib/ambari-agent/lib/resource_management/core/source.py", line 52, in __call__
return self.get_content()
File "/usr/lib/ambari-agent/lib/resource_management/core/source.py", line 197, in get_content
raise Fail("Failed to download file from {0} due to HTTP error: {1}".format(self.url, str(ex)))
resource_management.core.exceptions.Fail: Failed to download file from http://ip-172-31-44-126.us-west-2.compute.internal:8080/resources/mysql-connector-java.jar due to HTTP error: HTTP Error 404: Not Found
Created 05-26-2018 09:39 PM
When you install HDP and you don't intend to use the derby database as in most cases with MySQL you download mysql-connector-java.jar thats one of the preparatory steps on the node where you will be running Hive etc
# yum install -y mysql-connector-java
The location is /usr/share/java/mysql-connector-java.jar and when running the Ambari setup the jdbc location must be appended
# ambari-server setup --jdbc-db=mysql --jdbc-driver=/usr/share/java/mysql-connector-java.jar
Once you have done the above then Hive, Oozie,Ranger etc will function correctly
Please have a look at this HCC How to Sync MySQL Connector jar across HDP components and validate that you didn't miss a step.
If you found this answer addressed your question, please take a moment to log in and click the "Accept" link on the answer.
Created 05-26-2018 09:39 PM
When you install HDP and you don't intend to use the derby database as in most cases with MySQL you download mysql-connector-java.jar thats one of the preparatory steps on the node where you will be running Hive etc
# yum install -y mysql-connector-java
The location is /usr/share/java/mysql-connector-java.jar and when running the Ambari setup the jdbc location must be appended
# ambari-server setup --jdbc-db=mysql --jdbc-driver=/usr/share/java/mysql-connector-java.jar
Once you have done the above then Hive, Oozie,Ranger etc will function correctly
Please have a look at this HCC How to Sync MySQL Connector jar across HDP components and validate that you didn't miss a step.
If you found this answer addressed your question, please take a moment to log in and click the "Accept" link on the answer.
Created 05-28-2018 06:01 PM
when I try this command the setup doesn't complete
sudo ambari-server setup --jdbc-db=mysql --jdbc-driver=/home/ubuntu/mysql-connector-java.jar
Using python /usr/bin/python Setup ambari-server Copying /home/ubuntu/mysql-connector-java.jar to /var/lib/ambari-server/resources If you are updating existing jdbc driver jar for mysql with mysql-connector-java.jar. Please remove the old driver jar, from all hosts. Restarting services that need the driver, will automatically copy the new jar to the hosts. JDBC driver was successfully initialized. Ambari Server 'setup' completed successfully
It says setup is successful. but it doesn't do any setup. just comes out. when I do `ambari-server setup` then it runs the setup but after the configuration of the cluster many services don't start because they cannot find the mysql-connector-java.jar
Created 05-28-2018 08:30 PM
That's exactly the desired output "Ambari Server 'setup' completed successfully". Now if you start your hive 2server you shouldn't get the previous error.
Please let me know after attempting the H2S startup.