Member since
03-14-2016
4721
Posts
1111
Kudos Received
874
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
2441 | 04-27-2020 03:48 AM | |
4873 | 04-26-2020 06:18 PM | |
3975 | 04-26-2020 06:05 PM | |
3212 | 04-13-2020 08:53 PM | |
4919 | 03-31-2020 02:10 AM |
09-10-2019
06:25 PM
@moritz I see in your "ambari.properties" there are no JDBC settings appeared because looks like you are mixing the custom driver setup arguments along with the JDBC DB setup arguments in a single setup commands. Thats the reason the JDBC settings are not getting persisted. Please try the following sequence of setup. Step-1). Setup the JDBC DB settings. After this step you should see that your ambari.properties file has the JDBC entries in it. # ambari-server setup --java-home /usr/lib/jvm/java-1.8.0-openjdk/jre --enable-lzo-under-gpl-license --database=postgres --databasehost=localhost --databaseport=5432 --databasename=ambari --databaseusername=ambari --postgresschema=ambari --databasepassword=ambari -s Step-2). Now Setup the Custom Postgres JDBC Driver of your own choice using the following command. However, usually ambari ships a Postgres Driver here "/usr/lib/ambari-server/postgresql-*" # ambari-server setup --jdbc-db=postgres --jdbc-driver=/usr/share/java/postgresql-jdbc.jar Step-3). Now run the following command to verify the JDBC settings are reflected properly or not? Example: # grep 'jdbc' /etc/ambari-server/conf/ambari.properties
custom.postgres.jdbc.name=postgresql-jdbc.jar
server.jdbc.connection-pool=internal
server.jdbc.database=postgres
server.jdbc.database_name=ambari
server.jdbc.driver=org.postgresql.Driver
server.jdbc.hostname=localhost
server.jdbc.port=5432
server.jdbc.postgres.schema=ambari
server.jdbc.rca.driver=org.postgresql.Driver
server.jdbc.rca.url=jdbc:postgresql://localhost:5432/ambari
server.jdbc.rca.user.name=ambari
server.jdbc.rca.user.passwd=/etc/ambari-server/conf/password.dat
server.jdbc.url=jdbc:postgresql://localhost:5432/ambari
server.jdbc.user.name=ambari
server.jdbc.user.passwd=/etc/ambari-server/conf/password.dat .
... View more
09-09-2019
07:43 PM
2 Kudos
@moritz By running the following command , you are telling Ambari to use an Existing Postgres DB instance in this case ambari will expect you to create the Db user and setup the DB schema on your own inside the PostgresDB (ambari will not do it for you). # sudo ambari-server setup --java-home /usr/lib/jvm/java-1.8.0-openjdk/jre --enable-lzo-under-gpl-license --database=postgres --databasehost=localhost --databaseport=5432 --databasename=ambari --postgresschema=ambari --databaseusername=ambari --databasepassword=ambari --jdbc-db=postgres --jdbc-driver=/usr/share/java/postgresql-jdbc.jar Using existing Postgres DB instance for Ambari DB means we will need to make sure that After running the above "setup" command and before running the "start" command you already have performed the following task on your Postgres Database explicitly. https://docs.cloudera.com/HDPDocuments/Ambari-2.7.3.0/administering-ambari/content/amb_using_ambari_with_postgresql.html Are you sure that before starting Ambari DB you had performed the instructions mentioned in the above link? If you want Ambari to setup the PostgresDB (create DB user/ create various tables ..etc) for you then you may want to run the setup command without specifying the Postgres DB details so that ambari will think that it has to setup the Postgres DB for you in the Localhost with default settings like. default ambari DB username will be "ambari" default Postgres Db password will. be "bigdata" ...etc # sudo ambari-server setup --java-home /usr/lib/jvm/java-1.8.0-openjdk/jre --enable-lzo-under-gpl-license -s .
... View more
09-05-2019
03:18 AM
@ranger Even if you have build ranger from source... before making the API call you should validate the following: Are you really sure that the credentials that you are entering is correct? 1. Are you able to login to Ranger UI with that credential? (this is the verify if your credentials are correct or not) ? 2. Do you see "Bad Credentials" message inside the "xa_portal.log" ? Can you share the log?
... View more
09-05-2019
02:49 AM
@Manoj690 You might want to look at this thread: https://community.cloudera.com/t5/Support-Questions/Configuring-hive-users-in-admin-role/m-p/236802
... View more
09-05-2019
02:31 AM
@ranger As we see "Authentication Failed" hence most possible cause may be the incorrect ranger admin credentials supplied to the curl command. 1. Are you sure that you are able to Login to Ranger UI using Web Browser with the same credentials Username: "rangeradmin" Password: "rangeradmin"? http://$RANGER_HOSTNAME:6080 If not then please check what is the Username& Password you have entered here Ambari UI --> Ranger --> Configs --> Advanced --> "Advanced ranger-env" --> "Ranger Admin username" AND "Ranger Admin user's password" 2. Please tail the "xa_portal.log" log and see if you are getting any of the following message when you are attempting to login to Ranger UI using the same credentials? Or while making the API call? # tail -f /var/log/ranger/admin/xa_portal.log
# grep 'Login Unsuccessful' /var/log/ranger/admin/xa_portal.log
# grep 'Authentication with' /var/log/ranger/admin/xa_portal.log
# grep 'Bad Credentials' /var/log/ranger/admin/xa_portal.log .
... View more
09-04-2019
11:42 PM
@Manoj690 The terminal where you are trying to run the query . can you switch to "hive" user? # su - hive
... View more
09-04-2019
11:38 PM
2 Kudos
@Manoj690 We see the error as ERROR : FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask. MetaException(message:Got exception: org.apache.hadoop.security.AccessControlException Permission denied: user=root, access=EXECUTE, inode="/warehouse/tablespace/managed/hive":hive:hadoop:drwx------ Here we see that 'user=root' which means you might be running the query as "root" user. Who does not have permission to write in the mentioned HDFS directory "/warehouse/tablespace/managed/hive" . So better to run the same query as "hive" user and then check the results.
... View more
09-04-2019
05:30 PM
@tyadav Every service provides a "metainfo.xml" file which is used by ambari to determine the <dependencies> between individual service/components. For example in case of HIVE service you can see a "metainfo.xml" file in the following location. /var/lib/ambari-server/resources/common-services/HIVE/0.12.0.2.0/metainfo.xml
/var/lib/ambari-server/resources/stacks/HDP/3.0/services/HIVE/metainfo.xml You can find the <dependencies> tab inside this file which talks about the component dependencies. For example you can see the "HIVE_SERVER" dependencies as following: <component>
<name>HIVE_SERVER</name>
<displayName>HiveServer2</displayName>
<category>MASTER</category>
<cardinality>1</cardinality>
<versionAdvertised>true</versionAdvertised>
<reassignAllowed>true</reassignAllowed>
<clientsToUpdateConfigs></clientsToUpdateConfigs>
<dependencies>
<dependency>
<name>ZOOKEEPER/ZOOKEEPER_SERVER</name>
<scope>cluster</scope>
<auto-deploy>
<enabled>true</enabled>
<co-locate>HIVE/HIVE_SERVER</co-locate>
</auto-deploy>
</dependency>
<dependency>
<name>YARN/YARN_CLIENT</name>
<scope>host</scope>
<auto-deploy>
<enabled>true</enabled>
</auto-deploy>
</dependency>
<dependency>
<name>MAPREDUCE2/MAPREDUCE2_CLIENT</name>
<scope>host</scope>
<auto-deploy>
<enabled>true</enabled>
</auto-deploy>
</dependency>
</dependencies> . Similarly you can also find the dependencies using the following kind of Ambari API call: # curl -sk -u admin:admin -H "X-Requested-By: ambari" -X GET http://$AMBARI_HOST:8080/api/v1/stacks/HDP/versions/3.1/services/HIVE | grep -A5 'required_services'
"required_services" : [
"ZOOKEEPER",
"HDFS",
"YARN",
"TEZ"
], . . If your question is answered then, Please make sure to mark the answer as the accepted solution. If you find a reply useful, say thanks by clicking on the thumbs up button.
... View more
09-04-2019
02:47 AM
@tyadav Some of the hive tables that are created in HDFS might not be accessible if the HDFS is down. Hive Service has a dependency to HDFS/YARN/MapReduce. So are you able to start the HDFS/YARN/MapReduce service first? Also If HiveMetastore service is not coming up then can you please share the HiveMetastore log , including the Operational Log from Ambari UI where we can see the failure cause ?
... View more
09-04-2019
01:27 AM
@sonalidive786 Good to know that it has resolved your issue. If your question is answered then, Please make sure to mark the answer as the accepted solution. If you find a reply useful, say thanks by clicking on the thumbs up button.
... View more