Member since
07-30-2019
453
Posts
112
Kudos Received
80
Solutions
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 2398 | 04-12-2023 08:58 PM | |
| 4975 | 04-04-2023 11:48 PM | |
| 1592 | 04-02-2023 10:24 PM | |
| 3487 | 07-05-2019 08:38 AM | |
| 3402 | 05-13-2019 06:21 AM |
12-19-2018
06:43 PM
1 Kudo
Hi @choppadandi vamshi krishna, I am not sure why is logs not populating in /var/log/superset folder for you. i see in my cluster. its located in the same location [root@asn1 superset]# pwd
/var/log/superset
[root@asn1 superset]# ls -l
total 4 -rw-r--r--. 1 superset hadoop 511 Dec 19 18:33 superset.log Also, you must check this in the host where superset is installed not ambari server. additionally you can check your log location with the following command : [root@asn1 superset]# ps -ef|grep superset
superset 13493 1 0 18:33 ? 00:00:00 /usr/hdp/3.1.0.0-78/superset/bin/python3.4 /usr/hdp/current/superset/bin/gunicorn -D --workers 4 -p /var/run/superset/superset.pid --log-file /var/log/superset/superset.log -t 60 -b 0.0.0.0:9088 --limit-request-line 0 --limit-request-field_size 0 superset:app
superset 13496 13493 6 18:33 ? 00:00:02 /usr/hdp/3.1.0.0-78/superset/bin/python3.4 /usr/hdp/current/superset/bin/gunicorn -D --workers 4 -p /var/run/superset/superset.pid --log-file /var/log/superset/superset.log -t 60 -b 0.0.0.0:9088 --limit-request-line 0 --limit-request-field_size 0 superset:app Please accept this answer if its helpful.
... View more
12-19-2018
06:08 PM
Consider my cluster is having SSO configured and my SSO certificate contains character larger than 2048 and i am upgrading to ambari-2.7.0 using the command : ambari-server upgrade
There is a high chance your upgrade will get stuck at schema upgrade phase and in the ambari-server log you will find the below exception :
Internal Exception: java.sql.BatchUpdateException: Batch entry 2 INSERT INTO ambari_configuration (property_name, category_name, property_value) VALUES ('ambari.sso.provider.certificate','sso-configuration',<LONG VERTIFICATE VALUE>') was aborted: ERROR: value too long for type character varying(2048) Call getNextException to see other errors in the batch.
Root Cause : While upgrade to ambari-2.7.x + versions ambari will move the sensitive data from ambari.properties to ambari database table : ambari_configuration . if any of this sensitive data contains more than 2048 characters it will fail. usually certificates issues wont be more than 2048 characters but some cases if its higher than 2048. you might hit the abouve error.
This issue is fixed in Ambari-2.8 as part of : https://issues.apache.org/jira/browse/AMBARI-24992
the work around here is :
Edit the ambari.properties file and remove the entry for authentication.jwt.publicKey Perform the Ambari upgrade Manually alter the database:
ALTER TABLE ambari_configuration ALTER COLUMN property_value TYPE VARCHAR(4000);
NOTE: This syntax is specific to Postgres
4. Manually insert the relevant PEM file's contents into the database
INSERT INTO ambari_configuration(category_name, property_name, property_value)
VALUES ('sso-configuration', 'ambari.sso.provider.certificate', '<CONTENT OF THE PEM FILE>');
5. Restart ambari database
... View more
Labels:
12-19-2018
05:52 PM
2 Kudos
Disclaimer:This article is based on my personal experience and knowledge.Don't take it as a standard guidelines, understand the concept and modify it for your environmental best practices and use case. Always contact Hortonworks support if its production cluster
Issue Description: Ambari Showing Wrong NIFI Version After Upgrading to HDF 3.3 , as per release notes , the NIFI version in HDF-3.3 is 1.8 but ambari shows it as 1.7 in Stacks and Versions page.
Root cause : This is a known bug in hdf-ambari-mpack-3.3.0.0-165 ( the mpack used by ambari to manage HDF-3.3 ) This issue is fixedin HDF-3.3.1 mpack.
Solution : we can ignore the version shown in the stacks and services as its just ambari shows its wrong. we can verify the NIFI version in nifi ui or from hdf-select command in Host where nifi is installed.
Workaround :
Navigate to : /var/lib/ambari-server/resources/mpacks/hdf-ambari-mpack-3.3.0.0-165/hdp-addon-services/HDF/3.3/NIFI/1.7.0
Edit the File : metainfo.xml
Change the line :
<version>1.7.0</version>
to
<version>1.8.0</version>
Restart ambari server.
... View more
Labels:
12-19-2018
03:02 PM
@Tim Verhoeven, It will be helpfull if you could kindly create a new thread for issue you are facing.
... View more
12-19-2018
02:54 PM
Hi
@Michael Mester,
This will usually happen if you are using a local repository to install the HDP and ambari cannot fetch the version information from :
http://public-repo-1.hortonworks.com/HDP/amazonlinux2/3.x/updates/3.1.0.0/HDP-3.1.0.0-78.xml
and instead it fetch's from stacks defined in /var/lib/ambari-server/resources
and this HDP-3.1 is minor version of HDP-3.x the stacks defined in abouve location will be having the HDP-3.0's versions information.
you can either
ignore displayed versions in stacks and versions page.
or
you can go to ambari database and edit the repo_version table using following commands
[root@asn1 ~]# psql -U ambari ambari
Password for user ambari:
psql (9.2.24)
Type "help" for help.
ambari=> select version_xml from repo_version;
version_xml
-----------------------------------------------------------------------------------------------------------------------------------
<?xml version="1.0" encoding="UTF-8" standalone="yes"?>
.....<SOME DATA>... '
ambari=> update repo_version set version_xml='<USE_SAME_DATA_ABOUVE_EDIT The versions of Services as per this url : http://public-repo-1.hortonworks.com/HDP/amazonlinux2/3.x/updates/3.1.0.0/HDP-3.1.0.0-78.xml>';
Please note: always take a
Database backup before any operation to ambari and stop ambari server.
Default password of database if postgresql is
bigdata
PS: Please accept this answer if you find it helpful
only perform Database operations if you have prior experience or as mentioned please ignore what ambari show's in stack and versions page.
... View more
12-19-2018
02:52 PM
@Qureshi F, Do you managed to resolve this issue. If yes please share the analysis, accept the best answer and close this thread 🙂
... View more
12-19-2018
02:38 PM
1 Kudo
Hi @Henry Luo , This will usually happen if you are using a local repository to install the HDP and ambari cannot fetch the version information from : http://public-repo-1.hortonworks.com/HDP/amazonlinux2/3.x/updates/3.1.0.0/HDP-3.1.0.0-78.xml and instead it fetch's from stacks defined in /var/lib/ambari-server/resources and this HDP-3.1 is minor version of HDP-3.x the stacks defined in abouve location will be having the HDP-3.0's versions information. you can either ignore displayed versions in stacks and versions page. or you can go to ambari database and edit the repo_version table using following commands
[root@asn1 ~]# psql -U ambari ambari
Password for user ambari:
psql (9.2.24)
Type "help" for help.
ambari=> select version_xml from repo_version;
version_xml
-----------------------------------------------------------------------------------------------------------------------------------
<?xml version="1.0" encoding="UTF-8" standalone="yes"?>
.....<SOME DATA>... '
ambari=> update repo_version set version_xml='<USE_SAME_DATA_ABOUVE_EDIT The versions of Services as per this url : http://public-repo-1.hortonworks.com/HDP/amazonlinux2/3.x/updates/3.1.0.0/HDP-3.1.0.0-78.xml>';
Please note : always take a Database backup before any operation to ambari and stop ambari server. Default password of database if postgresql is bigdata PS: Please accept this answer if you find it helpful and only perform Database operations if you have prior experience or as mentioned please ignore what ambari show's in stack and versions page.
... View more
12-18-2018
04:48 PM
Hi @lam rab, Unfortunately ambari doesnt allow you add observers in the zoo.cfg. You can refer to : https://issues.apache.org/jira/browse/AMBARI-24748 here user is facing the same issue that you are facing. See if you can manually start zookeeper after changing the zoo.cfg which might help you. Please accept this answer if this helped you.
... View more
12-18-2018
04:14 PM
Hi @lam rab ,
If ambari is not managing zoo.cfg you cannot change it via configs.py also as configs.py do the same thing ambari does in web UI .why dont you mannually ssh to zeppelin host and
[root@asnaik4 conf]# cd /usr/hdp/current/zookeeper-server/conf
[root@asnaik4 conf]#vi zoo.cfg
If ambari is not managing a config file , the script also cannot help
Please accept this answer if it helps you.
... View more
12-17-2018
03:39 PM
Hi @Michael Bronson, Can you update the exact log exception in the operation log which blocked the start of Kafka service via ambari? If the value cannot be set via UI , please see setting via command line helps /var/lib/ambari-server/resources/scripts/configs.py -l <AMBARI_HOSTNAME> -t 8080 -u <USER_NAME> -p <PASSWORD> -a <GET/SET/DELETE> -n <CLUSTER_NAME> -c <CONFIG_TYPE> -k <KEY> -v <VALUE>
... View more