Member since
09-25-2015
51
Posts
32
Kudos Received
4
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
2018 | 04-06-2017 07:10 PM | |
6366 | 08-24-2016 06:55 PM | |
5037 | 12-16-2015 03:44 PM | |
5871 | 12-08-2015 12:54 PM |
10-22-2025
01:12 PM
Summary If you are using Java Garbage collection arguments in your settings, when you move to Java 11 or 17 from Java 8 or prior, the settings have changed. Applies to Anyone who has moved to Java 11 or 17 and requires GC logging. Instructions In the old GC (Java 8 and prior) logging settings, you would use something similar to: -Xloggc:/var/log/cloudera-scm-server/gc.log
-XX:+PrintGCDetails
-XX:+PrintGCTimeStamps
-XX:+PrintGCDateStamps In Java 11 and 17 this will actually cause an error as these are no longer used. To get similar output we recommend: -Xlog:gc*,time:file=/var/log/cloudera-scm-server/gc-%t.log where gc* will log anything related to GC up to INFO level time will give the equivilant data that used to be PrintGCTimeStamps and PrintGCDateStamps file will allow you to set an output file and it's location %t gives you a date stamp in the file name on creation (ex. gc-2025-05-23_11-56-54.log)
... View more
07-23-2024
06:44 AM
Cloudera Manager also has a great way to set class level debug on the fly without restart when needed to troubleshoot. The way to do this is to navigate to: http://<cm-server>:7180/cmf/debug/logLevel Once at this page, chose the class you wish to change, choose the radio button for the level that you wish to change it to, and hit the submit button. Understand that these changes will NOT persist a restart of the server but will start logging at the new level as soon as you hit the submit button on the logLevel page.
... View more
07-23-2024
06:33 AM
The JDK 8 HotSpot JVM is now using native memory for the representation of class metadata and is called Metaspace. The permanent generation has been removed. The PermSize and MaxPermSize are ignored and a warning is issued if they are present on the command line.
... View more
05-05-2017
01:15 PM
All, This is actually a BUG, as ambari removes the falcon service but not the hooks in Oozie configs. The proper way to fix this and not have it hit you each time you upgrade is to remove the below listed values from your oozie configs. I have also opened an internal (to Hortonworks) JIRA to have this fixed in future versions of Ambari. oozie.service.ProxyUserService.proxyuser.falcon.hosts
oozie.service.ProxyUserService.proxyuser.falcon.groups
oozie.service.URIHandlerService.uri.handlers
oozie.services.ext
oozie.service.ELService.ext.functions.coord-job-submit-instances
oozie.service.ELService.ext.functions.coord-action-create-inst
oozie.service.ELService.ext.functions.coord-action-create
oozie.service.ELService.ext.functions.coord-job-submit-data
oozie.service.ELService.ext.functions.coord-action-start
oozie.service.ELService.ext.functions.coord-sla-submit
oozie.service.ELService.ext.functions.coord-sla-create
... View more
04-06-2017
07:10 PM
1 Kudo
While we do not provide a best practice to this I suggest the following:
1. Bring down the entire cluster cleanly and perform the RAM upgrade. 2. Use this to determine what all your new config settings should be:
http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.6.0/bk_command-line-installation/content/determine-hdp-memory-config.html (or use the correct one for your HDP release, this is from 2.6.0) 3. Once you change your memory settings, restart the cluster.
... View more
03-21-2017
03:58 PM
2 Kudos
In the past, if Select returned no rows, hadoop would still create an empty file. Some customer would use this file to help with their work flow. In https://issues.apache.org/jira/browse/HIVE-13040 this was fixed, because anyone using cloud based solutions could be charged for empty files, so it was determined that hadoop should not write the files.
... View more
Labels:
01-12-2017
07:39 PM
3 Kudos
I can confirm for you that the deletes look correct. I normally do not do the alters, but I don't see them causing an issue. Remember to STOP ambari-server before editing. Take a good backup of the db. Then when done, start ambari-server.
... View more
08-24-2016
07:42 PM
@Arun A K I just use the Web Gui that comes with IPA ldap. Keep in mind I am not managing a large user base, but rather just doing small recreations to help customers. I would think the GUI would get cumbersome if you were doing an entire enterprise.
... View more
08-24-2016
07:15 PM
@Arun A K, first let's fix your admin. Simply go into the database and do: update users set ldap_user = 0 where user_name = 'admin'; then reset the password as follows: https://community.hortonworks.com/questions/449/how-to-reset-ambari-admin-password.html Here is the output of an ldapsearch on a user in my IPA, to show you where dn is: # orlando, users, accounts, ipa.example.com
dn: uid=orlando,cn=users,cn=accounts,dc=ipa,dc=example,dc=com
displayName: Orlando Teixeira
cn: Orlando Teixeira
objectClass: top
objectClass: person
objectClass: organizationalperson
objectClass: inetorgperson
objectClass: inetuser
objectClass: posixaccount
objectClass: krbprincipalaux
objectClass: krbticketpolicyaux
objectClass: ipaobject
objectClass: ipasshuser
objectClass: ipaSshGroupOfPubKeys
objectClass: mepOriginEntry
loginShell: /bin/sh
sn: Teixeira
gecos: Orlando Teixeira
homeDirectory: /home/orlando
krbPwdPolicyReference: cn=global_policy,cn=IPA.EXAMPLE.COM,cn=kerberos,dc=ipa,
dc=example,dc=com
mail: orlando@ipa.example.com
krbPrincipalName: orlando@IPA.EXAMPLE.COM
givenName: Orlando
uid: orlando
initials: OT
ipaUniqueID: 3b9308de-895c-11e5-a188-0800274e577d
uidNumber: 1690200001
gidNumber: 1690200001
memberOf: cn=ipausers,cn=groups,cn=accounts,dc=ipa,dc=example,dc=com
memberOf: cn=test,cn=groups,cn=accounts,dc=ipa,dc=example,dc=com
memberOf: cn=test2,cn=groups,cn=accounts,dc=ipa,dc=example,dc=com
mepManagedEntry: cn=orlando,cn=groups,cn=accounts,dc=ipa,dc=example,dc=com
krbLoginFailedCount: 6
krbLastFailedAuth: 20160601185034Z
# orlando, groups, accounts, ipa.example.com
dn: cn=orlando,cn=groups,cn=accounts,dc=ipa,dc=example,dc=com
objectClass: posixgroup
objectClass: ipaobject
objectClass: mepManagedEntry
objectClass: top
cn: orlando
gidNumber: 1690200001
description: User private group for orlando
mepManagedBy: uid=orlando,cn=users,cn=accounts,dc=ipa,dc=example,dc=com
ipaUniqueID: 3b9b8388-895c-11e5-a188-0800274e577d
... View more
08-24-2016
06:55 PM
2 Kudos
Here are the default IPA Values (If you used a out of the box no changes IPA) that work for me: authentication.ldap.dnAttribute=dn authentication.ldap.groupMembershipAttr= memberUid authentication.ldap.groupObjectClass=posixGroup authentication.ldap.userObjectClass=mepManagedEntry authentication.ldap.usernameAttribute=cn
... View more