About jsensharma

avikaggarwal199 · ‎03-19-2020

@jsensharma Thank you for your answer. I am facing similar issue with Ambari 2.7.0, Mysql 5.7.29. I am unable to get into admin account even once and on click of Login it just hangs and says ' Unable to connect to Ambari Server. Confirm Ambari Server is running and you can reach Ambari Server from this machine.' after some seconds.' I even posted details here: https://stackoverflow.com/q/60743259/7051479 Could you please help me out on this.

jsensharma · ‎03-12-2020

@Aman075 Instead of doing "#cd forPig" and then checking the listing can you try specifying the fully qualified path of the dir like: (because there may be multiple "forPig" directories (like one may be in relative path and other on absolute path) # pwd # ls -lart /forPig If you still face any issue then please try the DEBUG logging to see if there is anything wrong? # export HADOOP_ROOT_LOGGER=DEBUG,console # hdfs dfs -get -f /testing/pigData/drivers.csv /forPig/ .

jsensharma · ‎03-11-2020

@prakashpunj By default it uses sqllite as Database (no password). However, you can try checking the following files for more details on the Superset host. # grep 'SUPERSET_DATABASE_PASSWORD' /etc/superset/conf/superset_config.py # grep 'SUPERSET_DATABASE_PASSWORD' /var/lib/ambari-agent/data/command-* . Via ambari Ui you can check Ambari UI --> Superset --> Configs --> 'SUPERSET META DATA STORAGE CONFIG' (tab) Search for "Superset Database password" section in the above page and verify if it is empty or password is set. .

san_t_o · ‎03-11-2020

@venkatsambath I think and the same, we have analized its parents directories and a pparently they are fine. # ls -ln /var/lib/ambari-agent/tmp/hadoop_java_io_tmpdir/libleveldbjni-64-1-6110205147654050510.8 ls: cannot access /var/lib/ambari-agent/tmp/hadoop_java_io_tmpdir/libleveldbjni-64-1-6110205147654050510.8: No such file or directory # id yarn uid=1075(yarn) gid=1051(hadoop) groups=1051(hadoop) I have managed to start the node from the command line, but I have detected that the command that is executed from Ambari, sets the permissions of the path "hadoop_java_io_tmpdir" as owner to the user "hdfs:hadoop", however I do not identify why the user yarn does not have permissions writing and execution, the permissions are 1777 and the yarn user is member of hadoop group. Regards

Gaurang1 · ‎03-11-2020

Okay..make sense. I have raise another question https://community.cloudera.com/t5/Support-Questions/Error-while-quot-Specify-hosts-for-your-CDH-cluster/td-p/291536

jsensharma · ‎03-09-2020

@Ham Starting with the Ambari 2.7.5 release, access to Ambari repositories requires authentication. To access the binaries, you must first have the required authentication credentials ( username and password ). Authentication credentials for new customers and partners are provided in an email sent from Cloudera to registered support contacts. Existing users can file a non-technical case within the support portal (https://my.cloudera.com) to obtain credentials. Reference: https://docs.cloudera.com/HDPDocuments/Ambari-2.7.5.0/bk_ambari-installation/content/access_ambari_paywall.html https://www.cloudera.com/contact-sales.html

jsensharma · ‎03-02-2020

@stryjz Most the API calls will remain same/similar in Ambari 2.7 and previous releases. Ambari 2.7 has a cool new feature where it is integrated with Swagger and you can try and explore all the REST APIs. Steps to use Swagger Login to Ambari Hit this url ( http://{ambari-host}:8080/api-docs) For more information on this please refer to : https://community.cloudera.com/t5/Community-Articles/How-To-Use-Swagger-with-Ambari-Explore-Ambari-REST/ta-p/248692 If your question is answered then, Please make sure to mark the answer as the accepted solution. If you find a reply useful, say thanks by clicking on the thumbs up button.

tjangid · ‎03-02-2020

@Daria In addition to @jsensharma update, you can also refer to below documentation for a cluster hardware requirement and for Cloudera Reference Architecture https://docs.cloudera.com/documentation/enterprise/6/release-notes/topics/rg_hardware_requirements.html#concept_vvv_cxt_gbb https://docs.cloudera.com/documentation/other/reference-architecture.html

sharathkumar13 · ‎03-01-2020

Thank You. This helped a lot. I wrote the scripts for the basic functionalities.

jsensharma · ‎03-01-2020

@alepiedra Are you really connecting to the MySQL db provided as part of Sandbox ? Or is it some other mysql? Can you try specifying the Hostname as well in the mysql command to see how it goes? Something like this # mysql -u root -h sandbox.hortonworks.com .

erkansirin78 · ‎02-28-2020

In CDH 6.X I can't find Advanced spark2-metrics-properties in Spark config. Should I create manually?

shyamshaw · ‎02-28-2020

@jsensharma Thank you for your response. please check if you have enabled the LLAP interactive query in order to get the statistics for the partition table : I have configured HiveServer2 Interactive but how can I verify whether it is being enabled to get the statistics for the partition table. "Interactive Mode" was set to "false" and I changed it to "true" and did hard refresh of the browser but still the same issue.

jsensharma · ‎02-27-2020

@Sud To reset of forgotten password to 'admin' https://community.cloudera.com/t5/Community-Articles/Ambari-2-7-0-How-to-Reset-Ambari-Admin-Password-from/ta-p/248891 Once you remember the old admin credential (or have already reset to 'admin'). https://docs.cloudera.com/HDPDocuments/Ambari-2.7.5.0/administering-ambari/content/amb_change_the_admin_password.html If your question is answered then, Please make sure to mark the answer as the accepted solution. If you find a reply useful, say thanks by clicking on the thumbs up button.

jsensharma · ‎02-27-2020

@mike_bronson7 In addition to my previous comment: Ambari provides option to "Rolling Restart Kafka Brokers" (one by one). In the ambari UI when you click on Ambari UI --> Kafka --> Service Actions (drop down) --> "Restart Kafka Brokers" Then it basically shows the Rolling restart Settings like. You can decide how much time in your env one Kafka Broker full restart taks and then after how much time do you want other Kafka broker restart will be scheduled by Ambari. It can also be achieved using the API call as following: # curl -iskH "X-Requested-By: ambari" -u admin:admin -X POST -d '[{"RequestSchedule":{"batch":[{"requests":[{"order_id":1,"type":"POST","uri":"/clusters/NewCluster/requests","RequestBodyInfo":{"RequestInfo":{"context":"_PARSE_.ROLLING-RESTART.KAFKA_BROKER.1.3","command":"RESTART"},"Requests/resource_filters":[{"service_name":"KAFKA","component_name":"KAFKA_BROKER","hosts":"testnode2.example.com"}]}},{"order_id":2,"type":"POST","uri":"/clusters/NewCluster/requests","RequestBodyInfo":{"RequestInfo":{"context":"_PARSE_.ROLLING-RESTART.KAFKA_BROKER.2.3","command":"RESTART"},"Requests/resource_filters":[{"service_name":"KAFKA","component_name":"KAFKA_BROKER","hosts":"testnode3.example.com"}]}},{"order_id":3,"type":"POST","uri":"/clusters/NewCluster/requests","RequestBodyInfo":{"RequestInfo":{"context":"_PARSE_.ROLLING-RESTART.KAFKA_BROKER.3.3","command":"RESTART"},"Requests/resource_filters":[{"service_name":"KAFKA","component_name":"KAFKA_BROKER","hosts":"testnode5.example.com"}]}}]},{"batch_settings":{"batch_separation_in_seconds":"121","task_failure_tolerance":1}}]}}]' ttp://testnode1.example.com:8080/api/v1/clusters/NewCluster/request_schedules .

jsensharma · ‎02-27-2020

@mike_bronson7 Error says : hostname=kafka01. Host not found So please check if the Hostname is correct (i means fully qualified hostnmae) Please compare it with the hostname listed in the following API call response. Just try to open this URL in the browser to see which hostname ambari is expecting: http://ambari_server_hostname:8080/api/v1/clusters/$CLUSTER_NAME/hosts/ .

jsensharma · ‎02-27-2020

@cc1 There can be various reasons ...starting from - Low disk space, Low memory , - No jvm present , - Insufficient resources available on the namenode host, - Corrupted fsimage, - namenode port already in use - Corrupted Edits log file - Insufficient permissions to the NN startup user, - Incorrect configurations ... ...etc such various kind of reasons. .... Hence it will be good to first check the NameNode logs to find out what kind of error is it showing and then accordingly it can be troubleshooted.

jsensharma · ‎02-27-2020

@Sud You can try resetting the ambari 'admin' user's password to default 'admin' by running the following queries in the Ambari DB. Then you should be able to login to Ambari UI as user: "admin" and password: "admin". Then you can change the password to your desired one. 1). Stop Ambari Server # ambari-server stop 2). Take a Backup of Ambari DB (just for a safe copy) 3). Login to your Database like using psql/mysql/sqlplus utility and connect to Ambari DB then run any of the below quwery based on your Ambari Version. If you are using Ambari 2.6 Or previous Ambari versions then you can run the following SQL Query in your Ambari DB UPDATE users SET user_password='538916f8943ec225d97a9a86a2c6ec0818c1cd400e09e03b660fdaaec4af29ddbb6f2b1033b81b00' WHERE user_name='admin' For Ambari 2.7.x you can run the following query in Ambari DB UPDATE user_authentication SET authentication_key='538916f8943ec225d97a9a86a2c6ec0818c1cd400e09e03b660fdaaec4af29ddbb6f2b1033b81b00' WHERE user_id IN (SELECT user_id FROM users WHERE user_name='admin'); 4). Restart Ambari Server and then login to ambari UI with admin/admin credential. # ambari-server start . Using above approach you can change any users password to 'admin' and then later from ambari UI the password can be changed.

mike_bronson7 · ‎02-25-2020

another thing ls -ltr /var/lib/ambari-metrics-collector/hbase-tmp/ total 0 is empty ( since we remove the data from this folder for cleaning )

mike_bronson7 · ‎02-24-2020

Dear Jay what to say - you are the best , well done

jsensharma · ‎02-24-2020

@Prabhu_Muppala As we see that the netstat command shows no oracle port 1521 opened. (no output means Oracle is not running on default listerer port 1521. [cloudera@quickstart ~]$ sudo netstat -tnlpa | grep 1521 . Also the following error indicates that your Oracle Database is not successfully running on "localhost:1521" Caused by: oracle.net.ns.NetException: The Network Adapter could not establish the connection at oracle.net.nt.ConnStrategy.execute(ConnStrategy.java:470) So please verify why the oracle DB is not running and configured to use 1521 listener port? Please try to restart Oracle and then recheck if the port 1521 is opened? Or if you have configured to run Oracle on some other port? # netstat -tnlpa | grep $ORACLE_PROCESS_ID .

pauljoshiva · ‎02-23-2020

Hello @jsensharma, Thank you for your reply, I was able to successfully restart Yarn DNS Registry but the upgrade still shows the same error - unhealthy host. I checked the host component state in Ambari database and found that the Yarn registry is in Failed state. YARN_REGISTRY_DNS | UNKNOWN | STARTED | 15 | YARN | FAILED

mike_bronson7 · ‎02-21-2020

Dear Jay regarding this ambari cluster , I noticed that some of the metrics are shown and some of them are not as the following example from the logs we can see [root@master ambari-metrics-collector]# tail -10 hbase-ams-regionserver-master.sys77.com.log 2020-02-21 08:15:13,237 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: http://master.sys77.com:6188/ws/v1/timeline/metrics 2020-02-21 08:15:13,237 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: http://master.sys77.com:6188/ws/v1/timeline/containermetrics 2020-02-21 08:15:13,240 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2020-02-21 08:15:13,243 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled snapshot period at 10 second(s). 2020-02-21 08:15:13,243 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2020-02-21 08:15:48,203 INFO [MemStoreFlusher.1] regionserver.MemStoreFlusher: Flush of region METRIC_RECORD,kafka.server.BrokerTopicMetrics.BytesOutPerSec.15MinuteRate\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00,1582267405534.b665584cec3e6aa7a266b7fc94ef2e91. due to global heap pressure. Total Memstore size=227.6 M, Region memstore size=68.4 M 2020-02-21 08:15:48,205 INFO [MemStoreFlusher.1] regionserver.HRegion: Started memstore flush for METRIC_RECORD,kafka.server.BrokerTopicMetrics.BytesOutPerSec.15MinuteRate\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00,1582267405534.b665584cec3e6aa7a266b7fc94ef2e91., current region memstore size 68.37 MB, and 1/1 column families' memstores are being flushed. 2020-02-21 08:15:48,605 INFO [MemStoreFlusher.1] regionserver.DefaultStoreFlusher: Flushed, sequenceid=3159, memsize=68.4 M, hasBloomFilter=false, into tmp file hdfs://hdfsha/user/ams/hbase/data/default/METRIC_RECORD/b665584cec3e6aa7a266b7fc94ef2e91/.tmp/97bc3e982c0846e2864c2750526cca4f 2020-02-21 08:15:48,648 INFO [MemStoreFlusher.1] regionserver.HStore: Added hdfs://hdfsha/user/ams/hbase/data/default/METRIC_RECORD/b665584cec3e6aa7a266b7fc94ef2e91/0/97bc3e982c0846e2864c2750526cca4f, entries=267808, sequenceid=3159, filesize=3.9 M 2020-02-21 08:15:48,652 INFO [MemStoreFlusher.1] regionserver.HRegion: Finished memstore flush of ~68.37 MB/71693616, currentsize=0 B/0 for region METRIC_RECORD,kafka.server.BrokerTopicMetrics.BytesOutPerSec.15MinuteRate\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00,1582267405534.b665584cec3e6aa7a266b7fc94ef2e91. in 447ms, sequenceid=3159, compaction requested=false [root@master ambari-metrics-collector]# [root@master ambari-metrics-collector]# [root@master ambari-metrics-collector]# [root@master ambari-metrics-collector]# tail -10 ambari-metrics-collector.log 2020-02-21 08:16:20,918 INFO TimelineClusterAggregatorMinute: End aggregation cycle @ Fri Feb 21 08:16:20 UTC 2020 2020-02-21 08:16:21,227 INFO TimelineClusterAggregatorSecond: Saving 8394 metric aggregates. 2020-02-21 08:16:21,372 INFO TimelineMetricHostAggregatorMinute: 5448 row(s) updated in aggregation. 2020-02-21 08:16:21,419 INFO TimelineMetricHostAggregatorMinute: End Downsampling cycle. 2020-02-21 08:16:21,440 INFO TimelineMetricHostAggregatorMinute: End Downsampling cycle. 2020-02-21 08:16:21,457 INFO TimelineMetricHostAggregatorMinute: End Downsampling cycle. 2020-02-21 08:16:21,479 INFO TimelineMetricHostAggregatorMinute: End Downsampling cycle. 2020-02-21 08:16:21,479 INFO TimelineMetricHostAggregatorMinute: Aggregated host metrics for METRIC_RECORD_MINUTE, with startTime = Fri Feb 21 08:10:00 UTC 2020, endTime = Fri Feb 21 08:15:00 UTC 2020 2020-02-21 08:16:21,479 INFO TimelineMetricHostAggregatorMinute: End aggregation cycle @ Fri Feb 21 08:16:21 UTC 2020 2020-02-21 08:16:21,752 INFO TimelineClusterAggregatorSecond: End aggregation cycle @ Fri Feb 21 08:16:21 UTC 2020 [root@master ambari-metrics-collector]# [root@master ambari-metrics-collector]# [root@master ambari-metrics-collector]# [root@master ambari-metrics-collector]# tail -10 hbase-ams-master-master.sys77.com.log 2020-02-21 07:45:19,565 INFO [RpcServer.FifoWFPBQ.default.handler=29,queue=2,port=61300] master.HMaster: Client=ams/null List Table Descriptor for the METRIC_AGGREGATE_DAILY table succeeds 2020-02-21 07:46:09,290 INFO [timeline] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard master.sys77.com based on hostname: master.sys77.com 2020-02-21 07:49:59,377 INFO [LruBlockCacheStatsExecutor] hfile.LruBlockCache: totalSize=159.41 KB, freeSize=150.39 MB, max=150.54 MB, blockCount=0, accesses=0, hits=0, hitRatio=0, cachingAccesses=0, cachingHits=0, cachingHitsRatio=0,evictions=29, evicted=0, evictedPerRun=0.0 2020-02-21 07:54:59,376 INFO [LruBlockCacheStatsExecutor] hfile.LruBlockCache: totalSize=159.41 KB, freeSize=150.39 MB, max=150.54 MB, blockCount=0, accesses=0, hits=0, hitRatio=0, cachingAccesses=0, cachingHits=0, cachingHitsRatio=0,evictions=59, evicted=0, evictedPerRun=0.0 2020-02-21 07:59:59,376 INFO [LruBlockCacheStatsExecutor] hfile.LruBlockCache: totalSize=159.41 KB, freeSize=150.39 MB, max=150.54 MB, blockCount=0, accesses=0, hits=0, hitRatio=0, cachingAccesses=0, cachingHits=0, cachingHitsRatio=0,evictions=89, evicted=0, evictedPerRun=0.0 2020-02-21 08:00:32,031 INFO [WALProcedureStoreSyncThread] wal.WALProcedureStore: Remove log: hdfs://hdfsha/user/ams/hbase/MasterProcWALs/state-00000000000000000055.log 2020-02-21 08:00:32,031 INFO [WALProcedureStoreSyncThread] wal.WALProcedureStore: Removed logs: [hdfs://hdfsha/user/ams/hbase/MasterProcWALs/state-00000000000000000056.log] 2020-02-21 08:04:59,376 INFO [LruBlockCacheStatsExecutor] hfile.LruBlockCache: totalSize=159.41 KB, freeSize=150.39 MB, max=150.54 MB, blockCount=0, accesses=0, hits=0, hitRatio=0, cachingAccesses=0, cachingHits=0, cachingHitsRatio=0,evictions=119, evicted=0, evictedPerRun=0.0 2020-02-21 08:09:59,376 INFO [LruBlockCacheStatsExecutor] hfile.LruBlockCache: totalSize=159.41 KB, freeSize=150.39 MB, max=150.54 MB, blockCount=0, accesses=0, hits=0, hitRatio=0, cachingAccesses=0, cachingHits=0, cachingHitsRatio=0,evictions=149, evicted=0, evictedPerRun=0.0 2020-02-21 08:14:59,376 INFO [LruBlockCacheStatsExecutor] hfile.LruBlockCache: totalSize=159.41 KB, freeSize=150.39 MB, max=150.54 MB, blockCount=0, accesses=0, hits=0, hitRatio=0, cachingAccesses=0, cachingHits=0, cachingHitsRatio=0,evictions=179, evicted=0, evictedPerRun=0.0 [root@master ambari-metrics-collector]# we can see that 2020-02-21 08:15:48,648 INFO [MemStoreFlusher.1] regionserver.HStore: Added hdfs://hdfsha/user/ams/hbase/data/default/METRIC_RECORD/b665584cec3e6aa7a266b7fc94ef2e91/0/97bc3e982c0846e2864c2750526cca4f, entries=267808, sequenceid=3159, filesize=3.9 M but we set the - hbase.rootdir=/user/ams/hbase

Ravirakunapu · ‎02-20-2020

@jsensharma # telnet kdc.example.com 88 is working (but from CM >> Backup>>Add Peers >> from here it is not working) # cat /etc/hosts - Mapping was correct # netstat -tnlpa | grep $PID_Of_KDC tcp 0 0.0.0.0:88 lISTEN 68214/krb5kdc # service iptables status # systemctl status firewalld - Command not found

mark-gg · ‎02-19-2020

I followed https://community.cloudera.com/t5/Community-Articles/ambari-2-7-3-Ambari-writes-Empty-baseurl-values... and try again， it works. Maybe I didn't hard reload the page and start the create cluster wizard again

ARVINDR · ‎02-18-2020

Hi, Namenode not coming up despite trying the suggested command. Pls advise. Thanks & regards

jagadeesh_kumar · ‎02-17-2020

it show server error in my browser and i was followed every step in termial what you said . so ,can u tell me why?

jsensharma · ‎02-17-2020

@asmarz Regarding your query : "The problem that it i written that this principle is valid until 17/02/2020. So when I will test again I will get the same error when trying to browse the hdfs" >> Please check the following properties defined inside your "/etc/krb5.conf" and try to adjust those values based on your requirement. # grep -e 'ticket_lifetime\|renew_lifetime' /etc/krb5.conf renew_lifetime = 7d ticket_lifetime = 24h . ticket_lifetime: (Time duration string.) Sets the default lifetime for initial ticket requests. The default value is 1 day. renew_lifetime: (Time duration string.) Sets the default renewable lifetime for initial ticket requests. . For any Kerberos ticket , the ' ticket_lifetime ' (usually 1 day) is the time for which that particular ticket is valid. Once the ticket gets invalid, there is an option (kinit -R) to renew it. User can keep renewing her ticket this way till ' renew_lifetime ' time (usually 7 days).

hicha · ‎02-17-2020

Thank you for your collaboration, I found the solution. I'm using the wrong version of Livy.

AarifAkhter · ‎02-17-2020

grep 'java.home' /etc/ambari-server/conf/ambari.properties after use this this command showing this output java.home=/usr/jdk64/jdk1.8.0_77

MAZ9 · ‎02-17-2020

this suggestion works for me.....

Date Registered	‎03-14-2016 01:07 PM
Last Visited
Total Messages Posted	4,712
Total Kudos Received	1047

Re: cloudera hostname

Re: amari rest API + how to stop service on specif...

Re: amari rest API + how to stop service on specif...

Re: Namenode failure

Re: AMBARI + how to set value in json REST API

Re: ambari server connect mysql so frequent!!

Re: my file is copied to local but I can't find it...

Re: Superset - Default name and password

Re: Unable to start Node Manager - java.lang.Unsat...

Re: cloudera hostname

Re: Ambari 2.7.5 Respoitory

Re: Ambari API maintenance mode for host

Re: How many nodes should be installed for a minim...

Re: CLI tool to manage cluster

Re: HDF3.0 sandbox

Re: Monitoring Spark 2 performance via Grafana in ...

Re: Hive View 2.0 : Statistics not supported for p...

Re: Create new Ambari user

Re: is it possible to stop/start kafka service eac...

Re: amari rest API + how to stop service on specif...

Re: Namenode failure

Re: Create new Ambari user without Ambari admin cr...

Re: metrics collector crash after moving to distri...

Re: AMBARI + how to set value in json REST API

Re: SQOOP Connection Issue ( Sqoop to Oracle)

Re: Express upgrade to 3.1.0.0 fails at Finalize u...

Re: ambari metrics collector not display the metri...

Re: Kerberos KDC no working

Re: ambari2.7.3 install HDP3.1.0.0 failed at the "...

Re: Unable to start name node . No services coming...

Re: can't login into ambari

Re: Strange behaviour with HDFS user !!!

Re: LIVY-server don't work

Re: ambari installation error

Re: How to automate manual checkpointing on nameno...