About rohit_r_sharma

rohit_r_sharma · ‎09-05-2019

Hi All, Resolved using below steps: 1) To observe the Datanode threads: Created a widget in Ambari under HDFS for DataNode Threads (Runnable, Waited, Blocked) Monitored that from a particular date the threads went in wait stage. Exported the graph widget CSV file to view the exact time of wait threads. 2) Restart all Datanodes manually and observed that the wait threads were released. 3) With default 4096 threads the DataNode is running properly. Still unable to understand: 1) How to check the wait threads are in which DataNode? 2) Which task or process tend to threads in the wait stage? Would like to know if anyone comes across this and able to find in detail. Else the above steps are the only solution for wait threads.

rohit_r_sharma · ‎08-29-2019

Ambari 2.6 and HDP 2.6.3. The error is displayed while performing the following error: 1) HDFS get operation. 2) While aggregating and writing file on HDFS using pyspark. Error: "19/08/29 15:53:02 WARN hdfs.DFSClient: Failed to connect to /DN_IP:1019 for block, add to deadNodes and continue. java.io.EOFException: Premature EOF: no length prefix available " We found the following links to resolve the above error. => To set dfs.datanode.max.transfer.threads=8196 1) https://www.netiq.com/documentation/sentinel-82/admin/data/b1nbq4if.html (Performance Tuning Guidelines) 2) https://github.com/hortonworks/structor/issues/7 (jmaron commented on Jul 28, 2014) Could you all please suggest shall i go ahead with this resolution? Does this configuration affects any other services? Thankyou

rohit_r_sharma · ‎06-11-2019

@Jay Kumar SenSharma, Thanks for the support!!! Yeah, there was inconsistency in Ambari-Server DB which was not allowing Alert to function on Ambari-UI. The Ambari-server DB size was grown to 294 MB. By purging the last 6 months from DB and restarting the ambari functioned the Alerts back on Ambari-UI. Would like to know in detail if this happens on PROD env what measures should be taken as an admin.

rohit_r_sharma · ‎06-11-2019

@Geoffrey Shelton Okot, The purging saved me. Thanks a lot for the support. It would be great if I can automate purging every 6 months, please let me know if there is any way to do it.

rohit_r_sharma · ‎06-10-2019

@Geoffrey Shelton Okot, The ambari-server DB was created on 2018-09-04 20:10:19. The size of table schema ambari which belongs to ambari-server is 294 MB. Do you really think I need to purge the schema? Should the ambari-server schema size have a limit? If it is so How to limit it? OR automate purging?

rohit_r_sharma · ‎06-10-2019

@Jay Kumar SenSharma 1st Point ambari-server.log : Error Processing URI: /api/v1/clusters/cluster-name/alerts - (java.lang.NullPointerException) null 2nd Incognito Browser- Console (Tab) 3rd There is enough memory for Ambari-Server to function approx 166GB is Available. 4th With the help of your link above there is no log in ambari server saying exceeded Java Heap Size. The error in ambari-server is Java Null Pointer Exception null running alerts tab. Please Suggest.

rohit_r_sharma · ‎05-31-2019

Hi All, The configured HDP 2.6.3 cluster with Ambari 2.6 is unable to show contents inside the Alerts page. Can anyone help me, how to find the RCA for the same? Attaching screenshot of the Ambari Alerts Page: How to monitor log ? for this Alert page.

rohit_r_sharma · ‎06-21-2017

@Sumesh What if RM HA is not enabled in the ambari 2.2 and still facing the same error code 500 in Tez view?

rohit_r_sharma · ‎06-21-2017

@Sumesh What if RM HA is not enabled in the ambari 2.2 and still facing the same error code 500 in Tez view?

Online	Offline
Last Visited	‎01-13-2021 12:43 AM

Member Since	‎06-15-2016 10:46 AM
Last Visited	‎01-13-2021 12:43 AM
Posts	45
Kudos received	1

Cloudera Community

Re: Premature EOF: Error while reading and writing...

Re: Premature EOF: Error while reading and writing...

Premature EOF: Error while reading and writing dat...

Re: Unable to view Ambari Alerts page content

Re: Unable to view Ambari Alerts page content

Re: Unable to view Ambari Alerts page content

Re: Unable to view Ambari Alerts page content

Unable to view Ambari Alerts page content

Re: Unable to view Tez View - (error code: 500, me...

Re: Unable to view Tez View - (error code: 500, me...