About anshul_sisodia

anshul_sisodia · ‎07-27-2016

I made sure that no jobs were running at that time when the deletion happened :). Also I am not sure who set retention period to 8 years, have to check that. One thing i want to know here, if before deletion, I have would have set the property to 7days and restarted only timeline server, would it remove all the older logs from leveldb and keep logs which are generated in last 7 days? I guess after restarting Yarn, Job history server also resets.. and gets clears at regular intervals.. not sure though!!

anshul_sisodia · ‎07-27-2016

Thanks It worked. I just want to know if there are any consequences after deleting the leveldb-timeline-store.ldb directory. After deleteing content of this directory and restarting timeline server, the contents of this directory regenerated and freed up the space. We set “yarn.timeline-service.ttl-ms” from 267840000000(~443weeks) to 604800000(7 Days) to limit the size of the leveldb storage, according to hortonworks document.

anshul_sisodia · ‎07-27-2016

Ambari version is 2.1.2

anshul_sisodia · ‎07-27-2016

Ambari version is 2.1.2

anshul_sisodia · ‎07-26-2016

when I do klist, It shows below output: klist /var/lib/ambari-agent/tmp/web_alert_cc_4610ec9b283dcfc90bc6df1e519e1c52 Ticket cache: FILE:/var/lib/ambari-agent/tmp/web_alert_cc_4610ec9b283dcfc90bc6df1e519e1c52 Default principal: HTTP/abcd_fqdn@REALM.COM Valid starting Expires Service principal 07/26/16 08:42:28 07/26/16 08:47:28 krbtgt/REALM.COM@REALM.COM When I run below command it just execute and didn't give any error in the output /usr/share/centrifydc/kerberos/bin/kinit -l 5m -c /var/lib/ambari-agent/tmp/web_alert_cc_4610ec9b283dcfc90bc6df1e519e1c52 -kt /etc/security/keytabs/spnego.service.keytab HTTP/abcd_fqdn.com@REALM.COM

anshul_sisodia · ‎07-26-2016

How to confirm who manages Krb5.conf file. The ownership is with root: -rw-r--r-- 1 root root 727 May 11 17:00 krb5.conf ccache_type = 3 default_ccache_name is not defined Do I need to set this parameter for a particular UID or simply I give for all users default_ccache_name = /tmp/krb5cc_%{uid} and save conf file?

anshul_sisodia · ‎07-26-2016

I am getting below alerts: Services Reporting Alerts CRITICAL [MAPREDUCE2] MAPREDUCE2 CRITICAL History Server Web UI Connection failed to http://abcd_fqdn.com:19888 (Execution of '/usr/share/centrifydc/kerberos/bin/kinit -l 5m -c /var/lib/ambari-agent/tmp/web_alert_cc_4610ec9b283dcfc90bc6df1e519e1c52 -kt /etc/security/keytabs/spnego.service.keytab HTTP/ abcd_fqdn.com@Realm.COM > /dev/null' returned 1. kinit(v5): Credentials cache I/O operation failed XXX when initializing cache /var/lib/ambari-agent/tmp/web_alert_cc_4610ec9b283dcfc90bc6df1e519e1c52 ) I am not sure which credentials cache is it referring here. I can see credentials cache file on the node: -rw------- 1 yarn hadoop 1547 Jul 13 11:54 /tmp/krb5cc_513 -rw------- 1 hcat hadoop 1417 Jul 22 12:23 /tmp/krb5cc_516 -rw------- 1 hdfs hadoop 2775 Jul 22 12:24 /tmp/krb5cc_511 -rw------- 1 oozie hadoop 3046 Jul 22 12:24 /tmp/krb5cc_504 -rw------- 1 ambari-qa hadoop 1456 Jul 26 02:48 /tmp/krb5cc_1002 space in /tmp is also available.

anshul_sisodia · ‎07-21-2016

I have a scenario where yarn timeline store db is increasing day by day. In April it was 346GB and now it increased to 466GB and occupying lot of space in /var/opt/hadoop/yarn/timeline. # df -h Filesystem Size Used Avail Use% Mounted on /dev/sda2 30G 11G 18G 37% / udev 126G 260K 126G 1% /dev tmpfs 126G 0 126G 0% /dev/shm /dev/sda5 5.0G 2.5G 2.2G 54% /var /dev/sda7 756G 698G 21G 98% /var/opt/ /dev/sdb 2.5T 6.6G 2.3T 1% /data when i checked disk usage on /var/opt/hadoop/yarn/timeline du -sh * 466G leveldb-timeline-store.ldb 40K timeline-state-store.ldb I don't know why it is occupying this much of space. What steps do i need to take to make it consume less space.

anshul_sisodia · ‎07-05-2016

Is it a bug that shows port 8050 in Ambari UI but connect to port 8032..?? I still dont understand as why it doesn't connect to 8050 if we have set Yarn.resourcemanager.address to <rmaddress:8050> rather than connecting to 8032.

anshul_sisodia · ‎06-17-2016

@Kuldeep Kulkarni , I tried this suggestion and it worked for me but oozie and spark jobs failed as they are not able to connect to current active RM. I had to manually switchover RM then restarted oozie and spark, then jobs started running. Weird though 🙂 Anyways do you have any document or KB Article related to your suggetsion where this is shown or described. Again, Thanks for your time 🙂

Online	Offline
Last Visited	‎11-11-2016 07:42 AM

Member Since	‎12-11-2015 08:07 AM
Last Visited	‎11-11-2016 07:42 AM
Posts	79
Kudos received	26

Cloudera Community

Re: Hbase read latency metrics shows 200000000ms ....

Re: Ambari agent not coming up

Re: Yarn Timeline db consuming 466GB space

Re: Yarn Timeline db consuming 466GB space

Re: Kerberos kinit(v5): Credentials cache I/O oper...

Re: Kerberos kinit(v5): Credentials cache I/O oper...

Re: Kerberos kinit(v5): Credentials cache I/O oper...

Re: Kerberos kinit(v5): Credentials cache I/O oper...

Kerberos kinit(v5): Credentials cache I/O operatio...

Yarn Timeline db consuming 466GB space

Re: What is the default Yarn resource manager port...

Re: What is the default Yarn resource manager port...