Member since
12-11-2015
79
Posts
26
Kudos Received
2
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
4237 | 04-05-2016 12:14 PM | |
2525 | 12-14-2015 04:44 PM |
07-27-2016
02:37 PM
I made sure that no jobs were running at that time when the deletion happened :). Also I am not sure who set retention period to 8 years, have to check that. One thing i want to know here, if before deletion, I have would have set the property to 7days and restarted only timeline server, would it remove all the older logs from leveldb and keep logs which are generated in last 7 days? I guess after restarting Yarn, Job history server also resets.. and gets clears at regular intervals.. not sure though!!
... View more
07-27-2016
12:43 PM
Thanks It worked. I just want to know if there are any consequences after deleting the leveldb-timeline-store.ldb directory. After deleteing content of this directory and restarting timeline server, the contents of this directory regenerated and freed up the space.
We set “yarn.timeline-service.ttl-ms”
from 267840000000(~443weeks) to 604800000(7 Days) to limit the size of the
leveldb storage, according to hortonworks document.
... View more
07-27-2016
07:53 AM
Ambari version is 2.1.2
... View more
07-27-2016
07:52 AM
Ambari version is 2.1.2
... View more
07-26-2016
01:56 PM
when I do klist, It shows below output: klist /var/lib/ambari-agent/tmp/web_alert_cc_4610ec9b283dcfc90bc6df1e519e1c52
Ticket cache: FILE:/var/lib/ambari-agent/tmp/web_alert_cc_4610ec9b283dcfc90bc6df1e519e1c52
Default principal: HTTP/abcd_fqdn@REALM.COM
Valid starting Expires Service principal
07/26/16 08:42:28 07/26/16 08:47:28 krbtgt/REALM.COM@REALM.COM When I run below command it just execute and didn't give any error in the output /usr/share/centrifydc/kerberos/bin/kinit -l 5m -c /var/lib/ambari-agent/tmp/web_alert_cc_4610ec9b283dcfc90bc6df1e519e1c52 -kt /etc/security/keytabs/spnego.service.keytab HTTP/abcd_fqdn.com@REALM.COM
... View more
07-26-2016
12:53 PM
How to confirm who manages Krb5.conf file. The ownership is with root: -rw-r--r-- 1 root root 727 May 11 17:00 krb5.conf ccache_type = 3 default_ccache_name
is not defined Do I need to set this parameter for a particular UID or simply I give for all users default_ccache_name = /tmp/krb5cc_%{uid} and save conf file?
... View more
07-26-2016
10:38 AM
I am getting below alerts: Services Reporting Alerts
CRITICAL [MAPREDUCE2]
MAPREDUCE2
CRITICAL History Server Web UI
Connection failed to http://abcd_fqdn.com:19888 (Execution of '/usr/share/centrifydc/kerberos/bin/kinit -l 5m -c /var/lib/ambari-agent/tmp/web_alert_cc_4610ec9b283dcfc90bc6df1e519e1c52 -kt /etc/security/keytabs/spnego.service.keytab HTTP/ abcd_fqdn.com@Realm.COM > /dev/null' returned 1. kinit(v5): Credentials cache I/O operation failed XXX when initializing cache /var/lib/ambari-agent/tmp/web_alert_cc_4610ec9b283dcfc90bc6df1e519e1c52 ) I am not sure which credentials cache is it referring here. I can see credentials cache file on the node: -rw------- 1 yarn hadoop 1547 Jul 13 11:54 /tmp/krb5cc_513
-rw------- 1 hcat hadoop 1417 Jul 22 12:23 /tmp/krb5cc_516
-rw------- 1 hdfs hadoop 2775 Jul 22 12:24 /tmp/krb5cc_511
-rw------- 1 oozie hadoop 3046 Jul 22 12:24 /tmp/krb5cc_504
-rw------- 1 ambari-qa hadoop 1456 Jul 26 02:48 /tmp/krb5cc_1002 space in /tmp is also available.
... View more
Labels:
- Labels:
-
Apache Ambari
07-21-2016
10:16 AM
I have a scenario where yarn timeline store db is increasing day by day. In April it was 346GB and now it increased to 466GB and occupying lot of space in /var/opt/hadoop/yarn/timeline. # df -h
Filesystem Size Used Avail Use% Mounted on
/dev/sda2 30G 11G 18G 37% /
udev 126G 260K 126G 1% /dev
tmpfs 126G 0 126G 0% /dev/shm
/dev/sda5 5.0G 2.5G 2.2G 54% /var
/dev/sda7 756G 698G 21G 98% /var/opt/
/dev/sdb 2.5T 6.6G 2.3T 1% /data when i checked disk usage on /var/opt/hadoop/yarn/timeline du -sh *
466G leveldb-timeline-store.ldb
40K timeline-state-store.ldb I don't know why it is occupying this much of space. What steps do i need to take to make it consume less space.
... View more
Labels:
- Labels:
-
Apache YARN
07-05-2016
07:19 AM
Is it a bug that shows port 8050 in Ambari UI but connect to port 8032..?? I still dont understand as why it doesn't connect to 8050 if we have set Yarn.resourcemanager.address to <rmaddress:8050> rather than connecting to 8032.
... View more
06-17-2016
08:22 AM
@Kuldeep Kulkarni , I tried this suggestion and it worked for me but oozie and spark jobs failed as they are not able to connect to current active RM. I had to manually switchover RM then restarted oozie and spark, then jobs started running. Weird though 🙂 Anyways do you have any document or KB Article related to your suggetsion where this is shown or described. Again, Thanks for your time 🙂
... View more