Member since
12-06-2016
136
Posts
12
Kudos Received
1
Solution
My Accepted Solutions
Title | Views | Posted |
---|---|---|
2683 | 01-18-2018 12:56 PM |
01-16-2018
07:11 AM
Have another question about your post : "How to create and register custom ambari alerts ?" How to limit mount point or resolve error : OSError: [Errno 2] No such file or directory: 'net_prio' [root@serv03 host_scripts]# python test_alert_disk_space.py
mountPoints = ,/sys,/proc,/dev,/sys/kernel/security,/dev/shm,/dev/pts,/run,/sys/fs/cgroup,/sys/fs/cgroup/systemd,/sys/fs/pstore,/sys/fs/cgroup/pids,/sys/fs/cgroup/net_cls,net_prio,/sys/fs/cgroup/perf_event,/sys/fs/cgroup/cpu,cpuacct,/sys/fs/cgroup/devices,/sys/fs/cgroup/hugetlb,/sys/fs/cgroup/blkio,/sys/fs/cgroup/memory,/sys/fs/cgroup/cpuset,/sys/fs/cgroup/freezer,/sys/kernel/config,/,/usr,/proc/sys/fs/binfmt_misc,/dev/mqueue,/sys/kernel/debug,/dev/hugepages,/hadoop,/var,/var/lib,/home,/boot,/proc/sys/fs/binfmt_misc,/run/user/1015,/run/user/1012,/run/user/1031,/run/user/0,/run/user/1029,/run/user/1010,/run/user/1037,/run/user/1013,/run/user/1018,/run/user/1040,/run/user/1022,/run/user/1039
['', '/sys', '/proc', '/dev', '/sys/kernel/security', '/dev/shm', '/dev/pts', '/run', '/sys/fs/cgroup', '/sys/fs/cgroup/systemd', '/sys/fs/pstore', '/sys/fs/cgroup/pids', '/sys/fs/cgroup/net_cls', 'net_prio', '/sys/fs/cgroup/perf_event', '/sys/fs/cgroup/cpu', 'cpuacct', '/sys/fs/cgroup/devices', '/sys/fs/cgroup/hugetlb', '/sys/fs/cgroup/blkio', '/sys/fs/cgroup/memory', '/sys/fs/cgroup/cpuset', '/sys/fs/cgroup/freezer', '/sys/kernel/config', '/', '/usr', '/proc/sys/fs/binfmt_misc', '/dev/mqueue', '/sys/kernel/debug', '/dev/hugepages', '/hadoop', '/var', '/var/lib', '/home', '/boot', '/proc/sys/fs/binfmt_misc', '/run/user/1015', '/run/user/1012', '/run/user/1031', '/run/user/0', '/run/user/1029', '/run/user/1010', '/run/user/1037', '/run/user/1013', '/run/user/1018', '/run/user/1040', '/run/user/1022', '/run/user/1039']
---------- l :
FINAL finalResultCode CODE .....
---------- l : /sys
/sys
disk_usage.total = 0
=>WARNING
FINAL finalResultCode CODE .....WARNING
---------- l : /proc
/proc
disk_usage.total = 0
=>WARNING
FINAL finalResultCode CODE .....WARNING
---------- l : /dev
/dev
disk_usage.total
134933655552
=>WARNING
FINAL finalResultCode CODE .....WARNING
---------- l : /sys/kernel/security
/sys/kernel/security
disk_usage.total = 0
=>WARNING
FINAL finalResultCode CODE .....WARNING
---------- l : /dev/shm
/dev/shm
disk_usage.total
134944870400
=>WARNING
FINAL finalResultCode CODE .....WARNING
---------- l : /dev/pts
/dev/pts
disk_usage.total = 0
=>WARNING
FINAL finalResultCode CODE .....WARNING
---------- l : /run
/run
disk_usage.total
134944870400
=>WARNING
FINAL finalResultCode CODE .....WARNING
---------- l : /sys/fs/cgroup
/sys/fs/cgroup
disk_usage.total
134944870400
=>WARNING
FINAL finalResultCode CODE .....WARNING
---------- l : /sys/fs/cgroup/systemd
/sys/fs/cgroup/systemd
disk_usage.total = 0
=>WARNING
FINAL finalResultCode CODE .....WARNING
---------- l : /sys/fs/pstore
/sys/fs/pstore
disk_usage.total = 0
=>WARNING
FINAL finalResultCode CODE .....WARNING
---------- l : /sys/fs/cgroup/pids
/sys/fs/cgroup/pids
disk_usage.total = 0
=>WARNING
FINAL finalResultCode CODE .....WARNING
---------- l : /sys/fs/cgroup/net_cls
/sys/fs/cgroup/net_cls
disk_usage.total = 0
=>WARNING
FINAL finalResultCode CODE .....WARNING
---------- l : net_prio
net_prio
Traceback (most recent call last):
File "test_alert_disk_space.py", line 241, in <module>
execute()
File "/usr/lib/python2.6/site-packages/ambari_commons/os_family_impl.py", line 89, in thunk
return fn(*args, **kwargs)
File "test_alert_disk_space.py", line 90, in execute
disk_usage = _get_disk_usage(mountPath)
File "/usr/lib/python2.6/site-packages/ambari_commons/os_family_impl.py", line 89, in thunk
return fn(*args, **kwargs)
File "test_alert_disk_space.py", line 179, in _get_disk_usage
disk_stats = os.statvfs(path)
OSError: [Errno 2] No such file or directory: 'net_prio'
[root@serv03 host_scripts]#
... View more
01-16-2018
07:00 AM
Hi! Thanks you very match, it
works!
... View more
01-15-2018
03:40 PM
Ambari Version 2.5.0.3 (HDP-2.6.3.0)
... View more
01-15-2018
03:38 PM
How run default alert script alert_disk_space.py from command line :
[root@serv03
host_scripts]# python alert_disk_space.py
Traceback
(most recent call last):
File "alert_disk_space.py", line
24, in <module>
from ambari_commons.os_family_impl import
OsFamilyFuncImpl, OsFamilyImpl
ImportError:
No module named ambari_commons.os_family_impl
------------------------
Notification from Ambari working successfully
... View more
Labels:
- Labels:
-
Apache Ambari
01-15-2018
11:44 AM
Hi All! After done steps describe above have strange errors : [Errno 2] No such file or directory: 'net_prio' Please healp custom-host-mount-point-usage.png.. Ambari Version 2.5.0.3 (HDP-2.6.3.0)
... View more
11-15-2017
07:28 AM
Hi all! Where is I
can find information about limitation Hadoop Distcp ? (transactional / non-transactional etc )
... View more
11-14-2017
07:57 AM
Hi!
After change parameter preserveBlockSize & skipChecksum on target site, do not see any change in xml file for task (after recreate task) :
[hdfs@target ~]$ hdfs dfs -ls /apps/falcon/extensions/hdfs-mirroring/retargets/runtime/hdfs-mirroring-workflow.xml
-rwxr-xr-x 2 hdfs users 4943 2017-11-13 22:39 /apps/falcon/extensions/hdfs-mirroring/retargets/runtime/hdfs-mirroring-workflow.xml <<< change this file ( on target size)
[hdfs@target ~]$
t1.xml[hdfs@target ~]$ grep -i preserveBlockSize hdfs-mirroring-workflow.xml
<arg>-preserveBlockSize</arg>
<arg>${preserveBlockSize}</arg>
<arg>-preserveBlockSize</arg> <arg>true</arg>
[hdfs@target ~]$
[hdfs@target ~]$
[hdfs@target ~]$ grep -i skipChecksum hdfs-mirroring-workflow.xml
<arg>-skipChecksum</arg>
<arg>${skipChecksum}</arg>
<arg>-skipChecksum</arg> <arg>true</arg>
[hdfs@target ~]$
Please help me.
Where I can find file hdfs-replication.properties ?
... View more
09-08-2017
11:29 AM
any recomendation ?
... View more
09-07-2017
09:48 AM
Hi!
have error after connect from beeline :
[root@serv01 ~]# /usr/hdp/current/hive-server2/bin/beeline
Beeline version 1.2.1000.2.6.0.3-8 by Apache Hive
beeline> !connect jdbc:hive2://serv03.kyivstar.ua:2181,serv01.kyivstar.ua:2181,serv02.kyivstar.ua:2181/;serviceDiscoveryMode=zooKeeper;zooKeeperNamespace=hiveserver2-hive2
Connecting to jdbc:hive2://serv03.kyivstar.ua:2181,serv01.kyivstar.ua:2181,serv02.kyivstar.ua:2181/;serviceDiscoveryMode=zooKeeper;zooKeeperNamespace=hiveserver2-hive2
Enter username for jdbc:hive2://serv03.kyivstar.ua:2181,serv01.kyivstar.ua:2181,serv02.kyivstar.ua:2181/;serviceDiscoveryMode=zooKeeper;zooKeeperNamespace=hiveserver2-hive2: hive
Enter password for jdbc:hive2://serv03.kyivstar.ua:2181,serv01.kyivstar.ua:2181,serv02.kyivstar.ua:2181/;serviceDiscoveryMode=zooKeeper;zooKeeperNamespace=hiveserver2-hive2:
Error: org.apache.hive.jdbc.ZooKeeperHiveClientException: Unable to read HiveServer2 configs from ZooKeeper (state=,code=0)
0: jdbc:hive2://serv03.kyivstar.ua:2181,ks- (closed)> /var/lib/log/hive/hiveserver2Interactive.log : Exception in thread "Timer-0" java.lang.OutOfMemoryError: GC overhead limit exceeded
at java.io.DataOutputStream.<init>(DataOutputStream.java:204)
at org.apache.hadoop.fs.FSDataOutputStream.<init>(FSDataOutputStream.java:89)
at org.apache.hadoop.fs.FSDataOutputStream.<init>(FSDataOutputStream.java:84)
at org.apache.hadoop.fs.RawLocalFileSystem.create(RawLocalFileSystem.java:308)
at org.apache.hadoop.fs.RawLocalFileSystem.create(RawLocalFileSystem.java:341)
at org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSOutputSummer.<init>(ChecksumFileSystem.java:400)
at org.apache.hadoop.fs.ChecksumFileSystem.create(ChecksumFileSystem.java:463)
at org.apache.hadoop.fs.ChecksumFileSystem.create(ChecksumFileSystem.java:442)
at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:930)
at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:911)
at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:807)
at org.apache.hadoop.hive.common.metrics.metrics2.CodahaleMetrics$JsonFileReporter$1.run(CodahaleMetrics.java:422)
at java.util.TimerThread.mainLoop(Timer.java:555)
at java.util.TimerThread.run(Timer.java:505)
Exception: java.lang.OutOfMemoryError thrown from the UncaughtExceptionHandler in thread "main-SendThread(serv02.kyivstar.ua:2181)"
Exception in thread "Timer for 'hiveserver2' metrics system" java.lang.OutOfMemoryError: GC overhead limit exceeded
Exception in thread "HiveServer2-Handler-Pool: Thread-164" java.lang.OutOfMemoryError: GC overhead limit exceeded
... View more
Labels:
- Labels:
-
Apache Hive
04-12-2017
07:56 AM
properties.png
... View more
- « Previous
- Next »