Our Community is getting an upgrade! To get everything ready for the relaunch, we’ll be placing the site in read-only mode starting September 21st.
We really appreciate your understanding while we get things set up behind the scenes. Catch up on all the exciting details about the move here.
Need help or have questions? Drop us a line at [email protected]
Created 09-19-2017 12:27 PM
HDP - 2.5.0.55
SmartSense - 1.3.0.0-1
While reviewing our SmartSense reports I found that tez jobs were not appearing.
When I looked at the activity-analyzer.log I am found all of our tez jobs are generating an error indicating tez_job.critical.path.analyzer.draw.svg should be enabled. ( I have included a sample below. )
I could not find a spot in Ambari nor via extensive grepping to put the property.
Does anyone have experience with this?
thanks,
dale
18 Sep 2017 18:49:29,126 WARN [pool-15-thread-3] CriticalPathAnalyzer:91 - Output of this analyzer is an SVG image. tez_job.critical.path.analyzer.draw.svg is not enabled. Please enable it to get the SVG in /var/lib/smartsense/activity-analyzer/tez/tmp/svg/
18 Sep 2017 18:49:29,142 ERROR [pool-15-thread-6] TezActivityProcessor:110 - java.lang.NullPointerException
18 Sep 2017 18:49:29,143 ERROR [pool-15-thread-6] ActivityManager:89 - Failed to process activity id dag_1504751117105_262793_5 of type TEZ_JOB
com.hortonworks.smartsense.activity.ActivityException: Error parsing dag_1504751117105_262793_5
at com.hortonworks.smartsense.activity.job.tez.TezActivityProcessor.parseJob(TezActivityProcessor.java:111)
at com.hortonworks.smartsense.activity.JobActivityProcessor.processActivity(JobActivityProcessor.java:88)
at com.hortonworks.smartsense.activity.ActivityManager$1.call(ActivityManager.java:80)
at com.hortonworks.smartsense.activity.ActivityManager$1.call(ActivityManager.java:73)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.NullPointerException
Created 09-19-2017 05:11 PM
After some trail and error I was able to get the property to appear in /etc/smartsense-activity/conf/activity.ini.
Add the property at Ambari --> SmartSense --> Configs --> Advanced --> Custom activity-conf --> tez_job.critical.path.analyzer.draw.svg = true
This seems to work.
Created 09-19-2017 05:11 PM
After some trail and error I was able to get the property to appear in /etc/smartsense-activity/conf/activity.ini.
Add the property at Ambari --> SmartSense --> Configs --> Advanced --> Custom activity-conf --> tez_job.critical.path.analyzer.draw.svg = true
This seems to work.