About sheetal

sheetal · ‎08-18-2017

SmartSense provides this information (and much more than this) for every job.

sheetal · ‎05-31-2017

If you are referring to SmartSense data anonymization here are the details for version 1.4.0 https://docs.hortonworks.com/HDPDocuments/SS1/SmartSense-1.4.0/bk_user-guide/content/appendix_data_anonymization.html You can find similar details for other versions too from Hortonworks docs.https://docs.hortonworks.com/

sheetal · ‎05-31-2017

Ohk, So you went past the installation step. Yes, in order to use SmartSense you would need a SmartSense ID and currently it is available only through support portal. So you would need a support account in order to get a SmartSense ID.

sheetal · ‎05-31-2017

@Robin Dong Which version of Ambari are you using? From Ambari 2.2 onwards, SmartSense rpm/deb packages are part of Ambari repo. Are you directly connecting to public repo or do you have a local repo setup? If local, you may want to make sure that all packages from that repo are synced.

sheetal · ‎05-30-2017

Do you have any special characters (probably in explorer password) ? You may want to give it a try without them.

sheetal · ‎04-12-2017

In the Ambari "Config" screen for "SmartSense", you should be able to see it as below. I am still curious how did it become mandatory for you as the default config is "No". How are you installing? Using UI, BluePrints, APIs?

sheetal · ‎04-11-2017

Flex ID is applicable if you have corresponding subscription with Hortonworks. If you don't, you sould be able to "Disable" it through "Enable Flex Subscription" option (it is disabled by default)

sheetal · ‎04-06-2017

@Michael Salmon I can think for following possibilities that may result into this situations. 1. SmartSense HST server is down and needs to be started 2. The view config somehow is not pointing to correct HST server, if so that should be fixed through Ambari admin UI 3. Something else: Need to look into Ambari Server logs and hst server logs

sheetal · ‎01-25-2017

It's a zeppelin dashboard, so you will be able to use zeppelin auth features. Here are some references. https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.5.0/bk_zeppelin-component-guide/content/zepp-authentication.html https://community.hortonworks.com/questions/21252/zeppelin-tech-preview-with-ldap-authentication.html https://community.hortonworks.com/questions/37904/how-to-provide-user-based-authentication-in-zeppel.html

sheetal · ‎11-30-2016

@David Grier that's a good ask. providing an ability to download it as csv is on our roadmap.

sheetal · ‎10-27-2016

@junda chen those instructions are for older version (1.1), btw, why do you want to uninstall it?

sheetal · ‎10-23-2016

This usually means that the bundle was captured but could not be uploaded to Hortonworks for analysis. For bundle to be successfully uploaded to Hortonworks, the HST server should have internet access. If it does not, then we recommend setting up a gateway https://docs.hortonworks.com/HDPDocuments/SS1/SmartSense-1.3.0/bk_installation/content/gateway_install.html If either of these is already set up, then I would suggest looking at /var/log/hst/hst-server.log on HST Server host and if gateway is setup, /var/log/hst/hst-gateway.log on SmartSense Gateway host. The logs are very descriptive and should help you get more details on why the bundle could not be uploaded.

sheetal · ‎10-14-2016

@Sunile Manjee, is your Ambari Metrics Service running ? (specifically Ambari Metric Collector)? You may want to try restarting AMS Collector and then restart Activity Explorer.

sheetal · ‎10-11-2016

Is this a fresh install or upgrade? what's your content of /etc/hst/conf/hst-server.ini and /etc/hst/conf/hst-agent.ini

sheetal · ‎10-11-2016

Sometimes it may happen because of incomplete package installation (for various reasons including disk space). Can you try re-installing the smartsense package? (for centos/redhat) rpm -e smartsense-hst yum -y install smartsense-hst Try restarting it once from Ambari (this will set the appropriate configs). If this still does not resolve it, I would suggest to open a support case.

sheetal · ‎10-10-2016

Can you share more details of offline ambari install? What version of Ambari you have, what version of SmartSense are you trying to install etc?

sheetal · ‎10-10-2016

@Yaroslav Chinskiy, is this Ambari install or manual install?

sheetal · ‎10-07-2016

As mentioned in the error log, you should check /var/log/smartsense-activity/activity-analyzer.log from the host where activity analyzer is running. ( Have you entered SmartSense ID? In some cases, not having valid SmartSense ID results in starting of activity analyzer/explorers. )

sheetal · ‎09-30-2016

SmartSense 1.3 uses AMS's phoenix for storing its data. So as long as you have AMS running, you do not need any external HBase setup. If you have restarted AMS recently, you may want to try restarting SmartSense components as well.

sheetal · ‎09-30-2016

SmartSense agents are passive agents and not continuously running demons. They wake up only when there is data collection need (typically once a week or on ad-hoc invocation). They only run for few minutes. They use very limited memory. The CPU utilization would depend on how many and how large logs you are collecting and number of data anonymization rules you have. But usually it is not too heavy and finishes in minutes.

sheetal · ‎09-16-2016

What issue are you facing @Artem Ervits ? Is capture not starting, timing out, failing or something else?

sheetal · ‎09-16-2016

Quicklinks for SmartSense are available from Ambari 2.4.0 onwards. Ambari 2.2.2.0 does not have that feature. For Ambari 2.2.0 you will have to navigate to http://<activity explorer host>:9060/

sheetal · ‎07-12-2016

@Giuseppe cloud, navigate to SmartSense view and you will see the details. The alert also would show you reason for failure. It looks like in your case it failed, because it did not have valid SmartSense ID.

sheetal · ‎06-23-2016

@Sri Bandaru, you can get the queue related metrics through AMS. AMS has various queue related metrics like ActiveApplications, AggregateContainersAllocated, AggregateContainersReleased, AllocatedContainers, AllocatedMB, AllocatedVCores, AppsPending, AppsSubmitted, AvailableMB, AvailableVCores, PendingContainers, PendingMB, PendingVCores, ReservedContainers, ReservedMB, ReservedVCores, running_0, running_60, running_300, running_1440 etc. This will provdie you what your are looking for. Also if you are on Ambari 2.2.2+ you will have graphana UI in AMS where you can create your dashboards for the metrics of your interest.

sheetal · ‎06-23-2016

The download option is still there and not removed. If you believe that the bundle capture is completed and still you don't see an option, that could be potential bug (we have not seen it yet). In that case, plese create a support case.

sheetal · ‎06-23-2016

You can have additional copy for backup/redundancy purpose. SmartSense may not be recommending to remove it, but rather "move" it. As part of move, you would need to copy the metadata to new directory path and then update configurations (remove old directory path and add new directory path, this may be just confusion in words used.)

sheetal · ‎06-22-2016

@Anil Bagga, SmartSense recommends that you do not use root file system for storing NN or DN data/metadata. There have been numerous cases where using root fs for storing data has resulted into slowness (as multiple writes happening on same disk) and in some cases crashes due to root file system being filled up and no space to write NN metadata. That's why SmartSense recommends you to avoid these problems. So you should make sure that you are setup in such a way that you don't get into either of these situations.

sheetal · ‎05-23-2016

If it is not ambari managed cluster, then you must change the configs on HST server. They are auto pushed to Agents during capture. Any local changes on agents will be overwritten by server configs.

sheetal · ‎05-23-2016

It is not. Safer way is to change it in Ambari and restart for configurations to apply. Manual changes may get overwritten by Ambari and/or HST servers configurations.

sheetal · ‎05-19-2016

Sridhar, the download option is still there. However the option will appear only on successful completion of the bundle. If the bundle capture is in progress, timeout or failed, the download option is not available.

Online	Offline
Last Visited	‎08-18-2017 08:27 PM

Date Registered	‎10-02-2015 04:40 PM
Last Visited	‎08-18-2017 08:27 PM
Total Messages Posted	37
Total Kudos Received	20

Re: need info how to create a new account at https...

Re: Smartsense recommendations format

Re: SmartSense bundle upload failed

Re: smartsense hdfs dashboard connection issue

Re: New cluster : SmartSense / Activity Analyzer w...

Re: How to monitor yarn applications actual memory...

Re: need instructions on implementing the data ano...

Re: I got this error 'No package smartsense-hst av...

Re: need info how to create a new account at https...

Re: Activity Explorer Installation failed (Ambari ...

Re: HDP 2.6 Ambari 2.5 requires smartsense flex id...

Re: HDP 2.6 Ambari 2.5 requires smartsense flex id...

Re: smartsense view doesn't work

Re: LDAP Integration for SmartSense Zeppelin Dashb...

Re: Smartsense recommendations format

Re: "Unsupported action Uninstall" while uninstall...

Re: SmartSense bundle upload failed

Re: smartsense hdfs dashboard connection issue

Re: HST Server install fails

Re: HST Server install fails

Re: HST Server install fails

Re: HST Server install fails

Re: New cluster : SmartSense / Activity Analyzer w...

Re: Smartsense Zeppelin notebooks require hbase?

Re: Are there any node performance implications of...

Re: Smartsense 1.3 - quick links missing

Re: Smartsense 1.3 - quick links missing

Re: SmartSense Bundle Capture Failure

Re: Capacity Scheduler statistics

Re: Did they remove download bundle option from Sm...

Re: Smartsense recommendation for Namenode Metadat...

Re: Smartsense recommendation for Namenode Metadat...

Re: is it safe editing hst-server.ini directly ove...

Re: is it safe editing hst-server.ini directly ove...

Re: Did they remove download bundle option from Sm...