Re: need info how to create a new account at https...

sheetal · ‎08-18-2017

SmartSense provides this information (and much more than this) for every job.

sheetal · ‎05-31-2017

If you are referring to SmartSense data anonymization here are the details for version 1.4.0 https://docs.hortonworks.com/HDPDocuments/SS1/SmartSense-1.4.0/bk_user-guide/content/appendix_data_anonymization.html You can find similar details for other versions too from Hortonworks docs.https://docs.hortonworks.com/

sheetal · ‎05-31-2017

Ohk, So you went past the installation step. Yes, in order to use SmartSense you would need a SmartSense ID and currently it is available only through support portal. So you would need a support account in order to get a SmartSense ID.

sheetal · ‎05-31-2017

@Robin Dong Which version of Ambari are you using? From Ambari 2.2 onwards, SmartSense rpm/deb packages are part of Ambari repo. Are you directly connecting to public repo or do you have a local repo setup? If local, you may want to make sure that all packages from that repo are synced.

sheetal · ‎05-30-2017

Do you have any special characters (probably in explorer password) ? You may want to give it a try without them.

sheetal · ‎04-12-2017

In the Ambari "Config" screen for "SmartSense", you should be able to see it as below. I am still curious how did it become mandatory for you as the default config is "No". How are you installing? Using UI, BluePrints, APIs?

sheetal · ‎04-11-2017

Flex ID is applicable if you have corresponding subscription with Hortonworks. If you don't, you sould be able to "Disable" it through "Enable Flex Subscription" option (it is disabled by default)

sheetal · ‎04-06-2017

@Michael Salmon I can think for following possibilities that may result into this situations. 1. SmartSense HST server is down and needs to be started 2. The view config somehow is not pointing to correct HST server, if so that should be fixed through Ambari admin UI 3. Something else: Need to look into Ambari Server logs and hst server logs

sheetal · ‎01-25-2017

It's a zeppelin dashboard, so you will be able to use zeppelin auth features. Here are some references. https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.5.0/bk_zeppelin-component-guide/content/zepp-authentication.html https://community.hortonworks.com/questions/21252/zeppelin-tech-preview-with-ldap-authentication.html https://community.hortonworks.com/questions/37904/how-to-provide-user-based-authentication-in-zeppel.html

sheetal · ‎11-30-2016

@David Grier that's a good ask. providing an ability to download it as csv is on our roadmap.

sheetal · ‎10-23-2016

This usually means that the bundle was captured but could not be uploaded to Hortonworks for analysis. For bundle to be successfully uploaded to Hortonworks, the HST server should have internet access. If it does not, then we recommend setting up a gateway https://docs.hortonworks.com/HDPDocuments/SS1/SmartSense-1.3.0/bk_installation/content/gateway_install.html If either of these is already set up, then I would suggest looking at /var/log/hst/hst-server.log on HST Server host and if gateway is setup, /var/log/hst/hst-gateway.log on SmartSense Gateway host. The logs are very descriptive and should help you get more details on why the bundle could not be uploaded.

sheetal · ‎10-14-2016

@Sunile Manjee, is your Ambari Metrics Service running ? (specifically Ambari Metric Collector)? You may want to try restarting AMS Collector and then restart Activity Explorer.

sheetal · ‎10-07-2016

As mentioned in the error log, you should check /var/log/smartsense-activity/activity-analyzer.log from the host where activity analyzer is running. ( Have you entered SmartSense ID? In some cases, not having valid SmartSense ID results in starting of activity analyzer/explorers. )

sheetal · ‎09-30-2016

SmartSense agents are passive agents and not continuously running demons. They wake up only when there is data collection need (typically once a week or on ad-hoc invocation). They only run for few minutes. They use very limited memory. The CPU utilization would depend on how many and how large logs you are collecting and number of data anonymization rules you have. But usually it is not too heavy and finishes in minutes.

sheetal · ‎09-16-2016

What issue are you facing @Artem Ervits ? Is capture not starting, timing out, failing or something else?

sheetal · ‎09-16-2016

Quicklinks for SmartSense are available from Ambari 2.4.0 onwards. Ambari 2.2.2.0 does not have that feature. For Ambari 2.2.0 you will have to navigate to http://<activity explorer host>:9060/

sheetal · ‎06-23-2016

@Sri Bandaru, you can get the queue related metrics through AMS. AMS has various queue related metrics like ActiveApplications, AggregateContainersAllocated, AggregateContainersReleased, AllocatedContainers, AllocatedMB, AllocatedVCores, AppsPending, AppsSubmitted, AvailableMB, AvailableVCores, PendingContainers, PendingMB, PendingVCores, ReservedContainers, ReservedMB, ReservedVCores, running_0, running_60, running_300, running_1440 etc. This will provdie you what your are looking for. Also if you are on Ambari 2.2.2+ you will have graphana UI in AMS where you can create your dashboards for the metrics of your interest.

sheetal · ‎06-23-2016

The download option is still there and not removed. If you believe that the bundle capture is completed and still you don't see an option, that could be potential bug (we have not seen it yet). In that case, plese create a support case.

sheetal · ‎06-23-2016

You can have additional copy for backup/redundancy purpose. SmartSense may not be recommending to remove it, but rather "move" it. As part of move, you would need to copy the metadata to new directory path and then update configurations (remove old directory path and add new directory path, this may be just confusion in words used.)

sheetal · ‎06-22-2016

@Anil Bagga, SmartSense recommends that you do not use root file system for storing NN or DN data/metadata. There have been numerous cases where using root fs for storing data has resulted into slowness (as multiple writes happening on same disk) and in some cases crashes due to root file system being filled up and no space to write NN metadata. That's why SmartSense recommends you to avoid these problems. So you should make sure that you are setup in such a way that you don't get into either of these situations.

sheetal · ‎05-23-2016

If it is not ambari managed cluster, then you must change the configs on HST server. They are auto pushed to Agents during capture. Any local changes on agents will be overwritten by server configs.

sheetal · ‎05-23-2016

It is not. Safer way is to change it in Ambari and restart for configurations to apply. Manual changes may get overwritten by Ambari and/or HST servers configurations.

sheetal · ‎05-19-2016

Sridhar, the download option is still there. However the option will appear only on successful completion of the bundle. If the bundle capture is in progress, timeout or failed, the download option is not available.

sheetal · ‎02-09-2016

What repo URL are you using? Try using http://repo.hortonworks.com/content/groups/public

sheetal · ‎10-06-2015

Thanks for pointers. I will have customer check these configs.

sheetal · ‎10-06-2015

I noticed that Ambari sever is using IP Address for Ambari server host, however everywhere else it is being used as FQDN The IP is “192.168.110.1” and fqdn is “r3r31gateway.customer.domain.com” From command-xxx.json, I see "hostname": "r3r31gateway.customer.domain.com”, And "ambari_server_host": [ "192.168.110.1" ], Just wondering, why would that happen? Why would Ambari server use IP address instead of FQDN (even when it has FQDN) Secondly, how do we fix this and make Ambari use fqdn for “ambari_server_host” instead of IP address?

Online	Offline
Last Visited	‎08-05-2020 06:47 PM

Date Registered	‎10-02-2015 04:40 PM
Last Visited	‎08-05-2020 06:47 PM
Total Messages Posted	37
Total Kudos Received	20

Re: need info how to create a new account at https...

Re: Smartsense recommendations format

Re: SmartSense bundle upload failed

Re: smartsense hdfs dashboard connection issue

Re: New cluster : SmartSense / Activity Analyzer w...

Re: How to monitor yarn applications actual memory...

Re: need instructions on implementing the data ano...

Re: I got this error 'No package smartsense-hst av...

Re: need info how to create a new account at https...

Re: Activity Explorer Installation failed (Ambari ...

Re: HDP 2.6 Ambari 2.5 requires smartsense flex id...

Re: HDP 2.6 Ambari 2.5 requires smartsense flex id...

Re: smartsense view doesn't work

Re: LDAP Integration for SmartSense Zeppelin Dashb...

Re: Smartsense recommendations format

Re: SmartSense bundle upload failed

Re: smartsense hdfs dashboard connection issue

Re: New cluster : SmartSense / Activity Analyzer w...

Re: Are there any node performance implications of...

Re: Smartsense 1.3 - quick links missing

Re: Smartsense 1.3 - quick links missing

Re: Capacity Scheduler statistics

Re: Did they remove download bundle option from Sm...

Re: Smartsense recommendation for Namenode Metadat...

Re: Smartsense recommendation for Namenode Metadat...

Re: is it safe editing hst-server.ini directly ove...

Re: is it safe editing hst-server.ini directly ove...

Re: Did they remove download bundle option from Sm...

Re: jetty-util-6.1.26.hwx.jar

Re: Ambari server using IP address instead of FQDN

Ambari server using IP address instead of FQDN