Member since
10-02-2015
37
Posts
20
Kudos Received
10
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
871 | 05-31-2017 05:05 PM | |
490 | 11-30-2016 11:26 PM | |
1597 | 10-23-2016 03:11 AM | |
386 | 10-14-2016 04:06 AM | |
2987 | 10-07-2016 07:37 AM |
08-18-2017
04:54 PM
SmartSense provides this information (and much more than this) for every job.
... View more
05-31-2017
05:11 PM
If you are referring to SmartSense data anonymization here are the details for version 1.4.0 https://docs.hortonworks.com/HDPDocuments/SS1/SmartSense-1.4.0/bk_user-guide/content/appendix_data_anonymization.html You can find similar details for other versions too from Hortonworks docs.https://docs.hortonworks.com/
... View more
05-31-2017
05:08 PM
Ohk, So you went past the installation step. Yes, in order to use SmartSense you would need a SmartSense ID and currently it is available only through support portal. So you would need a support account in order to get a SmartSense ID.
... View more
05-31-2017
05:05 PM
@Robin Dong Which version of Ambari are you using? From Ambari 2.2 onwards, SmartSense rpm/deb packages are part of Ambari repo. Are you directly connecting to public repo or do you have a local repo setup? If local, you may want to make sure that all packages from that repo are synced.
... View more
05-30-2017
06:38 PM
Do you have any special characters (probably in explorer password) ? You may want to give it a try without them.
... View more
04-12-2017
02:58 AM
1 Kudo
In the Ambari "Config" screen for "SmartSense", you should be able to see it as below. I am still curious how did it become mandatory for you as the default config is "No". How are you installing? Using UI, BluePrints, APIs?
... View more
04-11-2017
07:06 PM
1 Kudo
Flex ID is applicable if you have corresponding subscription with Hortonworks. If you don't, you sould be able to "Disable" it through "Enable Flex Subscription" option (it is disabled by default)
... View more
04-06-2017
09:56 PM
@Michael Salmon I can think for following possibilities that may result into this situations. 1. SmartSense HST server is down and needs to be started 2. The view config somehow is not pointing to correct HST server, if so that should be fixed through Ambari admin UI 3. Something else: Need to look into Ambari Server logs and hst server logs
... View more
01-25-2017
06:42 PM
1 Kudo
It's a zeppelin dashboard, so you will be able to use zeppelin auth features. Here are some references. https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.5.0/bk_zeppelin-component-guide/content/zepp-authentication.html https://community.hortonworks.com/questions/21252/zeppelin-tech-preview-with-ldap-authentication.html https://community.hortonworks.com/questions/37904/how-to-provide-user-based-authentication-in-zeppel.html
... View more
11-30-2016
11:26 PM
@David Grier that's a good ask. providing an ability to download it as csv is on our roadmap.
... View more
10-23-2016
03:11 AM
This usually means that the bundle was captured but could not be uploaded to Hortonworks for analysis. For bundle to be successfully uploaded to Hortonworks, the HST server should have internet access. If it does not, then we recommend setting up a gateway https://docs.hortonworks.com/HDPDocuments/SS1/SmartSense-1.3.0/bk_installation/content/gateway_install.html If either of these is already set up, then I would suggest looking at /var/log/hst/hst-server.log on HST Server host and if gateway is setup, /var/log/hst/hst-gateway.log on SmartSense Gateway host. The logs are very descriptive and should help you get more details on why the bundle could not be uploaded.
... View more
10-14-2016
04:06 AM
@Sunile Manjee, is your Ambari Metrics Service running ? (specifically Ambari Metric Collector)? You may want to try restarting AMS Collector and then restart Activity Explorer.
... View more
10-07-2016
07:37 AM
1 Kudo
As mentioned in the error log, you should check /var/log/smartsense-activity/activity-analyzer.log from the host where activity analyzer is running. ( Have you entered SmartSense ID? In some cases, not having valid SmartSense ID results in starting of activity analyzer/explorers. )
... View more
09-30-2016
07:18 PM
1 Kudo
SmartSense agents are passive agents and not continuously running demons. They wake up only when there is data collection need (typically once a week or on ad-hoc invocation). They only run for few minutes. They use very limited memory. The CPU utilization would depend on how many and how large logs you are collecting and number of data anonymization rules you have. But usually it is not too heavy and finishes in minutes.
... View more
09-16-2016
04:34 PM
What issue are you facing @Artem Ervits ? Is capture not starting, timing out, failing or something else?
... View more
09-16-2016
04:32 PM
1 Kudo
Quicklinks for SmartSense are available from Ambari 2.4.0 onwards. Ambari 2.2.2.0 does not have that feature. For Ambari 2.2.0 you will have to navigate to http://<activity explorer host>:9060/
... View more
06-23-2016
06:10 AM
1 Kudo
@Sri Bandaru, you can get the queue related metrics through AMS. AMS has various queue related metrics like ActiveApplications, AggregateContainersAllocated, AggregateContainersReleased, AllocatedContainers, AllocatedMB, AllocatedVCores, AppsPending, AppsSubmitted, AvailableMB, AvailableVCores, PendingContainers, PendingMB, PendingVCores, ReservedContainers, ReservedMB, ReservedVCores, running_0, running_60, running_300, running_1440 etc. This will provdie you what your are looking for. Also if you are on Ambari 2.2.2+ you will have graphana UI in AMS where you can create your dashboards for the metrics of your interest.
... View more
06-23-2016
05:58 AM
The download option is still there and not removed. If you believe that the bundle capture is completed and still you don't see an option, that could be potential bug (we have not seen it yet). In that case, plese create a support case.
... View more
06-23-2016
05:50 AM
1 Kudo
You can have additional copy for backup/redundancy purpose. SmartSense may not be recommending to remove it, but rather "move" it. As part of move, you would need to copy the metadata to new directory path and then update configurations (remove old directory path and add new directory path, this may be just confusion in words used.)
... View more
06-22-2016
07:31 PM
4 Kudos
@Anil Bagga, SmartSense recommends that you do not use root file system for storing NN or DN data/metadata. There have been numerous cases where using root fs for storing data has resulted into slowness (as multiple writes happening on same disk) and in some cases crashes due to root file system being filled up and no space to write NN metadata. That's why SmartSense recommends you to avoid these problems. So you should make sure that you are setup in such a way that you don't get into either of these situations.
... View more
05-23-2016
08:59 PM
1 Kudo
If it is not ambari managed cluster, then you must change the configs on HST server. They are auto pushed to Agents during capture. Any local changes on agents will be overwritten by server configs.
... View more
05-23-2016
08:32 PM
1 Kudo
It is not. Safer way is to change it in Ambari and restart for configurations to apply. Manual changes may get overwritten by Ambari and/or HST servers configurations.
... View more
05-19-2016
04:49 AM
2 Kudos
Sridhar, the download option is still there. However the option will appear only on successful completion of the bundle. If the bundle capture is in progress, timeout or failed, the download option is not available.
... View more
02-09-2016
07:38 PM
1 Kudo
What repo URL are you using? Try using http://repo.hortonworks.com/content/groups/public
... View more
10-06-2015
11:46 PM
Thanks for pointers. I will have customer check these configs.
... View more
10-06-2015
05:11 AM
I noticed that Ambari sever is using IP Address for Ambari server host, however everywhere else it is being used as FQDN The IP is “192.168.110.1” and fqdn is “r3r31gateway.customer.domain.com” From command-xxx.json, I see "hostname": "r3r31gateway.customer.domain.com”, And "ambari_server_host": [ "192.168.110.1" ], Just wondering, why would that happen? Why would Ambari server use IP address instead of FQDN (even when it has FQDN) Secondly, how do we fix this and make Ambari use fqdn for “ambari_server_host” instead of IP address?
... View more
Labels:
- Labels:
-
Apache Ambari
-
Hortonworks SmartSense