Member since
10-08-2015
87
Posts
143
Kudos Received
23
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
1031 | 03-02-2017 03:39 PM | |
4696 | 02-09-2017 06:43 PM | |
14251 | 02-04-2017 05:38 PM | |
4522 | 01-10-2017 10:24 PM | |
3561 | 01-05-2017 06:58 PM |
09-03-2019
11:19 AM
Hi, We need to review the Resource manager logs to look for the Errors if any,. Also we need to view the Resource manager webUI to check for the resource utilization and Memory utiilization in queue wise on the jobs submitted. Thanks AKR
... View more
03-02-2017
03:39 PM
1 Kudo
@eorgad To protect the S3A access/secret keys, it is recommended that you use either: IAM role-based authentication (such as EC2 instance profile), or the Hadoop Credential Provider Framework - securely storing them and accessing them through configuration. The Hadoop Credential Provider Framework allows secure "Credential Providers" to keep secrets outside Hadoop configuration files, storing them in encrypted files in local or Hadoop filesystems, and including them in requests. The Hadoop-AWS Module documentation describes how to configure this properly.
... View more
01-07-2017
05:02 PM
Thanq @Tom McCuch, Thanq so much. Sorry for late response, I have been travelling.
... View more
12-30-2016
02:25 PM
@learninghuman You can read more about Hadoop Azure Support: Azure Blob Storage in the Apache Doc for Hadoop 2.7.2. You'd need to check with the vendors behind the other distros to see whether or not they support this or not.
... View more
12-14-2016
04:05 PM
@Hedart - Does this answer help answer your questions? If so, can you please Accept my answer? If there are further questions you'd like to ask, please feel free to use @Tom McCuch when you ask them, so I get notified. Thanks. Tom
... View more
11-30-2016
02:57 PM
Thank you, Constantin!
... View more
12-18-2016
09:15 PM
@Kaliyug Antagonist I like Tom's suggestion and will it try myself. Otherwise, if you wish to create your local cluster with Vagrant: https://community.hortonworks.com/articles/39156/setup-hortonworks-data-platform-using-vagrant-virt.html I use Eclipse and Vagrant cluster. I share a folder between my local machine and the cluster where I place the output jars and then submit them for execution. I followed instructions published here: here: https://community.hortonworks.com/articles/43269/intellij-eclipse-usage-against-hdp-25-sandbox.html I am not sure why you are against of the idea to use the sandbox. The code you develop can be at most tested functionally, locally. I get it that you want more debugging capabilities locally. A true load testing still needs to happen in a full scale environment.
... View more
01-25-2017
01:56 PM
Thank you Ameet for your tips.
I am following the link @ https://community.hortonworks.com/content/kbentry/38457/credit-fraud-prevention-demo-a-guided-tour.html to set up the credit card transaction monitor application
We are trying to do the end to end demo of credit card transaction monitor app by end of this week. We tried to clone the latest code and there was a version mismatch error while building the storm topology. Latest storm code(1.x) will work with only HDP2.5 which is not available in Azure. Later I have used the git code committed on nov15 which contains the storm version(0.10.0) maps to HDP2.4.
I am able to start the transactions with the simulator jar and able to see the transactions flowing with basic details. After that I am not seeing any transactions(Transaction id,merchant type,amount,distance) in the below box after double clicking it. I have captured the screenshots of the steps which I have done.
... View more
12-23-2016
05:20 AM
1 Kudo
Thank you for your response Tom, we have used Mondrian 4 for the semantic layer and adapted it so that front end tools like Excel, Tableau & Qlik can read it. We are still in development phase, but we really like what we see thus far. @Grant Krieger
... View more