Member since
10-28-2014
82
Posts
18
Kudos Received
17
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
1342 | 07-11-2019 08:49 AM | |
4263 | 08-02-2018 12:20 PM | |
6140 | 06-19-2018 02:19 PM | |
2750 | 06-19-2018 08:32 AM | |
2599 | 12-21-2017 08:19 AM |
08-16-2019
08:17 AM
We discovered that there were sporadic network issues in the tunnel between Azure and AWS ( our director instance is in AWS). Our assumption is that this was causing transient connection issues between director and Azure instances. Declaring issue solved for now as we no longer are experiencing it.
... View more
07-18-2019
09:03 AM
From experience Director will really lag as you scale higher up. We are at 5 environments with about 40 deployments spanning thousand of nodes. Make sure you go into application.properties and increase the amount of threads for tasks. That really makes a difference from what I've been seeing.
... View more
09-20-2018
12:07 PM
I think that this log line highlights the error. PluginExceptionCondition{type=ERROR, exceptionInfo={message=Encountered AWS exception, awsErrorCode=InvalidParameterValue, awsErrorMessage=Duplicate tag key 'Name' specified.}} Are you trying to add a "Name" tag to your instances? Cloudera Altus Director uses the "Name" tag, but can be re-configured to use a different tag instead. See https://www.cloudera.com/documentation/director/latest/topics/director_aws_custom_tag_names.html for instructions on how to do so.
... View more
08-13-2018
10:30 AM
1 Kudo
Hi iasindev, For case #1, when using bootstrap-remote, most of the work is done on the associated Director server, so check the logs there for problems. It could be the same problem that surfaced in #2. In #2, the error is occurring when Director is failing to access the CDH parcel repository over https. Are you hosting your own repository, or have you customized the Director truststore to no longer include common trusted certificates? Older Director releases are available under https://archive.cloudera.com/director/ . Just drill down for your operating system to find the version you need.
... View more
07-05-2018
10:57 AM
You can find Cloudera Management Service properties here: https://www.cloudera.com/documentation/enterprise/properties/5-15-x/topics/cm_props_mgmtservice.html
... View more
06-21-2018
12:57 PM
This finally worked for me. I have no idea why the YARN job history server failed to come. After adding permissions for "mapred" (described earlier in the forums), I was able to get the YARN service up. After that, spark installation failed. After following your recommendation and updating the spark parcels in the director .conf file, the cluster came up successfully. I still have no idea how upgrading the spark versions prevented yarn from failing! Thanks!
... View more
01-02-2018
02:40 AM
This issue was down to a missing Reverse DNS Lookup Zone for the subnet deploying the Cloudera environment to. Once the Reverse Lookup Zone was created and the correct entries were added, everything succeeded.
... View more
12-21-2017
08:45 AM
Thank you for confirming this. David.
... View more
11-12-2017
10:18 PM
Just to wrap up this thread, I managed to get the cluser up and running when selecting services as "Core hadoop" only instead of "Hadoop and Impala". Then some configuration to add Impala as a service manually got me to where I wanted. /David
... View more
11-09-2017
05:17 PM
I have the beginning of Flask based REST api I was working on before my project got discontinued. I tried my best to follow the Director API routes. I'll upload it to Github and share the link here.
... View more