We have an existing VPC, which uses a proxy for internet access. I have environment variables set for http_proxy and https_proxy and the python boto library is able to access the ec2 endpoint, create instances, etc. without a problem.
When I try to cloudera-director bootstrap aws.conf, it hangs for quite a while and finally gives:
Found errors in provider configuration:
* Unable to execute HTTP request: Connect to ec2.us-west-2.amazonaws.com:443 timed out
I see the error in the log file. Thinking this might be proxy related, I tried to set the java proxy properites by executing this directly:
LOG_DIR="/root/.cloudera-director/logs" /usr/lib/jvm/jre-1.7.0-openjdk.x86_64/bin/java -XX:MaxPermSize=128M -Xms256m -Xmx1g -Dlogging.config="/etc/cloudera-director-client/logback.xml" -Djava.awt.headless=true -Djava.http.proxyHost=10.163.20.5 -Djava.http.proxyPort=8080 -Djava.https.proxyHost=10.163.20.5 -Djava.https.proxyPort=8080 -jar /usr/lib64/cloudera-director/client/lib/launchpad-cli-1.0.2.jar bootstrap aws.conf --spring.config.location="/etc/cloudera-director-client/application.properties"
Unfortunately, I get the same error. Any suggestions or thoughts are appreciated.
Hi Eric -
Running with a HTTP proxy is not currently a supported configuration. I've filled an improvement request on your behalf and we will look into making this possible in a future release.
Is this proxy running on a NAT instance? There is no way to setup a subnet that will have direct internet access as a workaround?
We've just released Cloudera Director 1.1 and it can use a HTTP proxy server configured like this in application.properties:
# Fill these out to route providers through an HTTP proxy #lp.proxy.http.host: #lp.proxy.http.port: #lp.proxy.http.username: #lp.proxy.http.password: #lp.proxy.http.domain: #lp.proxy.http.workstation: #lp.proxy.http.preemptiveBasicProxyAuth: false
Let me know if I can provide more assistance.
It has nothing to do with proxy.
Why are you not using the loop interface for AWS?
If you use public addresses you will have issues with slowness, errors, etc and if you don't have nsswitch setup correctly.
I've setup a 10 node in less then an hour and works perfectly using loops.
I can help if you like.