Member since
04-14-2015
20
Posts
2
Kudos Received
1
Solution
My Accepted Solutions
Title | Views | Posted |
---|---|---|
4836 | 11-20-2015 05:56 AM |
02-09-2017
06:59 AM
You can put the s3 credentials in the s3 URI, or you can just pass the parameters on the command line, which is what I prefer, eg: hadoop fs -Dfs.s3a.access.key="" -Dfs.s3a.secret.key="" -ls s3a://bucket-name/ Its also worth knowing that if you run the command like I have given above, it will override any other settings that are defined in the cluster config, such as core-site.xml etc.
... View more
11-22-2016
10:14 AM
All, I'm very sorry about this, but it looks like this thread got lost in the shuffle when we were preparing to release our most recent version of Cloudera Director. I haven't experienced this error myself, but perusing some of our internal scripts, you may be able to get around this by setting JAVA_HOME, potentially with a Director bootstrap script. Here's an untested example: echo "export JAVA_HOME=/your/java/location" >> /etc/profile.d/java_home_setup That being said, this question may be better suited for the Cloudera Manager forum. However, why set up Zookeeper using CM directly when you can set it up using Director itself?
... View more
05-06-2016
05:07 AM
Thanks - that worked!
... View more
04-21-2016
01:26 PM
We just fixed this - https://github.com/cloudera/hue/commit/18a114fb3aff5399ba509e130d1159375700306b will be included in Hue 3.10
... View more
04-14-2016
08:07 AM
@Javier - I don't know the exact version this was released in, but I think the JIRA that we were hitting was HDFS-7798
... View more
01-05-2016
05:19 AM
1 Kudo
bulmanp - The private_key parameter should be the contents of the private key file (in your case, the 2nd option should have worked). Here is the working code I use : f = open ( "/root/.ssh/id_rsa" , "r" ) id_rsa = f .read() #print id_rsa f .close() #passwordless certificate login apicommand = cm.host_install( user_name = "root" , private_key =id_rsa , host_names =hostIds , cm_repo_url =cm_repo_url , java_install_strategy = "NONE" , unlimited_jce = True ).wait()
... View more
12-04-2015
12:04 PM
MJ - How is the replication schedule created first using the Java API?
... View more
10-21-2015
09:55 PM
This is a bit of a dated example but here is a java tool that can do this. At one point I tested this with Oozie and it worked ok. This has been used with tools like autosys to kick off replication schedules at a specific time. BDR Action It does of course require the scheudle to already exist. Right now the tool lets you list the available schedules. In an upcoming release of CM, this replication ID should be exposed via the UI. Thanks Jeff
... View more
09-23-2015
06:25 PM
Oh, and of course deploy the YARN config
... View more
07-23-2015
05:03 AM
Thanks Michalis. I was able to get the current activated parcel by searching for the product "CDH" and selecting the one who's stage ="ACTIVATED" using the CM API.
... View more
06-03-2015
07:07 AM
Yes, I was able to fix this by using gilad's script to manually drop the hive table by doing DML against the underlying metastore database. Do note that I found a few issues with a couple of the SQL statements (as I documented above), so be sure to backup your metastore database first if you attempt this. Good luck! Cheers, dave
... View more