Member since
08-08-2013
3
Posts
2
Kudos Received
2
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
21309 | 10-24-2013 10:56 AM | |
2672 | 10-16-2013 11:12 AM |
10-24-2013
10:56 AM
1 Kudo
Hey Ben, In a CM-managed cluster, CM will take care of managing and deploying configurations for you (including setting custom options like this). Manually editing the config files is brittle, since CM might push new configs ontop of it. Anyway, to add custom options, search for "safety valve" in the configuration editor, and you can paste in xml directly. Note also that these two properties are specific to the client, not the datanode or NN, so you probably want to be dropping this into the "HDFS Client Configuration Safety Valve for hdfs-site.xml" box. Best, Andrew
... View more
10-16-2013
11:12 AM
1 Kudo
You could try using HttpFS, it acts as a trusted edge node between the cluster and external clients. It's basically a proxy for WebHDFS, so clients can't talk directly to the namenode / datanodes. This is lower performance, but it should be okay for 10-20GB of data. See: http://archive.cloudera.com/cdh4/cdh/4/hadoop/hadoop-hdfs-httpfs/
... View more