Is there a way to configure a non-default replication factor for a HDFS directory such that all future files and sub-directories in that directory use that specific replication factor? Currently, we are using a work around of running a daemon process to set the replication factor for all files in the required directory. Is there a better way to do this? while true; do hdfs dfs -setrep -w 2 /tmp/ sleep 30 done I see at one point there was this JIRA https://issues.apache.org/jira/browse/HDFS-199 opened but is blocked by this JIRA [https://issues.apache.org/jira/browse/HADOOP-4771] ... View more

Is there a recommended rules engine for Hadoop? Has anyone tested Drool with Hive? The idea is to have a repository of rules, and the engine should read the rules and apply them to the data. These rules could be simple (e.g. value >10) or complex (e.g. average age is 40% greater than the standard deviation of the population). I know that I can write these rules manually in HIVE, but we would like to let the end users make changes on the rules without having us re-write the rule. ... View more

I know CB creates docker containers with HDP components to provision HDP cluster but can CB also work with a cloud infrastructure that uses Docker as Virtualization layer? ... View more

When a new Configuration group is created in Ambari and a newly added host is added to that group, I am unable to edit the settings / properties / configurations for that group. Everything is greyed out. Verified that admin user is logged in. Also tried creating a brand new configuration group as well as duplicating an existing configuration group but no luck. What else needs to be done to be able to edit the properties? I am specifically looking to change the namenode and datanode directories for HDFS. The existing nodes have /grid/[0-3] but the new node only has 1 disk thats mounted to /grid/0 so no [1-3]. ... View more