Hi, Can we get a roadmap for when Debian 8, 9, etc will get a release from Hortonworks? I'd hate to have to switch to a different distro! Thanks! ... View more

Has anyone been using  hive.hadoop.supports.splittable.combineinputformat with Hive .10 (CDH4.3.2)  and non-indexed lzo (non-splittable) compressed files?   We recently tried out this parameter with non-indexed lzo files and at first it appeared to be great, reducing the number of mappers to read the input data and doing a great job of merging data into files that were about the size of the max input split size.   Unfortunately, it was found that results from some hive queries with this parameter in place and using non-indexed lzo file started to give different results.   Here are a couple of older Jira's that seemed to indicate we could use this parameter with non-splittable compressed files.   https://issues.apache.org/jira/browse/MAPREDUCE-1597 https://issues.apache.org/jira/browse/HIVE-2089   Perhaps this is a new bug or we did something wrong.     ... View more

Is anyone using control groups (cgroups) to manage memory on debian (squeeze or wheezy)?   If so, what version of debian and what do you think of it so far?   I'm looking into additional options to control map and reduce memory usage and control groups looks to be a great fit, especially  whenever we add Impala.   If not...any other options out there?   My main course of action now is using mapred.map.child.limit and mapred.reduce.child limit to put a lid on child JVM size and spawned processes for streaming in addition to readjusting the map and reduce slots.   YARN is some day in our future, but not soon enough.     ... View more