Am not sure I entirely follow your question - could you clarify on how you are imagining to arrive at a simple output of "r 4" from all of that input? The word "last key value pair" doesn't quite make sense to me. Please elaborate? ... View more

Have you looked at this possibly related thread and its resolution? http://community.cloudera.com/t5/Batch-Processing-and-Workflow/Application-master-gets-stuck-when-it-gets-more-then-half/m-p/31393#M1641 -- Is your situation different? ... View more

Glad to hear you were able to figure it out. In spirit of https://xkcd.com/979/, please mark the thread solved with the solution post selected, so others with a similar problem can find their solution quicker on the web. ... View more

Please see http://archive.cloudera.com/cdh5/cdh/5/oozie/DG_SqoopActionExtension.html: """ The Sqoop command can be specified either using the command element or multiple arg elements. When using the command element, Oozie will split the command on every space into multiple arguments. When using the arg elements, Oozie will pass each argument value as an argument to Sqoop. The arg variant should be used when there are spaces within a single argument. """ Your resolution is to transform all your command arguments into arg clauses instead, and pass the whole SQL string as a single arg to make it be seen as one element, rather than space separated args as it currently is trying to parse it as. ... View more

Did you ensure to redeploy client configuration, and restart HDFS both, after adding the KMS service and linking HDFS with it? Your client is basically complaining of a missing KMS config, but without trace logs am also unsure if its coming instead out of the NN being unable to talk to KMS, or just purely the client. ... View more

Do both of these assert the right values you've set? SHOW CURRENT ROLES; SHOW GRANT ROLE developer; If yes, then the issue can likely be that HS2 and Sentry aren't really seeing the user 'impadmin' within the group 'hadoop'. On the HS2 and Sentry Service hosts, please check/pass the output of "id -Gn impadmin" Linux command. ... View more

Yes, you can have multiple sources tied to a config name, but what you are really missing is as the log says, a channel configuration. Please configure a channel per http://archive.cloudera.com/cdh5/cdh/5/flume-ng/FlumeUserGuide.html#a-simple-example > 15/09/14 11:08:07 WARN conf.FlumeConfiguration: Agent configuration for 'agent_foo' does not contain any valid channels. Marking it as invalid. ... View more