Thanks we'll do that. i.e. - currently we'll add the flag under init.d for the long run we'll create an alternative robust DB.   Doron ... View more

Thanks for the reply. dlo. It works. ... View more

Thanks dlo, You were correct, my service were daemons which was causing the issue. I made them to run in forground and everything just works fine.   ... View more

thanks so much !! ... View more

Hi Balta, If you want your edge node to talk to YARN, add a Yarn Gateway role to that host. If you want it to talk to Hive, add a Hive Gateway. Etc. When you deploy client configuration, it'll go to all roles of that service, including gateways. Thanks, Darren ... View more

As dlo mentioned, you need to use "Create Database" from Cloudera Manager.  You can also create it from the command line if not using Cloudera Manager.  See the following for more information:   http://www.cloudera.com/content/cloudera/en/documentation/core/latest/topics/cm_mc_oozie_service.html#cmig_topic_14_unique_1   Ben ... View more

Ah, my bad. Darren caught it. Cloudera Manager will write zoo.cfg to /var/run/cloudera-scm-agent/process/ (look for the latest director for zookeeper) ... View more

Usually /etc/ and /etc/hadoop don't have group write permissions. Not sure how they got there, but removing it seems like a good idea. ... View more

Thanks for the feedback. Glad it's all well now ... View more

Each file uses a minimum of one block entry (though that block will only be the size of the actual data).   So if you are adding 2736 folders each with 200 files that's  2736 * 200 = 547,200  blocks.   Do the folders represent some particular partitioning strategy? Can the files within a particular folder be combined into a single larger file?   Depending on your source data format, you may be better off looking at something like Kite to handle the dataset management for you. ... View more