Hi,   Is it technically possible to run Two Cloudera setups in a small POC cluster?   This is only to understand the technical feasibility and nothing to do with real-time use cases.   For example: We have 5 nodes with decent hardware named node 1, node 2..Node5.   If not, may i know why and where it will break?   Can we use Node 1, Node 2 as master for first cloudera setup and Node 4 and Node 5 for second clustera setup with completely different paths and port numbers?   I know it is a dump qustion but think there is something to learn     ... View more

Hi, I have below basic questions on log file location in a ideal HW cluster setup, 1. Where exactly the hadoop system log of hadop master(s) and data nodes are stored? for example, a) where can i see consolidated system logs of Name node & individual Data nodes? what is the path? can i see consolidated log on name node or should i refer both name node and data nodes? a) where can i see consolidated system logs of RM (resource mgr) & NM (Node Mgr)? what is the path? can i see consolidated log on RM & NM or should i refer both RM and NM? 2. Where exactly the hadoop application log of MR, Spark, YARN are stored? a) where can i see consolidated YARN application logs? assume that there are 100 YARN applications (Hive queries, Pig scripts etc) running in a day. Can i see all the logs on one centralized location? b) where can i see consolidated SPARK application logs? assume that there are 100 Spark applications running in a day. Can i see all the logs on one centralized location? I hear, system & application logs can be stored on HDFS? is it a default HW behavior? Apologies for this dump question. Appreciate your response. ... View more

Hi,   I have below basic questions on log file location in a ideal HW cluster setup,   1. Where exactly the hadoop system log of hadop master(s) and data nodes are stored? for example, a) where can i see consolidated system logs of Name node & individual Data nodes? what is the path? can i see consolidated log on name node or should i refer both name node and data nodes?   b) where can i see consolidated system logs of RM (resource mgr) & NM (Node Mgr)? what is the path? can i see consolidated log on RM & NM or should i refer both RM and NM?   2. Where exactly the hadoop application log of MR, Spark, YARN are stored?   a) where can i see consolidated YARN application logs? assume that there are 100 YARN applications (Hive queries, Pig scripts etc) running in a day. Can i see all the logs on one centralized location?   b) where can i see consolidated SPARK application logs? assume that there are 100 Spark applications running in a day. Can i see all the logs on one centralized location?   I hear, system & application logs can be stored on HDFS? is it a default HW behavior?   Apologies for this dump question. Appreciate your response.   ... View more

1) What are the options/tools available for Data migration from Hortonworks To Cloudera Platform?   2) What are the tools/options available for copying the scripts (Hive, Pig etc) from Hortonworks To Cloudera Platform?   3) What are the tools/options available for copying important properties (Yarn, HDFS, Hive etc) from Hortonworks To Cloudera Platform?   4) What are the tools/options available for copying Rules/Policies (like Ranger) from Hortonworks To Cloudera?   Thanks in advance ... View more