Hello, I am facing a a lot of issue in running Cloudera Managemment Service and Cloudera Quickstart services.I have given 8GB RAM but still the service and host monitior fails frequently. The services running on my VM are: 1. Flume 2. HDFS 3. Kafka 4. Spark 5. Sqoop 1 Client 6. Sqoop 2 7. YARN (MR2) 8. Zookeeper For about 5 minutes it's up and the signals are green, then gradually it changes to yellow and then complete red. What to do? How to make it up running every time? I have given enough memory to each and evrey service. Please suggest me. What am I doing wrong. The error messages I get are " Failed to connect the cloudera host", "Failed to start the service and host monitor". Please help me. How can I proceed with my project if these services are not running properly. I am stuck. ... View more

Hello, I am unable to find the "Flume " parcel in CDH 5.7.0. When I type flume-ng help, I get the required output that I should get if flume is intalled in my PC. [cloudera@quickstart ~]$ flume-ng help Usage: /usr/lib/flume-ng/bin/flume-ng <command> [options]... commands: help display this help text agent run a Flume agent avro-client run an avro Flume client version show Flume version info global options: --conf,-c <conf> use configs in <conf> directory --classpath,-C <cp> append to the classpath --dryrun,-d do not actually start Flume, just print the command --plugins-path <dirs> colon-separated list of plugins.d directories. See the plugins.d section in the user guide for more details. Default: $FLUME_HOME/plugins.d -Dproperty=value sets a Java system property value -Xproperty=value sets a Java -X option agent options: --name,-n <name> the name of this agent (required) --conf-file,-f <file> specify a config file (required if -z missing) --zkConnString,-z <str> specify the ZooKeeper connection to use (required if -f missing) --zkBasePath,-p <path> specify the base path in ZooKeeper for agent configs --no-reload-conf do not reload config file if changed --help,-h display help text avro-client options: --rpcProps,-P <file> RPC client properties file with server connection params --host,-H <host> hostname to which events will be sent --port,-p <port> port of the avro source --dirname <dir> directory to stream to avro source --filename,-F <file> text file to stream to avro source (default: std input) --headerFile,-R <file> File containing event headers as key/value pairs on each new line --help,-h display help text Either --rpcProps or both --host and --port must be specified. Note that if <conf> directory is specified, then it is always included first in the classpath. But how to add and start it as a service in Cloudera manager as kafka. I don't understand wherher I need the flume to be started as a service or it will be enough to just install it? When I check the status of flume from terminal: [cloudera@quickstart ~]$ sudo service flume-ng-agent status Flume NG agent is not running [FAILED] So should I add it as a service in CM or not? If yes then how? Please suggest me. ... View more

Hello, I am confused for why my CM is showing error and no results of any charts. It was working fine till yesterday and today morning it stopped unexpectedly. The error I am getting is: Request to the Service Monitor failed. This may cause slow page responses. View the status of the Service Monitor. Request to the Host Monitor failed. This may cause slow page responses. View the status of the Host Monitor. I have assigned 8GB of RAM and 2 processors to my VM. My Cloudera configuration shows: Cloudera QuickStart ZooKeeper: Service zookeeper has 1 Server. Cloudera suggests at least 3 Servers for ZooKeeper. Suppress...   HDFS: Service hdfs has 1 DataNode. Cloudera suggests at least 3 DataNodes for HDFS. Suppress...   HDFS: Java Heap Size of NameNode in Bytes Suppress... Java Heap Size of NameNode in Bytes is recommended to be at least 1GB for every million HDFS blocks. Suggested minimum value: 4294967296 Kafka: Java Heap Size of Broker Suppress... 50 is less than the recommended minimum of 256. quickstart.cloudera: Memory Overcommit Validation Threshold Suppress... Memory on host quickstart.cloudera is overcommitted. The total memory allocation is 13.7 GiB bytes but there are only 3.7 GiB bytes of RAM (766.5 MiB bytes of which are reserved for the system). Visit the Resources tab on the Host page for allocation details. Reconfigure the roles on the host to lower the overall memory allocation. Note: Java maximum heap sizes are multiplied by 1.3 to approximate JVM overhead. quickstart.cloudera: Package installs detected on host with parcels Suppress... Parcels are in use, but packages were also detected. Cloudera Manager recommends removing the packages. Components affected: crunch,flume-ng,hadoop,hadoop-0.20-mapreduce,hadoop-hdfs,hadoop-httpfs,hadoop-kms,hadoop-mapreduce,hadoop-yarn,hbase,hbase-solr,hive,hive-hcatalog,hue,hue-common,impala,llama,oozie,parquet,pig,sentry,solr,spark,sqoop,sqoop2,zookeeper. Other Cloudera Management Service: Java Heap Size of Service Monitor in Bytes Suppress... The recommended heap size is 1.0 GiB bytes, 768.0 MiB more than is configured. Cloudera Management Service: Maximum Non-Java Memory of Service Monitor Suppress... The recommended non-Java memory size is 1.5 GiB, 768.0 MiB more than is configured. Cloudera Management Service: Java Heap Size of Host Monitor in Bytes Suppress... The recommended heap size is 1.0 GiB bytes, 768.0 MiB more than is configured. Cloudera Management Service: Maximum Non-Java Memory of Host Monitor Suppress... The recommended non-Java memory size is 1.5 GiB, 768.0 MiB more than is configured.     I am new to Cloudera, so what should I change so that my VM will start working. Please help me. thanks for help in advance. ... View more

Hello I am new to CDH 5.7.0. Recently I started installing Kafka from Cloudera Managler using parcels. In the list of parcel Kafka was already avalable for download. I succesfully downloaded and distributed it but when I clicked on "Activate" link it shows me the following error  "CDH (5.2 and higher) parcel required for KAFKA (2.0.2-1.2.0.2.p0.5) is not available." How to resolve this? What am I doing wrong? Please suggest me, I am stuck. ... View more