Hi,   I'm running a POC on AWS using CDH 5.7.2. I have created and configure a simple environment using Cloudera Director as follow : Cloudera manager 1 x Master 3 x Workers 1 x Gateway All the 6 instances are m3.xlarge instance type. The installation is smooth and straight foward using cloudera director. After running my jobs for the POC, I stop the cluster from cloudera manager and then stop the instances on EC2 dashboard.   When I restart the instances and the cluster, I always get the following error in various order : Bad : 659 missing blocks in the cluster. 986 total blocks in the cluster. Percentage missing blocks: 66.84%. Critical threshold: any.   Bad : 659 under replicated blocks in the cluster. 986 total blocks in the cluster. Percentage under replicated blocks: 66.84%. Critical threshold: 40.00%.   Event Server Down (I have to manually start) Exception while getting fetch configDefaults hash: none java.net.ConnectException: Connection refused Failed to publish event: SimpleEvent{attributes={STACKTRACE=[java.net.ConnectExcepion: Connection refused ERROR com.cloudera.cmf.eventcatcher.server.EventCatcherService Could not fetch descriptor after 5 tries, exiting.   Host monitor Down (I have to manually start)   I consistantly reproduce these errors for every fresh installations I have done: - At first, all green light - After stopping the cluster/instances and restarting these errors occur   Is there anything wrong with the approach I use to stop & start my cluster ? I've started googling a bit around the missing block issue and understant that it may be related to corrupted files. How to prevent this issue from happening ? Any best practices are welcomed...   I've realized that I'm spending more than half of my time actually fixing the environment instead of focusing on my POC.   Thanks     ... View more

Hi,   I have successfully created a table in Hive by ingesting a CSV file, but I cannot query this table with Impala which does not recognize the column with the data type "date": Create table elections ( id string, name string, dt date) row format delimited fields terminated by ',' stored as textfile; LOAD DATA LOCAL INPATH "/home/cloudera/datasets/vox/elections.csv" overwrite INTO TABLE elections ; I was able to successfully query that table in hive. Below the result of describe within each query editor: HIVE   IMPALA   Would you be able to explain that difference ? I'm using Hive version 1.1.0 and Impala version 2.3.0   Thanks ... View more