Hi,   when I run fsck command it shows total blocks to be 68 (avg. block size 286572 B). How can I have only 68 blocks?   [hdfs@cluster1 ~]$ hdfs fsck / Connecting to namenode via http://cluster1.abc:50070 FSCK started by hdfs (auth:SIMPLE) from /192.168.101.241 for path / at Fri Sep 25 09:51:56 EDT 2015 ....................................................................Status: HEALTHY  Total size: 19486905 B  Total dirs: 569  Total files: 68  Total symlinks: 0  Total blocks (validated): 68 (avg. block size 286572 B)  Minimally replicated blocks: 68 (100.0 %)  Over-replicated blocks: 0 (0.0 %)  Under-replicated blocks: 0 (0.0 %)  Mis-replicated blocks: 0 (0.0 %)  Default replication factor: 3  Average block replication: 1.9411764  Corrupt blocks: 0  Missing replicas: 0 (0.0 %)  Number of data-nodes: 3  Number of racks: 1 FSCK ended at Fri Sep 25 09:51:56 EDT 2015 in 41 milliseconds     The filesystem under path '/' is HEALTHY   -   This is what I get when I run hdfsadmin -repot command:   [hdfs@cluster1 ~]$ hdfs dfsadmin -report Configured Capacity: 5715220577895 (5.20 TB) Present Capacity: 5439327449088 (4.95 TB) DFS Remaining: 5439303270400 (4.95 TB) DFS Used: 24178688 (23.06 MB) DFS Used%: 0.00% Under replicated blocks: 0 Blocks with corrupt replicas: 0 Missing blocks: 0 Missing blocks (with replication factor 1): 504   -   Also, when I run hive job, it does not go beyond "Running job: job_1443147339086_0002". Could it be related?   Any suggestion?   Thank you! ... View more

Hi,   I am getting below message when I start the Hive. I just installed CDH 5.4.   from cloudera manager:   Canary test failed to create file in directory /tmp/.cloudera_health_monitoring_canary_files.   from server:   Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.server.namenode.SafeModeException): Cannot create directory /tmp/hive/hdfs/5502ca90-629f-4c7e-afd5-dada9535d15c. Name node is in safe mode. The reported blocks 404 needs additional 504 blocks to reach the threshold 0.9990 of total blocks 908. The number of live datanodes 3 has reached the minimum number 0. Safe mode will be turned off automatically once the thresholds have been reached.     How do I fix it?   Thanks! ... View more

It is always handy to search tables and column in metadata. How do I search for tables in Hive based on th column name?   I know we can do via metadata. I logged into MySQL metadata but did not find a way to search.   I saw a way to search a column name but could not find a way to relate to table name. select COLUMN_NAME from COLUMNS_V2 where column_name regexp 'repo' ; I also searched on TBLS table, but there is no column name.   Any help? ... View more