@aakulov - Did you get a chance to look at this one ? See anything concerning? ... View more

It was found to have multiple inconsistencies on hbase which were fixed yesterday. So dont see this for now. This could also be due to following message on HBASE master (this message wasn't there before repair/fix which was performed) -    The Load Balancer is not enabled which will eventually cause performance degradation in HBase as Regions will not be distributed across all RegionServers. The balancer is only expected to be disabled during rolling upgrade scenarios.   Question - Seems this is triggered by balance_switch flag on hbase. What's the best practice for this on production environment? is it supposed to be true or false? Kindly advise.   ... View more

I tried to grep for 'user' or 'host in all configs under /etc/hadoop/conf.cloudera.hdfs and dont see any reference for that. Any direction here would be certainly helpful Wondering if it could be due to following kerberos property -    <property> <name>dfs.namenode.kerberos.principal</name> <value>hdfs/_HOST@MOB.NUANCE.COM</value> </property> ... View more

Which config this could be ? I can share more logs if you’d like to see. This started coming after I added 6 nodes to scale. ... View more

Any response on this would be highly appreciated. ... View more

i got the output. Thanks very much for all your help, ... View more

Thanks so much for your prompt reply. I ran the suggested command but i see size as 0 whereas i know it has some data. So what does that mean?   hive> describe extended bee_master_20170113_010001 > ; OK entity_id string account_id string bill_cycle string entity_type string col1 string col2 string col3 string col4 string col5 string col6 string col7 string col8 string col9 string col10 string col11 string col12 string Detailed Table Information Table(tableName:bee_master_20170113_010001, dbName:default, owner:sagarpa, createTime:1484297904, lastAccessTime:0, retention:0, sd:StorageDescriptor(cols:[FieldSchema(name:entity_id, type:string, comment:null), FieldSchema(name:account_id, type:string, comment:null), FieldSchema(name:bill_cycle, type:string, comment:null), FieldSchema(name:entity_type, type:string, comment:null), FieldSchema(name:col1, type:string, comment:null), FieldSchema(name:col2, type:string, comment:null), FieldSchema(name:col3, type:string, comment:null), FieldSchema(name:col4, type:string, comment:null), FieldSchema(name:col5, type:string, comment:null), FieldSchema(name:col6, type:string, comment:null), FieldSchema(name:col7, type:string, comment:null), FieldSchema(name:col8, type:string, comment:null), FieldSchema(name:col9, type:string, comment:null), FieldSchema(name:col10, type:string, comment:null), FieldSchema(name:col11, type:string, comment:null), FieldSchema(name:col12, type:string, comment:null)], location:hdfs://cmilcb521.amdocs.com:8020/user/insighte/bee_data/bee_run_20170113_010001, inputFormat:org.apache.hadoop.mapred.TextInputFormat, outputFormat:org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat, compressed:false, numBuckets:-1, serdeInfo:SerDeInfo(name:null, serializationLib:org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe, parameters:{field.delim= , serialization.format= Time taken: 0.328 seconds, Fetched: 18 row(s) hive> describe formatted bee_master_20170113_010001 > ; OK # col_name data_type comment entity_id string account_id string bill_cycle string entity_type string col1 string col2 string col3 string col4 string col5 string col6 string col7 string col8 string col9 string col10 string col11 string col12 string # Detailed Table Information Database: default Owner: sagarpa CreateTime: Fri Jan 13 02:58:24 CST 2017 LastAccessTime: UNKNOWN Protect Mode: None Retention: 0 Location: hdfs://cmilcb521.amdocs.com:8020/user/insighte/bee_data/bee_run_20170113_010001 Table Type: EXTERNAL_TABLE Table Parameters: COLUMN_STATS_ACCURATE false EXTERNAL TRUE numFiles 0 numRows -1 rawDataSize -1 totalSize 0 transient_lastDdlTime 1484297904 # Storage Information SerDe Library: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe InputFormat: org.apache.hadoop.mapred.TextInputFormat OutputFormat: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat Compressed: No Num Buckets: -1 Bucket Columns: [] Sort Columns: [] Storage Desc Params: field.delim \t serialization.format \t Time taken: 0.081 seconds, Fetched: 48 row(s) hive> describe formatted bee_ppv; OK # col_name data_type comment entity_id string account_id string bill_cycle string ref_event string amount double ppv_category string ppv_order_status string ppv_order_date timestamp # Detailed Table Information Database: default Owner: sagarpa CreateTime: Thu Dec 22 12:56:34 CST 2016 LastAccessTime: UNKNOWN Protect Mode: None Retention: 0 Location: hdfs://cmilcb521.amdocs.com:8020/user/insighte/bee_data/tables/bee_ppv Table Type: EXTERNAL_TABLE Table Parameters: COLUMN_STATS_ACCURATE true EXTERNAL TRUE numFiles 0 numRows 0 rawDataSize 0 totalSize 0 transient_lastDdlTime 1484340138 # Storage Information SerDe Library: org.apache.hadoop.hive.ql.io.parquet.serde.ParquetHiveSerDe InputFormat: org.apache.hadoop.hive.ql.io.parquet.MapredParquetInputFormat OutputFormat: org.apache.hadoop.hive.ql.io.parquet.MapredParquetOutputFormat Compressed: No Num Buckets: -1 Bucket Columns: [] Sort Columns: [] Storage Desc Params: field.delim \t serialization.format \t Time taken: 0.072 seconds, Fetched: 40 row(s) ... View more