Member since
08-14-2015
14
Posts
1
Kudos Received
0
Solutions
02-08-2016
02:49 AM
Hi, I have faced a situtation of this kind where after 3 days of installation cloudera manager did not work and the root cause is /var/ file system is fully occupied. What has been done. 1) Manually deleted un necessary files in /var partition. 2) Logged in to clouderamanager web UI after successful removal of unwanted files. 3) Changed log location of few services to new partition which has full vacant space. After this, after few days there was an issue like logs were not updated properly. Root cause for the same is: We should be careful when we move the original file log location to new location. File system permissions should be owned by respective users and for example /<new partition>/log/hive should be owned by hive user but not by root user. New log location /<new partition>/log/hive was created as root user and this was an issue. @steveandbee: Are the internal log folders created automatically after cluster restart?
... View more
02-08-2016
01:47 AM
Hi, Try to check complete file system. I faced a situation of this kind and in that particular case /var file system got full and after this I moved log location to a new file system and we should not forget about file system permissions if the same is planned. Or else try to move or delete old logs which are not required.
... View more
11-12-2015
10:02 PM
Thanks for your support. Case is closed now.
... View more
11-06-2015
01:48 AM
Hi, Many thanks for the information. Is there any official web link which informs us about orc format being not supported?
... View more
11-05-2015
10:35 PM
Hi, Here is the output from hive/impala. Table is created in hive. HIVE === hive> SHOW CREATE TABLE tablename; OK CREATE TABLE `tablename`( `time` int, `instrumentationserver` string, `cid` string, `contentgroup` string, `actiontype` string, `resourcetype` string, `subresourcetype` string, `visitor` string, `useragent` string, `ipaddress` string, `measurementmethod` string, `justassigned` boolean, `robotactivity` string, `robotua` string, `pageurl` string, `referringurl` string, `targeturl` string, `duration` int, `screenresolution` string, `colordepth` string, `languagecode` string, `javaenabled` boolean, `cookieenabled` boolean, `customtags` array<struct<name:string,value:string>>, `partnertags` array<struct<name:string,value:string>>, `documenttitle` string, `homepage` boolean, `connectiontype` string, `timezoneoffset` int, `browser` string, `browserversion` string, `os` string, `osversion` string, `country` string, `region` string, `city` string, `connectionspeed` string, `latitude` float, `longitude` float, `metrocode` int, `firstevent` boolean, `cookieblocked` boolean, `clickpoint` string, `primarygroup` string, `campaign` string, `creative` string, `placement` string, `result` string, `markedresult` boolean, `revenue` float, `creativegroup` string, `streamduration` int, `adserver` int, `endpoint` int, `publisher` string, `adnetwork` string, `identity` string, `sequencenum` int, `chapter` int, `totalchapternum` int, `customtagstr` string, `donottrack` boolean, `zipcode` string, `viewabilitystatus` string, `channelasset` string, `crashidentifier` boolean, `product` string, `reportingdatadate` string, `viewtimeoffset` int, `providerlist` string, `suppressprovider` string, `forwardflag` boolean, `accessmethod` int, `encryptionidentifier` boolean, `daycd` string, `hourcd` int, `userlatitude` float, `userlongitude` float, `assetid` string, `advertiseid` string) PARTITIONED BY ( `traf_type` string, `date` string, `hh` string, `part` string) ROW FORMAT SERDE 'org.apache.hadoop.hive.ql.io.orc.OrcSerde' STORED AS INPUTFORMAT 'org.apache.hadoop.hive.ql.io.orc.OrcInputFormat' OUTPUTFORMAT 'org.apache.hadoop.hive.ql.io.orc.OrcOutputFormat' LOCATION 'hdfs://nameservice1/user/hive/warehouse/dbname.db/tablename' TBLPROPERTIES ( 'last_modified_by'='hive', 'last_modified_time'='1445934602', 'transient_lastDdlTime'='1445934602') Time taken: 0.205 seconds, Fetched: 98 row(s) hive> IMPALA ===== [impalarunning.server.org:21000] > SHOW CREATE TABLE tablename; Query: show CREATE TABLE tablename ERROR: AnalysisException: Failed to load metadata for table: dbname.tablename CAUSED BY: TableLoadingException: Unrecognized table type for table: dbname.tablename [impalarunning.server.org:21000] > Original table name is replaced by "tablename."
... View more
11-04-2015
09:14 PM
Hi Thanks for the reply. I will get back to you with the information shortly.
... View more
11-04-2015
12:18 AM
Hi Tim, Many thanks for the reply. I am trying to find out root cause of this issue and issue is present only for one table but for other tables. I am trying to find out to check if the metadata is corrupted or not. How to check the same, your help is valuable.
... View more
11-02-2015
04:01 AM
Hi,
I see below error,
Could some one please help.
[dayrhedpru007.enterprisenet.org:21000] > select * from events_census limit 2;
Query: select * from events_census limit 2
ERROR: AnalysisException: Failed to load metadata for table: agf_dev.events_census
CAUSED BY: TableLoadingException: Unrecognized table type for table: agf_dev.events_census
... View more
Labels:
- Labels:
-
Apache Hive
-
Apache Impala
08-14-2015
01:41 AM
1 Kudo
Removed any hidden files too under /tmp directory on the failed host. Use ls -al command to view hidden files Example: .scm_prepare_node.lock
... View more
08-14-2015
01:35 AM
Hi, Following has been done to get rid of the issue: 1) Aborted installation. 2) Logged in to each failed host and removed files in /tmp and retried installation on each failed host. Below is the example: rm -rf scm_prepare_node.VqVHCy66 scm_prepare_node.WjYHxBu2 scm_prepare_node.0Hk6W9O1 .scm_prepare_node.lock
... View more