Member since
07-29-2013
162
Posts
8
Kudos Received
7
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
6475 | 05-06-2015 06:52 AM | |
2729 | 06-09-2014 10:51 PM | |
3806 | 01-30-2014 10:40 PM | |
3228 | 08-22-2013 12:28 AM | |
4386 | 08-18-2013 11:23 PM |
01-22-2014
04:37 AM
Hi, I'm trying to update property Alert Publisher (Default) Alerts: Mail Server Password and do get this error when clicking "save". What does it mean? Server Error The feature Operational Reports is not available.
... View more
Labels:
- Labels:
-
Cloudera Manager
12-17-2013
11:31 PM
Hi. Would like to see two tabs with lists in "Profile" tab 1. All my topic (I've created them) 2. All participated topic (all topic where I wrote a comment)
... View more
12-09-2013
10:41 AM
Hi, what property did you modify, it sohuld be cluster-wide or related only to client?
... View more
10-18-2013
03:42 AM
Hi, imagine I do have a table: CREATE TABLE partitioned_table(....) PARTITIONED BY (fulldate String) And a query: select distinct(fulldate) from partitioned_table order by fulldate desc limit 100; What would impala do? Only "virtual" (partition???) column takes place in query. Therese no need to fetch HDFS data. It looks like right now Impala does read ALL partitions and calculated DISTINCT for a virtual column (virtual=is not present in data, this is metadata-only column)
... View more
Labels:
- Labels:
-
Apache Impala
-
HDFS
10-17-2013
02:15 PM
There is a suggestion: http://www.cloudera.com/content/cloudera-content/cloudera-docs/Impala/latest/Installing-and-Using-Impala/ciiu_impala_jdbc.html Just follow the white rabbit. It works 100%. I use this tool: http://www.squirrelsql.org/ Can't say something special about your Sql Developer.
... View more
10-16-2013
11:25 PM
We do it using oozie coordinator which runc workflow: parse data, add partition, invalidate metadata. And we met another problem:) http://community.cloudera.com/t5/Interactive-Short-cycle-SQL/INVALIDATE-METADATA-suddenly-caused-javax-jdo/m-p/2353#M66 Right now it's not a tragedy, we are waiting for bug fixes.
... View more
10-16-2013
11:20 PM
It's unpredictable. It works for 24 times a day for a whole week and once it fails. Resubmitting helps. We'll wait for new version. Thanks.
... View more
10-15-2013
03:31 AM
Hi, we have partitioned table and IMPALA 1.1.1-1.p0.17 We have issue INVALIDATE METADATA on impalad instance. Application ehich uses partitioned table does send SQL queries to that imapald. Suddenly we got an exception while executing impalad (we've implemented it as java action which connects via jdbc to target imapald) Failing Oozie Launcher, Main class [mrjob.oozieaction.InvalidateMetadataAction], main() threw exception, Failed to perform Hive operation
mrjob.oozieaction.HiveOperationException: Failed to perform Hive operation
at mrjob.oozieaction.HiveOperationBase.execute(HiveOperationBase.java:49)
at mrjob.oozieaction.InvalidateMetadataAction.main(InvalidateMetadataAction.java:9)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.oozie.action.hadoop.LauncherMapper.map(LauncherMapper.java:495)
at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:50)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:417)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:332)
at org.apache.hadoop.mapred.Child$4.run(Child.java:268)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1408)
at org.apache.hadoop.mapred.Child.main(Child.java:262)
Caused by: java.sql.SQLException: IllegalStateException: MetaException(message:Got exception: org.apache.hadoop.hive.metastore.api.MetaException javax.jdo.JDOObjectNotFoundException: No such database row
FailedObject:17687[OID]org.apache.hadoop.hive.metastore.model.MSerDeInfo
NestedThrowables:
org.datanucleus.exceptions.NucleusObjectNotFoundException: No such database row)
CAUSED BY: MetaException: Got exception: org.apache.hadoop.hive.metastore.api.MetaException javax.jdo.JDOObjectNotFoundException: No such database row
FailedObject:17687[OID]org.apache.hadoop.hive.metastore.model.MSerDeInfo
NestedThrowables:
org.datanucleus.exceptions.NucleusObjectNotFoundException: No such database row
at org.apache.hive.jdbc.Utils.verifySuccess(Utils.java:159)
at org.apache.hive.jdbc.Utils.verifySuccessWithInfo(Utils.java:147)
at org.apache.hive.jdbc.HiveStatement.execute(HiveStatement.java:182)
at mrjob.oozieaction.InvalidateMetadata.doExecute(InvalidateMetadata.java:24)
at mrjob.oozieaction.HiveOperationBase.execute(HiveOperationBase.java:45)
... 14 more It was working for a week without any problem. What went wrong? We do add partition each hour so it happened one ducring 7days*24 hours, now 10 hours passed and there are no problems.
... View more
Labels:
10-15-2013
01:18 AM
Hi, we did upgrade Cloudera Manager from 4.6.3 to 4.7.2 on our UAT env. And Cloudera Manager did completely remove Java 1.6 and palced Java 1.7We are using Java 1.6.x and we don't want 1.7 because our Storm online procissing in not fully tested with java 1.7 Is there any possibility to forbid Cloudera Manager to install Java 1.7 and use existing one: 1.6.x?
... View more
Labels:
- Labels:
-
Apache Storm
-
Cloudera Manager
10-14-2013
07:33 AM
Hi, I've created partitioned table. DROP TABLE IF EXISTS TEST_HOURLY; CREATE EXTERNAL TABLE TEST_HOURLY( weight bigint, tile_id int, zone_col int, zone_row int, top_left_lon DOUBLE, top_left_lat DOUBLE, bottom_right_lon DOUBLE, bottom_right_lat DOUBLE ) PARTITIONED BY(fulldate STRING) ROW FORMAT DELIMITED FIELDS TERMINATED BY '\t' STORED AS TEXTFILE; ALTER TABLE TEST_HOURLY ADD PARTITION(fulldate='2013-10-09-07') LOCATION 'hdfs://nameservice1/derivative/stream/TEST_HOURLY/2013-10-09-07'; The I do a query: INSERT INTO TEST_HOURLY PARTITION(fulldate='2013-10-09-07') SELECT .... using impala-shell and see the respose: Inserted 150588 rows in 21.93s but partition folder hdfs://nameservice1/derivative/stream/TEST_HOURLY/2013-10-09-07 is empty 😞 Imapla did create partition under /user/hive/warehouse/fulldate=2013-10-09-07 How can I force Impala to create partition at the place I need?
... View more
Labels:
- Labels:
-
Apache Hive
-
Apache Impala
-
HDFS