Member since
04-26-2017
16
Posts
1
Kudos Received
0
Solutions
02-08-2019
01:29 PM
Tim, Thanks for the suggestion. I checked the startup logs for the impalad that is complaining and looks like there are some weird permission issues which we fixed and things are looking good. However there is one thing that is puzzling me. We have impala user allocated to impala_prod LDAP group, however, there is also a local user impala allocated to local group impala on the node running impalad. When we removed scratch dirs and fired up impalad, looks like scratch dirs are created with the user from local and group from LDAP. Can this possible? - Ravi
... View more
02-07-2019
09:52 PM
Hi All, When I try to run a huge query at Impala that does a lot of aggregation & sorts, it throws up with the following error. The error is vague and of not much help. Our cluster has 32 impala daemons and all the nodes have been configured with 8 disks of 4TB each. We defined scratch directories on all the disks/nodes in Cloudera Manager. I tried looking at the logs as indicated in the error message but I couldn't find anything useful. Could not create files in any configured scratch directories (--scratch_dirs=) on backend 'data405.prod.com:22000'. See logs for previous errors that may have prevented creating or writing scratch files. Version of impala: 2.12.0-cdh5.15.0 Any pointers would be greatly helpful. Thanks, Ravi
... View more
Labels:
- Labels:
-
Apache Impala
12-29-2017
03:13 PM
Hi, A column in my table has an unix time in milliseconds. When I am trying to use from_unixtime() it is returning me null. In the documentation its mentioned that from_unixtime() handles only unix time in seconds. Any specific problem handling milliseconds? select from_unixtime(1513895588243,"yyyy-MM-dd HH:mm:ss.SSSSSS"); Result> from_unixtime(1513895588243, 'yyyy-mm-dd hh:mm:ss.ssssss') NULL I am expecting '2017-12-21 22:33:08.243000000' I wrote below query which would give me the result as expected above, select 1513895588243, cast(concat(cast(from_unixtime(CAST(1513895588243/1000 as BIGINT), 'yyyy-MM-dd HH:mm:ss') as String),'.',substr(cast(1513895588243 as String), 11, 3)) as timestamp); Result: 1513895588243 2017-12-21 22:33:08.243000000 But, the above query is not an efficient way. Is there any efficient workaround for this?
... View more
Labels:
- Labels:
-
Apache Hive
-
Apache Impala
09-07-2017
03:53 PM
Hi, I tried this in CDH 5.12 and it worked perfectly fine. I am not sure of the problem you are facing though. Thanks, Ravi
... View more
04-26-2017
08:17 PM
Hi, I am trying to install Arcadia Enterprise parcels in my cluster but facing the below error. Error for parcel ARCADIAENTERPRISE-3.3.0.0-1485371982.cdh5-el6.parcel : Hash file is not found. I am sure I have my parcels(.parcel, .parcel.sha) been placed in /opt/cloudera/parcel-repo but still facing this problem. Cluster - CDH 5.10.1
... View more
Labels:
- Labels:
-
Cloudera Manager