Member since
05-04-2017
7
Posts
0
Kudos Received
0
Solutions
09-10-2019
06:19 PM
I am using hive.
... View more
09-10-2019
06:19 PM
Its hive. Let me know in case of any questions?
... View more
09-10-2019
12:44 PM
I am joining two tables with where clause on partition column. My partition column is date field. SO if i join based on range of date then it gives below error else If i have only date in partition column it runs fine. SELECT FROM TableA as a left join TableB as b on a.hibtn = b.amtran and a.businesseffectivedate = b.businesseffectivedate where a.businesseffectivedate between '2019-02-01' and '2019-02-28' and b.businesseffectivedate between '2019-02-01' and '2019-02-28' Above query fails with [Code: 0, SQL State: ] java.lang.AssertionError: No work found for tablescan TS[14053510] Error. SELECT FROM TableA as a left join TableB as b on a.hibtn = b.amtran and a.businesseffectivedate = b.businesseffectivedate where a.businesseffectivedate = '2019-02-01' and b.businesseffectivedate = '2019-02-01' Above query runs fine. Any idea on tablescan error?
... View more
Labels:
- Labels:
-
Apache Hive
07-31-2018
02:44 PM
How to capture the return code of the Beeline command that I am executing within a Shell Script. Like Below: beeline -u $Beeline -e "ALTER TABLE DROP if exists partition (date='');" I want to capture the status of above query with in shell script. Thanks AG
... View more
Labels:
- Labels:
-
Apache Hive
05-04-2017
07:52 AM
Here is DDL create table if not exists <TABLENAME> (
audit_crz_create_ts timestamp comment "audit trail CRZ load timestamp",
zpctyp string comment "code type",
zpfcod string comment "currency code",
zp_sg079 string comment "filler",
zplang string comment "language code",
zp_sg080 string comment "filler",
zpfdes string comment "currency description",
zpfdec int comment "no.of decimal places",
zp_sg223 string comment "filler",
f_d_cc string comment "delete code",
f_r_cc string comment "record id")
partitioned by (businesseffectivedate date)
row format delimited
fields terminated by '\t'
lines terminated by '\n'
stored as orc
location '/data/crz/bb5g/con/<TABLENAME>/';
... View more
05-04-2017
06:17 AM
From unix I am geting below error: Failed with exception java.io.IOException:org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassCastException: org.apache.hadoop.hive.serde2.io.HiveVarcharWritable cannot be cast to org.apache.hadoop.io.Text
... View more
05-04-2017
05:28 AM
After loading the ORC file to Hive table, My select * query gets aborted with below error: Fetching results ran into the following error(s): Bad status for request TFetchResultsReq(fetchType=0, operationHandle=TOperationHandle(hasResultSet=True, modifiedRowCount=None, operationType=0, operationId=THandleIdentifier(secret='f\xfa\xf32\xd1KB\xbb\xb9\t\xe8\x1c\xd1\x01\xa5\xf2', guid=')\x17\r4\x7f D\xcf\xa0Z\xff\x8a70\xaa\x93')), orientation=4, maxRows=100): TFetchResultsResp(status=TStatus(errorCode=0, errorMessage='java.io.IOException: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassCastException', sqlState=None, infoMessages=['*org.apache.hive.service.cli.HiveSQLException:java.io.IOException: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassCastException:25:24', 'org.apache.hive.service.cli.operation.SQLOperation:getNextRowSet:SQLOperation.java:352', 'org.apache.hive.service.cli.operation.OperationManager:getOperationNextRowSet:OperationManager.java:221', 'org.apache.hive.service.cli.session.HiveSessionImpl:fetchResults:HiveSessionImpl.java:707', 'sun.reflect.GeneratedMethodAccessor45:invoke::-1', 'sun.reflect.DelegatingMethodAccessorImpl:invoke:DelegatingMethodAccessorImpl.java:43', 'java.lang.reflect.Method:invoke:Method.java:606', 'org.apache.hive.service.cli.session.HiveSessionProxy:invoke:HiveSessionProxy.java:78', 'org.apache.hive.service.cli.session.HiveSessionProxy:access$000:HiveSessionProxy.java:36', 'org.apache.hive.service.cli.session.HiveSessionProxy$1:run:HiveSessionProxy.java:63', 'java.security.AccessController:doPrivileged:AccessController.java:-2', 'javax.security.auth.Subject:doAs:Subject.java:415', 'org.apache.hadoop.security.UserGroupInformation:doAs:UserGroupInformation.java:1692', 'org.apache.hive.service.cli.session.HiveSessionProxy:invoke:HiveSessionProxy.java:59', 'com.sun.proxy.$Proxy45:fetchResults::-1', 'org.apache.hive.service.cli.CLIService:fetchResults:CLIService.java:454', 'org.apache.hive.service.cli.thrift.ThriftCLIService:FetchResults:ThriftCLIService.java:672', 'org.apache.hive.service.cli.thrift.TCLIService$Processor$FetchResults:getResult:TCLIService.java:1553', 'org.apache.hive.service.cli.thrift.TCLIService$Processor$FetchResults:getResult:TCLIService.java:1538', 'org.apache.thrift.ProcessFunction:process:ProcessFunction.java:39', 'org.apache.thrift.TBaseProcessor:process:TBaseProcessor.java:39', 'org.apache.hadoop.hive.thrift.HadoopThriftAuthBridge$Server$TUGIAssumingProcessor:process:HadoopThriftAuthBridge.java:692', 'org.apache.thrift.server.TThreadPoolServer$WorkerProcess:run:TThreadPoolServer.java:285', 'java.util.concurrent.ThreadPoolExecutor:runWorker:ThreadPoolExecutor.java:1145', 'java.util.concurrent.ThreadPoolExecutor$Worker:run:ThreadPoolExecutor.java:615', 'java.lang.Thread:run:Thread.java:745', '*java.io.IOException:org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassCastException:27:2', 'org.apache.hadoop.hive.ql.exec.FetchTask:fetch:FetchTask.java:154', 'org.apache.hadoop.hive.ql.Driver:getResults:Driver.java:1720', 'org.apache.hive.service.cli.operation.SQLOperation:getNextRowSet:SQLOperation.java:347', '*org.apache.hadoop.hive.ql.metadata.HiveException:java.lang.ClassCastException:34:7', 'org.apache.hadoop.hive.ql.exec.ListSinkOperator:process:ListSinkOperator.java:93', 'org.apache.hadoop.hive.ql.exec.Operator:forward:Operator.java:838', 'org.apache.hadoop.hive.ql.exec.SelectOperator:process:SelectOperator.java:88', 'org.apache.hadoop.hive.ql.exec.Operator:forward:Operator.java:838', 'org.apache.hadoop.hive.ql.exec.TableScanOperator:process:TableScanOperator.java:97', 'org.apache.hadoop.hive.ql.exec.FetchOperator:pushRow:FetchOperator.java:425', 'org.apache.hadoop.hive.ql.exec.FetchOperator:pushRow:FetchOperator.java:417', 'org.apache.hadoop.hive.ql.exec.FetchTask:fetch:FetchTask.java:140', '*java.lang.ClassCastException:null:0:-1'], statusCode=3), results=None, hasMoreRows=None)
... View more
Labels:
- Labels:
-
Apache Hive