Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Failed with exception java.io.IOException:java.io.IOException: java.lang.NullPointerException: no value for: avgObjSize

Failed with exception java.io.IOException:java.io.IOException: java.lang.NullPointerException: no value for: avgObjSize

Explorer

Hi all i am getting error in subject while i am trying to run select query

error in hue:

Bad status for request TFetchResultsReq(fetchType=0, operationHandle=TOperationHandle(hasResultSet=True, modifiedRowCount=None, operationType=0, operationId=THandleIdentifier(secret='`\x98\x8dox\xaaK$\xb5\x00\x9a\x12\xf4\xe3\xf6^', guid='\xc9o\xd5^"\x86KR\xbf\xf7\x0e4`V\x15\xb4')), orientation=4, maxRows=100): TFetchResultsResp(status=TStatus(errorCode=0, errorMessage='java.io.IOException: java.io.IOException: java.lang.NullPointerException: no value for: avgObjSize', sqlState=None, infoMessages=['*org.apache.hive.service.cli.HiveSQLException:java.io.IOException: java.io.IOException: java.lang.NullPointerException: no value for: avgObjSize:25:24', 'org.apache.hive.service.cli.operation.SQLOperation:getNextRowSet:SQLOperation.java:463', 'org.apache.hive.service.cli.operation.OperationManager:getOperationNextRowSet:OperationManager.java:294', 'org.apache.hive.service.cli.session.HiveSessionImpl:fetchResults:HiveSessionImpl.java:769', 'sun.reflect.GeneratedMethodAccessor27:invoke::-1', 'sun.reflect.DelegatingMethodAccessorImpl:invoke:DelegatingMethodAccessorImpl.java:43', 'java.lang.reflect.Method:invoke:Method.java:606', 'org.apache.hive.service.cli.session.HiveSessionProxy:invoke:HiveSessionProxy.java:78', 'org.apache.hive.service.cli.session.HiveSessionProxy:access$000:HiveSessionProxy.java:36', 'org.apache.hive.service.cli.session.HiveSessionProxy$1:run:HiveSessionProxy.java:63', 'java.security.AccessController:doPrivileged:AccessController.java:-2', 'javax.security.auth.Subject:doAs:Subject.java:415', 'org.apache.hadoop.security.UserGroupInformation:doAs:UserGroupInformation.java:1917', 'org.apache.hive.service.cli.session.HiveSessionProxy:invoke:HiveSessionProxy.java:59', 'com.sun.proxy.$Proxy30:fetchResults::-1', 'org.apache.hive.service.cli.CLIService:fetchResults:CLIService.java:462', 'org.apache.hive.service.cli.thrift.ThriftCLIService:FetchResults:ThriftCLIService.java:694', 'org.apache.hive.service.cli.thrift.TCLIService$Processor$FetchResults:getResult:TCLIService.java:1553', 'org.apache.hive.service.cli.thrift.TCLIService$Processor$FetchResults:getResult:TCLIService.java:1538', 'org.apache.thrift.ProcessFunction:process:ProcessFunction.java:39', 'org.apache.thrift.TBaseProcessor:process:TBaseProcessor.java:39', 'org.apache.hive.service.auth.TSetIpAddressProcessor:process:TSetIpAddressProcessor.java:56', 'org.apache.thrift.server.TThreadPoolServer$WorkerProcess:run:TThreadPoolServer.java:286', 'java.util.concurrent.ThreadPoolExecutor:runWorker:ThreadPoolExecutor.java:1145', 'java.util.concurrent.ThreadPoolExecutor$Worker:run:ThreadPoolExecutor.java:615', 'java.lang.Thread:run:Thread.java:745', '*java.io.IOException:java.io.IOException: java.lang.NullPointerException: no value for: avgObjSize:29:4', 'org.apache.hadoop.hive.ql.exec.FetchOperator:getNextRow:FetchOperator.java:508', 'org.apache.hadoop.hive.ql.exec.FetchOperator:pushRow:FetchOperator.java:415', 'org.apache.hadoop.hive.ql.exec.FetchTask:fetch:FetchTask.java:140', 'org.apache.hadoop.hive.ql.Driver:getResults:Driver.java:2069', 'org.apache.hive.service.cli.operation.SQLOperation:getNextRowSet:SQLOperation.java:458', '*java.io.IOException:java.lang.NullPointerException: no value for: avgObjSize:33:4', 'com.mongodb.hadoop.hive.input.HiveMongoInputFormat:getSplits:HiveMongoInputFormat.java:266', 'com.mongodb.hadoop.hive.input.HiveMongoInputFormat:getSplits:HiveMongoInputFormat.java:68', 'org.apache.hadoop.hive.ql.exec.FetchOperator:getNextSplits:FetchOperator.java:363', 'org.apache.hadoop.hive.ql.exec.FetchOperator:getRecordReader:FetchOperator.java:295', 'org.apache.hadoop.hive.ql.exec.FetchOperator:getNextRow:FetchOperator.java:446', '*java.lang.NullPointerException:no value for: avgObjSize:35:2', 'org.bson.BasicBSONObject:getInt:BasicBSONObject.java:129', 'com.mongodb.hadoop.splitter.SampleSplitter:calculateSplits:SampleSplitter.java:58', 'com.mongodb.hadoop.hive.input.HiveMongoInputFormat:getSplits:HiveMongoInputFormat.java:248'], statusCode=3), results=None, hasMoreRows=None)

error log in HS2:

2019-12-18 20:37:35,338 INFO  org.apache.hadoop.hive.ql.log.PerfLogger: [HiveServer2-Handler-Pool: Thread-94]: <PERFLOG method=compile from=org.apache.hadoop.hive.ql.Driver>
2019-12-18 20:37:35,338 INFO  org.apache.hadoop.hive.ql.Driver: [HiveServer2-Handler-Pool: Thread-94]: Compiling command(queryId=hive_20191218203737_d628721b-e695-411d-ab24-2366da85a941): USE `default`
2019-12-18 20:37:35,339 INFO  org.apache.hadoop.hive.ql.log.PerfLogger: [HiveServer2-Handler-Pool: Thread-94]: <PERFLOG method=parse from=org.apache.hadoop.hive.ql.Driver>
2019-12-18 20:37:35,339 INFO  org.apache.hadoop.hive.ql.log.PerfLogger: [HiveServer2-Handler-Pool: Thread-94]: </PERFLOG method=parse start=1576730255339 end=1576730255339 duration=0 from=org.apache.hadoop.hive.ql.Driver>
2019-12-18 20:37:35,339 INFO  org.apache.hadoop.hive.ql.log.PerfLogger: [HiveServer2-Handler-Pool: Thread-94]: <PERFLOG method=semanticAnalyze from=org.apache.hadoop.hive.ql.Driver>
2019-12-18 20:37:35,343 INFO  org.apache.hadoop.hive.ql.Driver: [HiveServer2-Handler-Pool: Thread-94]: Semantic Analysis Completed
2019-12-18 20:37:35,343 INFO  org.apache.hadoop.hive.ql.log.PerfLogger: [HiveServer2-Handler-Pool: Thread-94]: </PERFLOG method=semanticAnalyze start=1576730255339 end=1576730255343 duration=4 from=org.apache.hadoop.hive.ql.Driver>
2019-12-18 20:37:35,343 INFO  org.apache.hadoop.hive.ql.Driver: [HiveServer2-Handler-Pool: Thread-94]: Returning Hive schema: Schema(fieldSchemas:null, properties:null)
2019-12-18 20:37:35,343 INFO  org.apache.hadoop.hive.ql.log.PerfLogger: [HiveServer2-Handler-Pool: Thread-94]: </PERFLOG method=compile start=1576730255338 end=1576730255343 duration=5 from=org.apache.hadoop.hive.ql.Driver>
2019-12-18 20:37:35,344 INFO  org.apache.hadoop.hive.ql.log.PerfLogger: [HiveServer2-Handler-Pool: Thread-94]: </PERFLOG method=compile start=1576730255338 end=1576730255344 duration=6 from=org.apache.hadoop.hive.ql.Driver>
2019-12-18 20:37:35,344 INFO  org.apache.hadoop.hive.ql.Driver: [HiveServer2-Handler-Pool: Thread-94]: Completed compiling command(queryId=hive_20191218203737_d628721b-e695-411d-ab24-2366da85a941); Time taken: 0.005 seconds
2019-12-18 20:37:35,344 INFO  org.apache.hadoop.hive.ql.log.PerfLogger: [HiveServer2-Handler-Pool: Thread-94]: <PERFLOG method=Driver.run from=org.apache.hadoop.hive.ql.Driver>
2019-12-18 20:37:35,344 INFO  org.apache.hadoop.hive.ql.log.PerfLogger: [HiveServer2-Handler-Pool: Thread-94]: <PERFLOG method=TimeToSubmit from=org.apache.hadoop.hive.ql.Driver>
2019-12-18 20:37:35,344 INFO  org.apache.hadoop.hive.ql.log.PerfLogger: [HiveServer2-Handler-Pool: Thread-94]: <PERFLOG method=acquireReadWriteLocks from=org.apache.hadoop.hive.ql.Driver>
2019-12-18 20:37:35,345 INFO  org.apache.hadoop.hive.ql.log.PerfLogger: [HiveServer2-Handler-Pool: Thread-94]: </PERFLOG method=acquireReadWriteLocks start=1576730255344 end=1576730255345 duration=1 from=org.apache.hadoop.hive.ql.Driver>
2019-12-18 20:37:35,345 INFO  org.apache.hadoop.hive.ql.log.PerfLogger: [HiveServer2-Handler-Pool: Thread-94]: <PERFLOG method=Driver.execute from=org.apache.hadoop.hive.ql.Driver>
2019-12-18 20:37:35,345 INFO  org.apache.hadoop.hive.ql.Driver: [HiveServer2-Handler-Pool: Thread-94]: Executing command(queryId=hive_20191218203737_d628721b-e695-411d-ab24-2366da85a941): USE `default`
2019-12-18 20:37:35,345 INFO  org.apache.hadoop.hive.ql.log.PerfLogger: [HiveServer2-Handler-Pool: Thread-94]: </PERFLOG method=TimeToSubmit start=1576730255344 end=1576730255345 duration=1 from=org.apache.hadoop.hive.ql.Driver>
2019-12-18 20:37:35,345 INFO  org.apache.hadoop.hive.ql.log.PerfLogger: [HiveServer2-Handler-Pool: Thread-94]: <PERFLOG method=runTasks from=org.apache.hadoop.hive.ql.Driver>
2019-12-18 20:37:35,345 INFO  org.apache.hadoop.hive.ql.Driver: [HiveServer2-Handler-Pool: Thread-94]: Starting task [Stage-0:DDL] in serial mode
2019-12-18 20:37:35,352 INFO  org.apache.hadoop.hive.ql.log.PerfLogger: [HiveServer2-Handler-Pool: Thread-94]: </PERFLOG method=runTasks start=1576730255345 end=1576730255352 duration=7 from=org.apache.hadoop.hive.ql.Driver>
2019-12-18 20:37:35,352 INFO  org.apache.hadoop.hive.ql.log.PerfLogger: [HiveServer2-Handler-Pool: Thread-94]: </PERFLOG method=Driver.execute start=1576730255345 end=1576730255352 duration=7 from=org.apache.hadoop.hive.ql.Driver>
2019-12-18 20:37:35,352 INFO  org.apache.hadoop.hive.ql.Driver: [HiveServer2-Handler-Pool: Thread-94]: Completed executing command(queryId=hive_20191218203737_d628721b-e695-411d-ab24-2366da85a941); Time taken: 0.007 seconds
2019-12-18 20:37:35,352 INFO  org.apache.hadoop.hive.ql.Driver: [HiveServer2-Handler-Pool: Thread-94]: OK
2019-12-18 20:37:35,352 INFO  org.apache.hadoop.hive.ql.log.PerfLogger: [HiveServer2-Handler-Pool: Thread-94]: <PERFLOG method=releaseLocks from=org.apache.hadoop.hive.ql.Driver>
2019-12-18 20:37:35,352 INFO  org.apache.hadoop.hive.ql.log.PerfLogger: [HiveServer2-Handler-Pool: Thread-94]: </PERFLOG method=releaseLocks start=1576730255352 end=1576730255352 duration=0 from=org.apache.hadoop.hive.ql.Driver>
2019-12-18 20:37:35,352 INFO  org.apache.hadoop.hive.ql.log.PerfLogger: [HiveServer2-Handler-Pool: Thread-94]: </PERFLOG method=Driver.run start=1576730255344 end=1576730255352 duration=8 from=org.apache.hadoop.hive.ql.Driver>
2019-12-18 20:37:35,363 INFO  org.apache.hive.service.cli.operation.OperationManager: [HiveServer2-Handler-Pool: Thread-94]: Closing operation: OperationHandle [opType=EXECUTE_STATEMENT, getHandleIdentifier()=cd36aefb-cc66-4d9e-a63a-7123539563e4]
2019-12-18 20:37:35,366 INFO  org.apache.hive.service.cli.operation.OperationManager: [HiveServer2-Handler-Pool: Thread-94]: Adding operation: OperationHandle [opType=EXECUTE_STATEMENT, getHandleIdentifier()=c96fd55e-2286-4b52-bff7-0e34605615b4]
2019-12-18 20:37:35,367 INFO  org.apache.hadoop.hive.ql.log.PerfLogger: [HiveServer2-Handler-Pool: Thread-94]: <PERFLOG method=compile from=org.apache.hadoop.hive.ql.Driver>
2019-12-18 20:37:35,367 INFO  org.apache.hadoop.hive.ql.Driver: [HiveServer2-Handler-Pool: Thread-94]: Compiling command(queryId=hive_20191218203737_9e2c47cd-434d-4053-b9bb-3a74bb7527cc): select * FROM movie_flix_stage.watching_ping
2019-12-18 20:37:35,368 INFO  org.apache.hadoop.hive.ql.log.PerfLogger: [HiveServer2-Handler-Pool: Thread-94]: <PERFLOG method=parse from=org.apache.hadoop.hive.ql.Driver>
2019-12-18 20:37:35,368 INFO  org.apache.hadoop.hive.ql.log.PerfLogger: [HiveServer2-Handler-Pool: Thread-94]: </PERFLOG method=parse start=1576730255368 end=1576730255368 duration=0 from=org.apache.hadoop.hive.ql.Driver>
2019-12-18 20:37:35,368 INFO  org.apache.hadoop.hive.ql.log.PerfLogger: [HiveServer2-Handler-Pool: Thread-94]: <PERFLOG method=semanticAnalyze from=org.apache.hadoop.hive.ql.Driver>
2019-12-18 20:37:35,368 INFO  org.apache.hadoop.hive.ql.parse.SemanticAnalyzer: [HiveServer2-Handler-Pool: Thread-94]: Starting Semantic Analysis
2019-12-18 20:37:35,369 INFO  org.apache.hadoop.hive.ql.parse.SemanticAnalyzer: [HiveServer2-Handler-Pool: Thread-94]: Completed phase 1 of Semantic Analysis
2019-12-18 20:37:35,369 INFO  org.apache.hadoop.hive.ql.parse.SemanticAnalyzer: [HiveServer2-Handler-Pool: Thread-94]: Get metadata for source tables
2019-12-18 20:37:35,387 INFO  org.apache.hadoop.hive.ql.parse.SemanticAnalyzer: [HiveServer2-Handler-Pool: Thread-94]: Get metadata for subqueries
2019-12-18 20:37:35,387 INFO  org.apache.hadoop.hive.ql.parse.SemanticAnalyzer: [HiveServer2-Handler-Pool: Thread-94]: Get metadata for destination tables
2019-12-18 20:37:35,431 INFO  hive.ql.Context: [HiveServer2-Handler-Pool: Thread-94]: New scratch dir is hdfs://quickstart.cloudera:8020/tmp/hive/cloudera/4650a87b-f5af-4847-a833-330ea174727f/hive_2019-12-18_20-37-35_367_5939430540576070161-2
2019-12-18 20:37:35,431 INFO  org.apache.hadoop.hive.ql.parse.SemanticAnalyzer: [HiveServer2-Handler-Pool: Thread-94]: Completed getting MetaData in Semantic Analysis
2019-12-18 20:37:35,433 INFO  org.apache.hadoop.hive.common.FileUtils: [HiveServer2-Handler-Pool: Thread-94]: Creating directory if it doesn't exist: hdfs://quickstart.cloudera:8020/tmp/hive/cloudera/4650a87b-f5af-4847-a833-330ea174727f/hive_2019-12-18_20-37-35_367_5939430540576070161-2/-mr-10000/.hive-staging_hive_2019-12-18_20-37-35_367_5939430540576070161-2
2019-12-18 20:37:35,476 INFO  org.apache.hadoop.hive.ql.ppd.OpProcFactory: [HiveServer2-Handler-Pool: Thread-94]: Processing for FS(21)
2019-12-18 20:37:35,477 INFO  org.apache.hadoop.hive.ql.ppd.OpProcFactory: [HiveServer2-Handler-Pool: Thread-94]: Processing for SEL(20)
2019-12-18 20:37:35,477 INFO  org.apache.hadoop.hive.ql.ppd.OpProcFactory: [HiveServer2-Handler-Pool: Thread-94]: Processing for TS(19)
2019-12-18 20:37:35,478 INFO  org.apache.hadoop.hive.ql.parse.SemanticAnalyzer: [HiveServer2-Handler-Pool: Thread-94]: Completed plan generation
2019-12-18 20:37:35,479 INFO  org.apache.hadoop.hive.ql.Driver: [HiveServer2-Handler-Pool: Thread-94]: Semantic Analysis Completed
2019-12-18 20:37:35,479 INFO  org.apache.hadoop.hive.ql.log.PerfLogger: [HiveServer2-Handler-Pool: Thread-94]: </PERFLOG method=semanticAnalyze start=1576730255368 end=1576730255479 duration=111 from=org.apache.hadoop.hive.ql.Driver>
2019-12-18 20:37:35,479 INFO  org.apache.hadoop.hive.ql.Driver: [HiveServer2-Handler-Pool: Thread-94]: Returning Hive schema: Schema(fieldSchemas:[FieldSchema(name:watching_ping.id, type:string, comment:null), FieldSchema(name:watching_ping.user_id, type:string, comment:null), FieldSchema(name:watching_ping.video_id, type:string, comment:null), FieldSchema(name:watching_ping.ts, type:timestamp, comment:null)], properties:null)
2019-12-18 20:37:35,480 INFO  org.apache.hadoop.hive.ql.exec.TableScanOperator: [HiveServer2-Handler-Pool: Thread-94]: Initializing Self TS[19]
2019-12-18 20:37:35,481 INFO  org.apache.hadoop.hive.ql.exec.TableScanOperator: [HiveServer2-Handler-Pool: Thread-94]: Operator 19 TS initialized
2019-12-18 20:37:35,481 INFO  org.apache.hadoop.hive.ql.exec.TableScanOperator: [HiveServer2-Handler-Pool: Thread-94]: Initializing children of 19 TS
2019-12-18 20:37:35,481 INFO  org.apache.hadoop.hive.ql.exec.SelectOperator: [HiveServer2-Handler-Pool: Thread-94]: Initializing child 20 SEL
2019-12-18 20:37:35,481 INFO  org.apache.hadoop.hive.ql.exec.SelectOperator: [HiveServer2-Handler-Pool: Thread-94]: Initializing Self SEL[20]
2019-12-18 20:37:35,481 INFO  org.apache.hadoop.hive.ql.exec.SelectOperator: [HiveServer2-Handler-Pool: Thread-94]: SELECT struct<id:string,user_id:string,video_id:string,ts:timestamp>
2019-12-18 20:37:35,481 INFO  org.apache.hadoop.hive.ql.exec.SelectOperator: [HiveServer2-Handler-Pool: Thread-94]: Operator 20 SEL initialized
2019-12-18 20:37:35,481 INFO  org.apache.hadoop.hive.ql.exec.SelectOperator: [HiveServer2-Handler-Pool: Thread-94]: Initializing children of 20 SEL
2019-12-18 20:37:35,481 INFO  org.apache.hadoop.hive.ql.exec.ListSinkOperator: [HiveServer2-Handler-Pool: Thread-94]: Initializing child 22 OP
2019-12-18 20:37:35,481 INFO  org.apache.hadoop.hive.ql.exec.ListSinkOperator: [HiveServer2-Handler-Pool: Thread-94]: Initializing Self OP[22]
2019-12-18 20:37:35,481 INFO  org.apache.hadoop.hive.ql.exec.ListSinkOperator: [HiveServer2-Handler-Pool: Thread-94]: Operator 22 OP initialized
2019-12-18 20:37:35,482 INFO  org.apache.hadoop.hive.ql.exec.ListSinkOperator: [HiveServer2-Handler-Pool: Thread-94]: Initialization Done 22 OP
2019-12-18 20:37:35,482 INFO  org.apache.hadoop.hive.ql.exec.SelectOperator: [HiveServer2-Handler-Pool: Thread-94]: Initialization Done 20 SEL
2019-12-18 20:37:35,482 INFO  org.apache.hadoop.hive.ql.exec.TableScanOperator: [HiveServer2-Handler-Pool: Thread-94]: Initialization Done 19 TS
2019-12-18 20:37:35,482 INFO  org.apache.hadoop.hive.ql.log.PerfLogger: [HiveServer2-Handler-Pool: Thread-94]: </PERFLOG method=compile start=1576730255367 end=1576730255482 duration=115 from=org.apache.hadoop.hive.ql.Driver>
2019-12-18 20:37:35,482 INFO  org.apache.hadoop.hive.ql.log.PerfLogger: [HiveServer2-Handler-Pool: Thread-94]: </PERFLOG method=compile start=1576730255367 end=1576730255482 duration=115 from=org.apache.hadoop.hive.ql.Driver>
2019-12-18 20:37:35,482 INFO  org.apache.hadoop.hive.ql.Driver: [HiveServer2-Handler-Pool: Thread-94]: Completed compiling command(queryId=hive_20191218203737_9e2c47cd-434d-4053-b9bb-3a74bb7527cc); Time taken: 0.115 seconds
2019-12-18 20:37:35,487 INFO  org.apache.hadoop.hive.ql.log.PerfLogger: [HiveServer2-Background-Pool: Thread-102]: <PERFLOG method=Driver.run from=org.apache.hadoop.hive.ql.Driver>
2019-12-18 20:37:35,487 INFO  org.apache.hadoop.hive.ql.log.PerfLogger: [HiveServer2-Background-Pool: Thread-102]: <PERFLOG method=TimeToSubmit from=org.apache.hadoop.hive.ql.Driver>
2019-12-18 20:37:35,487 INFO  org.apache.hadoop.hive.ql.log.PerfLogger: [HiveServer2-Background-Pool: Thread-102]: <PERFLOG method=acquireReadWriteLocks from=org.apache.hadoop.hive.ql.Driver>
2019-12-18 20:37:35,524 INFO  org.apache.hadoop.hive.ql.log.PerfLogger: [HiveServer2-Background-Pool: Thread-102]: </PERFLOG method=acquireReadWriteLocks start=1576730255487 end=1576730255524 duration=37 from=org.apache.hadoop.hive.ql.Driver>
2019-12-18 20:37:35,524 INFO  org.apache.hadoop.hive.ql.log.PerfLogger: [HiveServer2-Background-Pool: Thread-102]: <PERFLOG method=Driver.execute from=org.apache.hadoop.hive.ql.Driver>
2019-12-18 20:37:35,524 INFO  org.apache.hadoop.hive.ql.Driver: [HiveServer2-Background-Pool: Thread-102]: Executing command(queryId=hive_20191218203737_9e2c47cd-434d-4053-b9bb-3a74bb7527cc): select * FROM movie_flix_stage.watching_ping
2019-12-18 20:37:35,525 INFO  org.apache.hadoop.hive.ql.log.PerfLogger: [HiveServer2-Background-Pool: Thread-102]: </PERFLOG method=TimeToSubmit start=1576730255487 end=1576730255525 duration=38 from=org.apache.hadoop.hive.ql.Driver>
2019-12-18 20:37:35,525 INFO  org.apache.hadoop.hive.ql.log.PerfLogger: [HiveServer2-Background-Pool: Thread-102]: <PERFLOG method=runTasks from=org.apache.hadoop.hive.ql.Driver>
2019-12-18 20:37:35,525 INFO  org.apache.hadoop.hive.ql.log.PerfLogger: [HiveServer2-Background-Pool: Thread-102]: </PERFLOG method=runTasks start=1576730255525 end=1576730255525 duration=0 from=org.apache.hadoop.hive.ql.Driver>
2019-12-18 20:37:35,525 INFO  org.apache.hadoop.hive.ql.log.PerfLogger: [HiveServer2-Background-Pool: Thread-102]: </PERFLOG method=Driver.execute start=1576730255524 end=1576730255525 duration=1 from=org.apache.hadoop.hive.ql.Driver>
2019-12-18 20:37:35,526 INFO  org.apache.hadoop.hive.ql.Driver: [HiveServer2-Background-Pool: Thread-102]: Completed executing command(queryId=hive_20191218203737_9e2c47cd-434d-4053-b9bb-3a74bb7527cc); Time taken: 0.001 seconds
2019-12-18 20:37:35,526 INFO  org.apache.hadoop.hive.ql.Driver: [HiveServer2-Background-Pool: Thread-102]: OK
2019-12-18 20:37:35,526 INFO  org.apache.hadoop.hive.ql.log.PerfLogger: [HiveServer2-Background-Pool: Thread-102]: <PERFLOG method=releaseLocks from=org.apache.hadoop.hive.ql.Driver>
2019-12-18 20:37:35,532 INFO  org.apache.hadoop.hive.ql.log.PerfLogger: [HiveServer2-Background-Pool: Thread-102]: </PERFLOG method=releaseLocks start=1576730255526 end=1576730255532 duration=6 from=org.apache.hadoop.hive.ql.Driver>
2019-12-18 20:37:35,532 INFO  org.apache.hadoop.hive.ql.log.PerfLogger: [HiveServer2-Background-Pool: Thread-102]: </PERFLOG method=Driver.run start=1576730255487 end=1576730255532 duration=45 from=org.apache.hadoop.hive.ql.Driver>
2019-12-18 20:37:36,059 INFO  org.mongodb.driver.connection: [HiveServer2-Handler-Pool: Thread-94]: Closed connection [connectionId{localValue:18, serverValue:19}] to localhost:27017 because the pool has been closed.
2019-12-18 20:37:36,061 INFO  org.mongodb.driver.cluster: [HiveServer2-Handler-Pool: Thread-94]: Cluster created with settings {hosts=[localhost:27017], mode=SINGLE, requiredClusterType=UNKNOWN, serverSelectionTimeout='30000 ms', maxWaitQueueSize=500}
2019-12-18 20:37:36,063 INFO  org.mongodb.driver.cluster: [HiveServer2-Handler-Pool: Thread-94]: Cluster description not yet available. Waiting for 30000 ms before timing out
2019-12-18 20:37:36,065 INFO  org.mongodb.driver.connection: [cluster-ClusterId{value='5dfafe90612fed3f2a8d61d2', description='null'}-localhost:27017]: Opened connection [connectionId{localValue:19, serverValue:28}] to localhost:27017
2019-12-18 20:37:36,065 INFO  org.mongodb.driver.cluster: [cluster-ClusterId{value='5dfafe90612fed3f2a8d61d2', description='null'}-localhost:27017]: Monitor thread successfully connected to server with description ServerDescription{address=localhost:27017, type=STANDALONE, state=CONNECTED, ok=true, version=ServerVersion{versionList=[4, 2, 2]}, minWireVersion=0, maxWireVersion=8, maxDocumentSize=16777216, logicalSessionTimeoutMinutes=30, roundTripTimeNanos=415085}
2019-12-18 20:37:36,069 INFO  org.mongodb.driver.connection: [HiveServer2-Handler-Pool: Thread-94]: Opened connection [connectionId{localValue:20, serverValue:29}] to localhost:27017
2019-12-18 20:37:36,070 WARN  org.apache.hadoop.security.UserGroupInformation: [HiveServer2-Handler-Pool: Thread-94]: PriviledgedActionException as:cloudera (auth:SIMPLE) cause:org.apache.hive.service.cli.HiveSQLException: java.io.IOException: java.io.IOException: java.lang.NullPointerException: no value for: avgObjSize
2019-12-18 20:37:36,070 WARN  org.apache.hive.service.cli.thrift.ThriftCLIService: [HiveServer2-Handler-Pool: Thread-94]: Error fetching results: 
org.apache.hive.service.cli.HiveSQLException: java.io.IOException: java.io.IOException: java.lang.NullPointerException: no value for: avgObjSize
	at org.apache.hive.service.cli.operation.SQLOperation.getNextRowSet(SQLOperation.java:463)
	at org.apache.hive.service.cli.operation.OperationManager.getOperationNextRowSet(OperationManager.java:294)
	at org.apache.hive.service.cli.session.HiveSessionImpl.fetchResults(HiveSessionImpl.java:769)
	at sun.reflect.GeneratedMethodAccessor27.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at org.apache.hive.service.cli.session.HiveSessionProxy.invoke(HiveSessionProxy.java:78)
	at org.apache.hive.service.cli.session.HiveSessionProxy.access$000(HiveSessionProxy.java:36)
	at org.apache.hive.service.cli.session.HiveSessionProxy$1.run(HiveSessionProxy.java:63)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1917)
	at org.apache.hive.service.cli.session.HiveSessionProxy.invoke(HiveSessionProxy.java:59)
	at com.sun.proxy.$Proxy30.fetchResults(Unknown Source)
	at org.apache.hive.service.cli.CLIService.fetchResults(CLIService.java:462)
	at org.apache.hive.service.cli.thrift.ThriftCLIService.FetchResults(ThriftCLIService.java:694)
	at org.apache.hive.service.cli.thrift.TCLIService$Processor$FetchResults.getResult(TCLIService.java:1553)
	at org.apache.hive.service.cli.thrift.TCLIService$Processor$FetchResults.getResult(TCLIService.java:1538)
	at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39)
	at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39)
	at org.apache.hive.service.auth.TSetIpAddressProcessor.process(TSetIpAddressProcessor.java:56)
	at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:286)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
Caused by: java.io.IOException: java.io.IOException: java.lang.NullPointerException: no value for: avgObjSize
	at org.apache.hadoop.hive.ql.exec.FetchOperator.getNextRow(FetchOperator.java:508)
	at org.apache.hadoop.hive.ql.exec.FetchOperator.pushRow(FetchOperator.java:415)
	at org.apache.hadoop.hive.ql.exec.FetchTask.fetch(FetchTask.java:140)
	at org.apache.hadoop.hive.ql.Driver.getResults(Driver.java:2069)
	at org.apache.hive.service.cli.operation.SQLOperation.getNextRowSet(SQLOperation.java:458)
	... 24 more
Caused by: java.io.IOException: java.lang.NullPointerException: no value for: avgObjSize
	at com.mongodb.hadoop.hive.input.HiveMongoInputFormat.getSplits(HiveMongoInputFormat.java:266)
	at com.mongodb.hadoop.hive.input.HiveMongoInputFormat.getSplits(HiveMongoInputFormat.java:68)
	at org.apache.hadoop.hive.ql.exec.FetchOperator.getNextSplits(FetchOperator.java:363)
	at org.apache.hadoop.hive.ql.exec.FetchOperator.getRecordReader(FetchOperator.java:295)
	at org.apache.hadoop.hive.ql.exec.FetchOperator.getNextRow(FetchOperator.java:446)
	... 28 more
Caused by: java.lang.NullPointerException: no value for: avgObjSize
	at org.bson.BasicBSONObject.getInt(BasicBSONObject.java:129)
	at com.mongodb.hadoop.splitter.SampleSplitter.calculateSplits(SampleSplitter.java:58)
	at com.mongodb.hadoop.hive.input.HiveMongoInputFormat.getSplits(HiveMongoInputFormat.java:248)
	... 32 more

 

Before this error i was able to run queries but later i am facing this issue.

Don't have an account?
Coming from Hortonworks? Activate your account here