Try : WITH json_extract AS ( SELECT get_json_object(xml_data, '$.app.Id') AS ID, get_json_object(xml_data, '$.app.apply[0].flag') AS Flag, get_json_object(xml_data, '$.app.apply[0].Product') AS products FROM check ) SELECT ID, Flag, get_json_object(product_data, '$.Code') AS Code, get_json_object(product_data, '$.Line') AS Line, get_json_object(product_data, '$.status') AS Status FROM json_extract LATERAL VIEW OUTER EXPLODE(SPLIT(products, '},')) p AS product_data; ... View more

Try something like this :  WITH json_extract AS ( SELECT get_json_object(xml_data, '$.app.Id') AS ID, get_json_object(xml_data, '$.app.apply[0].flag') AS Flag, get_json_object(xml_data, '$.app.apply[0].Product') AS products_json FROM check ) SELECT ID, Flag, get_json_object(product_item, '$.Code') AS Code, get_json_object(product_item, '$.Line') AS Line, get_json_object(product_item, '$.status') AS Status FROM json_extract LATERAL VIEW OUTER EXPLODE(split(regexp_replace(regexp_replace(products_json, '\\[|\\]', ''), '\\}\\s*,\\s*\\{', '}|{'), '|')) p AS product_item; ... View more

@Rich_Learner could you please share your table definition?  show create table <table_name> I wanted to see if you are using textfile or json serde. Also I could try replicating the issue with that info. ... View more

@Mamun_Shaheed I just wanted to mention that if you plan to use JAAS config, then set KrbAuthType=1, else if you want the subject for krb authentication obtained automatically set the value to '0'. currently it is set to 2. ... View more

@zorrofrombrasil How are you running this job? Is it through Zeppelin or any JDBC app? The reason I ask is because I see a keep-alive query "SELECT 1" being run, so the session does not go idle. Nevertheless, this "Invalid SessionHandle" could appear if the connection has switched over to a different hiveserver2 instance. The reason could be a network glitch, or any communication drop(timeout) at the middle layer such as Load Balancer/Knox(if in use).  If we are dealing with such large data size, it is better to use a native thrift client like "beeline" that can be run in a Screen so it is not interrupted when a user closes a terminal, or shuts down the client computer.  For JDBC application, make sure SocketTimeout is disabled(value = 0), and hive.server2.idle.operation.timeout & hive.server2.idle.session.timeout are set to large values like 6hrs and 8hrs respectively in Hive configuration. ... View more

I'm 3 years late, but in case anyone else facing the same issue, try using auth='NOSASL'. Maybe the issue does not occur with newer versions. ... View more

@NagendraKumar MSCK Repair which is a DDL operation can be run through PutHiveQL processor.  For info on the classification of a Hive command, refer to  https://cwiki.apache.org/confluence/display/Hive/LanguageManual+DDL ... View more

@NagendraKumar TRUNCATE is basically a DDL operation which you can run using PutHiveQL processor. For info on the classification of a Hive command, refer to  https://cwiki.apache.org/confluence/display/Hive/LanguageManual+DDL ... View more

Do we get this error after it gets connected? Could there be a socket timeout error set at client side? I am not aware if the hive driver has a default timeout value.  Instead of ZooKeeper, could you try connecting to HS2 directly. e.g. host: "hs2 node fqdn" port: 10001 Remove serviceDiscoveryMode: 'zooKeeper', zooKeeperNamespace: 'hiveserver2' ... View more