https://community.cloudera.com/t5/Support-Questions/issue-trying-Impyla/m-p/294724#M217407 <P>Thanks, you are a genius <span class="lia-unicode-emoji" title=":slightly_smiling_face:">🙂</span> .<BR />Installing thrift-sasl-0.4.2 and impyla 0.16.2 did allow successful running of the script. However now I have a different issue. The call cursor.fetchmany(size=3) hangs indefinitely in Jupyter notebook. It executes immediately in similar pyhive script on same small table.<BR /><BR />from impala.dbapi import connect<BR />conn = connect(host='myhost', port=21050, auth_mechanism='GSSAPI', kerberos_service_name='impala')<BR />cursor = conn.cursor()<BR />cursor.execute('SELECT * FROM default.mytable LIMIT 100')<BR />cursor.fetchmany(size=3)<BR />cursor.close()<BR />conn.close()<BR /><BR />It show query status as Executing in Cloudera manager-&gt;Impala Queries monitor. But also says Query State: FINISHED in the query details .</P><P>The hang seems to be in the statement buff = self.sock.recv(sz)</P><PRE><SPAN class="ansi-green-fg">/data/opt/anaconda3/lib/python3.7/site-packages/thriftpy2/transport/socket.py</SPAN> in <SPAN class="ansi-cyan-fg">read</SPAN><SPAN class="ansi-blue-fg">(self, sz)</SPAN> <SPAN class="ansi-green-fg"> 107</SPAN> <SPAN class="ansi-green-fg">while</SPAN> <SPAN class="ansi-green-fg">True</SPAN><SPAN class="ansi-blue-fg">:</SPAN> <SPAN class="ansi-green-fg"> 108</SPAN> <SPAN class="ansi-green-fg">try</SPAN><SPAN class="ansi-blue-fg">:</SPAN> <SPAN class="ansi-green-fg">--&gt; 109</SPAN> buff <SPAN class="ansi-blue-fg">=</SPAN> self<SPAN class="ansi-blue-fg">.</SPAN>sock<SPAN class="ansi-blue-fg">.</SPAN>recv<SPAN class="ansi-blue-fg">(</SPAN>sz<SPAN class="ansi-blue-fg">)</SPAN> <SPAN class="ansi-green-fg"> 110</SPAN> <SPAN class="ansi-green-fg">except</SPAN> socket<SPAN class="ansi-blue-fg">.</SPAN>error <SPAN class="ansi-green-fg">as</SPAN> e<SPAN class="ansi-blue-fg">:</SPAN> <SPAN class="ansi-green-fg"> 111</SPAN> <SPAN class="ansi-green-fg">if</SPAN> e<SPAN class="ansi-blue-fg">.</SPAN>errno <SPAN class="ansi-blue-fg">==</SPAN> errno<SPAN class="ansi-blue-fg">.</SPAN>EINTR<SPAN class="ansi-blue-fg">:</SPAN> <SPAN class="ansi-red-fg">KeyboardInterrupt</SPAN>: </PRE><P>&nbsp;</P><P>After trying various options and setting timeout=100 in the connect statement, it appears the script queries impala table successfully but every 2nd or 3rd time it fails with the below error:</P><PRE><SPAN class="ansi-green-fg">/data/opt/anaconda3/lib/python3.7/site-packages/impala/hiveserver2.py</SPAN> in <SPAN class="ansi-cyan-fg">_rpc</SPAN><SPAN class="ansi-blue-fg">(self, func_name, request)</SPAN> <SPAN class="ansi-green-intense-fg ansi-bold"> 992</SPAN> response <SPAN class="ansi-blue-fg">=</SPAN> self<SPAN class="ansi-blue-fg">.</SPAN>_execute<SPAN class="ansi-blue-fg">(</SPAN>func_name<SPAN class="ansi-blue-fg">,</SPAN> request<SPAN class="ansi-blue-fg">)</SPAN> <SPAN class="ansi-green-intense-fg ansi-bold"> 993</SPAN> self<SPAN class="ansi-blue-fg">.</SPAN>_log_response<SPAN class="ansi-blue-fg">(</SPAN>func_name<SPAN class="ansi-blue-fg">,</SPAN> response<SPAN class="ansi-blue-fg">)</SPAN> <SPAN class="ansi-green-fg">--&gt; 994</SPAN> err_if_rpc_not_ok<SPAN class="ansi-blue-fg">(</SPAN>response<SPAN class="ansi-blue-fg">)</SPAN> <SPAN class="ansi-green-intense-fg ansi-bold"> 995</SPAN> <SPAN class="ansi-green-fg">return</SPAN> response <SPAN class="ansi-green-intense-fg ansi-bold"> 996</SPAN> <SPAN class="ansi-green-fg">/data/opt/anaconda3/lib/python3.7/site-packages/impala/hiveserver2.py</SPAN> in <SPAN class="ansi-cyan-fg">err_if_rpc_not_ok</SPAN><SPAN class="ansi-blue-fg">(resp)</SPAN> <SPAN class="ansi-green-intense-fg ansi-bold"> 746</SPAN> resp<SPAN class="ansi-blue-fg">.</SPAN>status<SPAN class="ansi-blue-fg">.</SPAN>statusCode <SPAN class="ansi-blue-fg">!=</SPAN> TStatusCode<SPAN class="ansi-blue-fg">.</SPAN>SUCCESS_WITH_INFO_STATUS <SPAN class="ansi-green-fg">and</SPAN> <SPAN class="ansi-green-intense-fg ansi-bold"> 747</SPAN> resp.status.statusCode != TStatusCode.STILL_EXECUTING_STATUS): <SPAN class="ansi-green-fg">--&gt; 748</SPAN> <SPAN class="ansi-green-fg">raise</SPAN> HiveServer2Error<SPAN class="ansi-blue-fg">(</SPAN>resp<SPAN class="ansi-blue-fg">.</SPAN>status<SPAN class="ansi-blue-fg">.</SPAN>errorMessage<SPAN class="ansi-blue-fg">)</SPAN> <SPAN class="ansi-green-intense-fg ansi-bold"> 749</SPAN> <SPAN class="ansi-green-intense-fg ansi-bold"> 750</SPAN> <SPAN class="ansi-red-fg">HiveServer2Error</SPAN>: Invalid query handle: b14cce8e19xxxx:5b51463xxxx </PRE><P>&nbsp;Any more thoughts?</P> Sat, 25 Apr 2020 03:29:40 GMT ebeb 2020-04-25T03:29:40Z