Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

socket timeout exception in HDP 3.1 and ADLS gen1 and Hive query

Highlighted

socket timeout exception in HDP 3.1 and ADLS gen1 and Hive query

New Contributor

Hi,


I used HIVE external table with HDP 3.1.0 (Cloudbreak) and ADLS gen1 (hadoop-azure-datalake-3.1.0.3.0.0.0-1634.jar + azure-data-lake-store-sdk-2.2.7.jar)

I’ve coded a java application in charge to write in ADLS.

My HIVE queries (select * …) encountered a socket timeout like:


19/04/18 07:22:15 DEBUG store.HttpTransport: HTTPRequest,Failed,cReqId:xxxxxxx-xxxxx-xxxx-xxxx-xxxxxxxx.0,lat:9010,err:java.net.SocketTimeoutException,Reqlen:0,Resplen:0,token_ns:3800,sReqId:null,path:/myrootpath/ds102/rawdata/ds102_0.blob,qp:op=OPEN&filesessionid=xxxxxxxx-xxxxx-xxxx-xxxx-xxxxxxxx&length=4194304&read=true&api-version=2017-08-01


It seems Microsoft Azure had fixed the issue with azure-data-lake-store-sdk-2.3.4.jar

Does Hortonworks plans to embed azure-data-lake-store-sdk-2.3.4.jar?

Otherwise, How may I do it by myself?


Kind regards,

François.