Skip to main content
roshanbi
Gold ⭐️
March 28, 2022
Solved

kudu connection

Dear Team,

 

kindly advise on why connection from our CDC tools to Kudu is not working? What does KuduWriterException: End of file: unable to send message: Other end of pipe was closed (error 0) mean?

 

at java.lang.Thread.run(Thread.java:750)
com.webaction.common.exc.ConnectionException: Couldn't establish connection with Kudu ( RB-HADOOP-03.mtg.local:7051,RB-HADOOP-04.mtg.local:7051,RB-HADOOP-05.mtg.local:7051,RB-HADOOP-03.mtg.local:7051,RB-HADOOP-04.mtg.local:7051,RB-HADOOP-05.mtg.local:7051,RB-HADOOP-03.mtg.local:7051,RB-HADOOP-04.mtg.local:7051,RB-HADOOP-05.mtg.local:7051,RB-HADOOP-03.mtg.local:7051,RB-HADOOP-04.mtg.local:7051,RB-HADOOP-05.mtg.local:7051,RB-HADOOP-03.mtg.local:7051,RB-HADOOP-04.mtg.local:7051,RB-HADOOP-05.mtg.local:7051,RB-HADOOP-03.mtg.local:7051,RB-HADOOP-04.mtg.local:7051,RB-HADOOP-05.mtg.local:7051,RB-HADOOP-03.mtg.local:7051,RB-HADOOP-04.mtg.local:7051,RB-HADOOP-05.mtg.local:7051,RB-HADOOP-03.mtg.local:7051,RB-HADOOP-04.mtg.local:7051,RB-HADOOP-05.mtg.local:7051,RB-HADOOP-03.mtg.local:7051,RB-HADOOP-04.mtg.local:7051,RB-HADOOP-05.mtg.local:7051 )
at com.striim.proc.Connection.KuduWriterConnection.connect(KuduWriterConnection.java:83)
at com.striim.proc.Connection.KuduWriterConnection.<init>(KuduWriterConnection.java:44)
at com.striim.proc.Connection.KuduWriterConnection.getConnection(KuduWriterConnection.java:100)
at com.striim.proc.KuduWriter.initializeKuduClient(KuduWriter.java:224)
at com.striim.proc.KuduWriter.initWriter(KuduWriter.java:132)
at com.webaction.utils.writers.common.RetriableBaseDataStoreWriter.init(RetriableBaseDataStoreWriter.java:78)
at com.webaction.runtime.components.Target.start(Target.java:377)
at com.webaction.runtime.components.Flow.start(Flow.java:431)
at com.webaction.runtime.components.Flow.start(Flow.java:375)
at com.webaction.runtime.components.Flow.start(Flow.java:335)
at com.webaction.runtime.components.Flow$2.run(Flow.java:1612)
at java.lang.Thread.run(Thread.java:750)
com.webaction.common.exc.ConnectionException: Couldn't establish connection with Kudu ( RB-HADOOP-03.mtg.local:7051,RB-HADOOP-04.mtg.local:7051,RB-HADOOP-05.mtg.local:7051,RB-HADOOP-03.mtg.local:7051,RB-HADOOP-04.mtg.local:7051,RB-HADOOP-05.mtg.local:7051,RB-HADOOP-03.mtg.local:7051,RB-HADOOP-04.mtg.local:7051,RB-HADOOP-05.mtg.local:7051,RB-HADOOP-03.mtg.local:7051,RB-HADOOP-04.mtg.local:7051,RB-HADOOP-05.mtg.local:7051,RB-HADOOP-03.mtg.local:7051,RB-HADOOP-04.mtg.local:7051,RB-HADOOP-05.mtg.local:7051,RB-HADOOP-03.mtg.local:7051,RB-HADOOP-04.mtg.local:7051,RB-HADOOP-05.mtg.local:7051,RB-HADOOP-03.mtg.local:7051,RB-HADOOP-04.mtg.local:7051,RB-HADOOP-05.mtg.local:7051,RB-HADOOP-03.mtg.local:7051,RB-HADOOP-04.mtg.local:7051,RB-HADOOP-05.mtg.local:7051,RB-HADOOP-03.mtg.local:7051,RB-HADOOP-04.mtg.local:7051,RB-HADOOP-05.mtg.local:7051,RB-HADOOP-03.mtg.local:7051,RB-HADOOP-04.mtg.local:7051,RB-HADOOP-05.mtg.local:7051,RB-HADOOP-03.mtg.local:7051,RB-HADOOP-04.mtg.local:7051,RB-HADOOP-05.mtg.local:7051,RB-HADOOP-03.mtg.local:7051,RB-HADOOP-04.mtg.local:7051,RB-HADOOP-05.mtg.local:7051 )
at com.striim.proc.Connection.KuduWriterConnection.connect(KuduWriterConnection.java:83)
at com.striim.proc.Connection.KuduWriterConnection.<init>(KuduWriterConnection.java:44)
at com.striim.proc.Connection.KuduWriterConnection.getConnection(KuduWriterConnection.java:100)
at com.striim.proc.KuduWriter.initializeKuduClient(KuduWriter.java:224)
at com.striim.proc.KuduWriter.initWriter(KuduWriter.java:132)
at com.webaction.utils.writers.common.RetriableBaseDataStoreWriter.init(RetriableBaseDataStoreWriter.java:78)
at com.webaction.runtime.components.Target.start(Target.java:377)
at com.webaction.runtime.components.Flow.start(Flow.java:431)
at com.webaction.runtime.components.Flow.start(Flow.java:375)
at com.webaction.runtime.components.Flow.start(Flow.java:335)
at com.webaction.runtime.components.Flow$2.run(Flow.java:1612)
at java.lang.Thread.run(Thread.java:750)
com.striim.proc.exception.KuduWriterException: End of file: unable to send message: Other end of pipe was closed (error 0)
at com.striim.proc.CheckPoint.CheckpointTableImpl.checkForCheckpointTable(CheckpointTableImpl.java:133)
at com.striim.proc.CheckPoint.CheckpointTableImpl.<init>(CheckpointTableImpl.java:44)
at com.striim.proc.KuduWriter.initWriter(KuduWriter.java:152)
at com.webaction.utils.writers.common.RetriableBaseDataStoreWriter.init(RetriableBaseDataStoreWriter.java:78)
at com.webaction.runtime.components.Target.start(Target.java:377)
at com.webaction.runtime.components.Flow.start(Flow.java:431)
at com.webaction.runtime.components.Flow.start(Flow.java:375)
at com.webaction.runtime.components.Flow.start(Flow.java:335)
at com.webaction.runtime.components.Flow$2.run(Flow.java:1612)
at java.lang.Thread.run(Thread.java:750)
Command RESUME failed so application CDC.CDC_CBS_CUST_CBS_NP is put in HALTED state
com.striim.proc.exception.KuduWriterException: End of file: unable to send message: Other end of pipe was closed (error 0)
at com.striim.proc.CheckPoint.CheckpointTableImpl.checkForCheckpointTable(CheckpointTableImpl.java:133)
at com.striim.proc.CheckPoint.CheckpointTableImpl.<init>(CheckpointTableImpl.java:44)
at com.striim.proc.KuduWriter.initWriter(KuduWriter.java:152)
at com.webaction.utils.writers.common.RetriableBaseDataStoreWriter.init(RetriableBaseDataStoreWriter.java:78)
at com.webaction.runtime.components.Target.start(Target.java:377)
at com.webaction.runtime.components.Flow.start(Flow.java:431)
at com.webaction.runtime.components.Flow.start(Flow.java:375)
at com.webaction.runtime.components.Flow.start(Flow.java:335)
at com.webaction.runtime.components.Flow$2.run(Flow.java:1612)
at java.lang.Thread.run(Thread.java:750)
com.striim.proc.exception.KuduWriterException: End of file: unable to send message: Other end of pipe was closed (error 0)
at com.striim.proc.CheckPoint.CheckpointTableImpl.checkForCheckpointTable(CheckpointTableImpl.java:133)
at com.striim.proc.CheckPoint.CheckpointTableImpl.<init>(CheckpointTableImpl.java:44)
at com.striim.proc.KuduWriter.initWriter(KuduWriter.java:152)
at com.webaction.utils.writers.common.RetriableBaseDataStoreWriter.init(RetriableBaseDataStoreWriter.java:78)
at com.webaction.runtime.components.Target.start(Target.java:377)
at com.webaction.runtime.components.Flow.start(Flow.java:431)
at com.webaction.runtime.components.Flow.start(Flow.java:375)
at com.webaction.runtime.components.Flow.start(Flow.java:335)
at com.webaction.runtime.components.Flow$2.run(Flow.java:1612)

 

Thanks,

Roshan

jromero
jromeroAnswer
Gold ⭐️
March 28, 2022

Hello Roshan,

com.striim.proc.exception.KuduWriterException: End of file: unable to send message: Other end of pipe was closed (error 0)

Looks to me like a known bug discovered recently for which there is already a patch.  Seems to be related to Cloudera OPSAPS-61660.

Best bet for you would be to open a ticket with support to have it confirmed.

 

Regards,

Jason R.

3 replies

jromero
Gold ⭐️
jromeroAnswer
Gold ⭐️
March 28, 2022

Hello Roshan,

com.striim.proc.exception.KuduWriterException: End of file: unable to send message: Other end of pipe was closed (error 0)

Looks to me like a known bug discovered recently for which there is already a patch.  Seems to be related to Cloudera OPSAPS-61660.

Best bet for you would be to open a ticket with support to have it confirmed.

 

Regards,

Jason R.

Translate
roshanbi
roshanbiAuthor
Gold ⭐️
April 25, 2022

Thanks Jason. We upgraded Cloudera and issue is resolved.

Translate
VidyaSargur
Community Manager
Community Manager
April 4, 2022

Hi @roshanbi, Has the reply helped resolve your issue? If so, please mark the appropriate reply as the solution, as it will make it easier for others to find the answer in the future.  

Translate
Regards, Vidya Sargur, Community Manager Was your question answered? Make sure to mark the answer as the accepted solution. If you find a reply useful, say thanks by clicking on the thumbs up button.