kudu connection

[#1]

Dear Team,

kindly advise on why connection from our CDC tools to Kudu is not working? What does KuduWriterException: End of file: unable to send message: Other end of pipe was closed (error 0) mean?

at java.lang.Thread.run(Thread.java:750)
com.webaction.common.exc.ConnectionException: Couldn't establish connection with Kudu ( RB-HADOOP-03.mtg.local:7051,RB-HADOOP-04.mtg.local:7051,RB-HADOOP-05.mtg.local:7051,RB-HADOOP-03.mtg.local:7051,RB-HADOOP-04.mtg.local:7051,RB-HADOOP-05.mtg.local:7051,RB-HADOOP-03.mtg.local:7051,RB-HADOOP-04.mtg.local:7051,RB-HADOOP-05.mtg.local:7051,RB-HADOOP-03.mtg.local:7051,RB-HADOOP-04.mtg.local:7051,RB-HADOOP-05.mtg.local:7051,RB-HADOOP-03.mtg.local:7051,RB-HADOOP-04.mtg.local:7051,RB-HADOOP-05.mtg.local:7051,RB-HADOOP-03.mtg.local:7051,RB-HADOOP-04.mtg.local:7051,RB-HADOOP-05.mtg.local:7051,RB-HADOOP-03.mtg.local:7051,RB-HADOOP-04.mtg.local:7051,RB-HADOOP-05.mtg.local:7051,RB-HADOOP-03.mtg.local:7051,RB-HADOOP-04.mtg.local:7051,RB-HADOOP-05.mtg.local:7051,RB-HADOOP-03.mtg.local:7051,RB-HADOOP-04.mtg.local:7051,RB-HADOOP-05.mtg.local:7051 )
at com.striim.proc.Connection.KuduWriterConnection.connect(KuduWriterConnection.java:83)
at com.striim.proc.Connection.KuduWriterConnection.<init>(KuduWriterConnection.java:44)
at com.striim.proc.Connection.KuduWriterConnection.getConnection(KuduWriterConnection.java:100)
at com.striim.proc.KuduWriter.initializeKuduClient(KuduWriter.java:224)
at com.striim.proc.KuduWriter.initWriter(KuduWriter.java:132)
at com.webaction.utils.writers.common.RetriableBaseDataStoreWriter.init(RetriableBaseDataStoreWriter.java:78)
at com.webaction.runtime.components.Target.start(Target.java:377)
at com.webaction.runtime.components.Flow.start(Flow.java:431)
at com.webaction.runtime.components.Flow.start(Flow.java:375)
at com.webaction.runtime.components.Flow.start(Flow.java:335)
at com.webaction.runtime.components.Flow$2.run(Flow.java:1612)
at java.lang.Thread.run(Thread.java:750)
com.webaction.common.exc.ConnectionException: Couldn't establish connection with Kudu ( RB-HADOOP-03.mtg.local:7051,RB-HADOOP-04.mtg.local:7051,RB-HADOOP-05.mtg.local:7051,RB-HADOOP-03.mtg.local:7051,RB-HADOOP-04.mtg.local:7051,RB-HADOOP-05.mtg.local:7051,RB-HADOOP-03.mtg.local:7051,RB-HADOOP-04.mtg.local:7051,RB-HADOOP-05.mtg.local:7051,RB-HADOOP-03.mtg.local:7051,RB-HADOOP-04.mtg.local:7051,RB-HADOOP-05.mtg.local:7051,RB-HADOOP-03.mtg.local:7051,RB-HADOOP-04.mtg.local:7051,RB-HADOOP-05.mtg.local:7051,RB-HADOOP-03.mtg.local:7051,RB-HADOOP-04.mtg.local:7051,RB-HADOOP-05.mtg.local:7051,RB-HADOOP-03.mtg.local:7051,RB-HADOOP-04.mtg.local:7051,RB-HADOOP-05.mtg.local:7051,RB-HADOOP-03.mtg.local:7051,RB-HADOOP-04.mtg.local:7051,RB-HADOOP-05.mtg.local:7051,RB-HADOOP-03.mtg.local:7051,RB-HADOOP-04.mtg.local:7051,RB-HADOOP-05.mtg.local:7051,RB-HADOOP-03.mtg.local:7051,RB-HADOOP-04.mtg.local:7051,RB-HADOOP-05.mtg.local:7051,RB-HADOOP-03.mtg.local:7051,RB-HADOOP-04.mtg.local:7051,RB-HADOOP-05.mtg.local:7051,RB-HADOOP-03.mtg.local:7051,RB-HADOOP-04.mtg.local:7051,RB-HADOOP-05.mtg.local:7051 )
at com.striim.proc.Connection.KuduWriterConnection.connect(KuduWriterConnection.java:83)
at com.striim.proc.Connection.KuduWriterConnection.<init>(KuduWriterConnection.java:44)
at com.striim.proc.Connection.KuduWriterConnection.getConnection(KuduWriterConnection.java:100)
at com.striim.proc.KuduWriter.initializeKuduClient(KuduWriter.java:224)
at com.striim.proc.KuduWriter.initWriter(KuduWriter.java:132)
at com.webaction.utils.writers.common.RetriableBaseDataStoreWriter.init(RetriableBaseDataStoreWriter.java:78)
at com.webaction.runtime.components.Target.start(Target.java:377)
at com.webaction.runtime.components.Flow.start(Flow.java:431)
at com.webaction.runtime.components.Flow.start(Flow.java:375)
at com.webaction.runtime.components.Flow.start(Flow.java:335)
at com.webaction.runtime.components.Flow$2.run(Flow.java:1612)
at java.lang.Thread.run(Thread.java:750)
com.striim.proc.exception.KuduWriterException: End of file: unable to send message: Other end of pipe was closed (error 0)
at com.striim.proc.CheckPoint.CheckpointTableImpl.checkForCheckpointTable(CheckpointTableImpl.java:133)
at com.striim.proc.CheckPoint.CheckpointTableImpl.<init>(CheckpointTableImpl.java:44)
at com.striim.proc.KuduWriter.initWriter(KuduWriter.java:152)
at com.webaction.utils.writers.common.RetriableBaseDataStoreWriter.init(RetriableBaseDataStoreWriter.java:78)
at com.webaction.runtime.components.Target.start(Target.java:377)
at com.webaction.runtime.components.Flow.start(Flow.java:431)
at com.webaction.runtime.components.Flow.start(Flow.java:375)
at com.webaction.runtime.components.Flow.start(Flow.java:335)
at com.webaction.runtime.components.Flow$2.run(Flow.java:1612)
at java.lang.Thread.run(Thread.java:750)
Command RESUME failed so application CDC.CDC_CBS_CUST_CBS_NP is put in HALTED state
com.striim.proc.exception.KuduWriterException: End of file: unable to send message: Other end of pipe was closed (error 0)
at com.striim.proc.CheckPoint.CheckpointTableImpl.checkForCheckpointTable(CheckpointTableImpl.java:133)
at com.striim.proc.CheckPoint.CheckpointTableImpl.<init>(CheckpointTableImpl.java:44)
at com.striim.proc.KuduWriter.initWriter(KuduWriter.java:152)
at com.webaction.utils.writers.common.RetriableBaseDataStoreWriter.init(RetriableBaseDataStoreWriter.java:78)
at com.webaction.runtime.components.Target.start(Target.java:377)
at com.webaction.runtime.components.Flow.start(Flow.java:431)
at com.webaction.runtime.components.Flow.start(Flow.java:375)
at com.webaction.runtime.components.Flow.start(Flow.java:335)
at com.webaction.runtime.components.Flow$2.run(Flow.java:1612)
at java.lang.Thread.run(Thread.java:750)
com.striim.proc.exception.KuduWriterException: End of file: unable to send message: Other end of pipe was closed (error 0)
at com.striim.proc.CheckPoint.CheckpointTableImpl.checkForCheckpointTable(CheckpointTableImpl.java:133)
at com.striim.proc.CheckPoint.CheckpointTableImpl.<init>(CheckpointTableImpl.java:44)
at com.striim.proc.KuduWriter.initWriter(KuduWriter.java:152)
at com.webaction.utils.writers.common.RetriableBaseDataStoreWriter.init(RetriableBaseDataStoreWriter.java:78)
at com.webaction.runtime.components.Target.start(Target.java:377)
at com.webaction.runtime.components.Flow.start(Flow.java:431)
at com.webaction.runtime.components.Flow.start(Flow.java:375)
at com.webaction.runtime.components.Flow.start(Flow.java:335)
at com.webaction.runtime.components.Flow$2.run(Flow.java:1612)

Thanks,

Roshan

[#2 · Accepted solution]

Hello Roshan,

com.striim.proc.exception.KuduWriterException: End of file: unable to send message: Other end of pipe was closed (error 0)

Looks to me like a known bug discovered recently for which there is already a patch.  Seems to be related to Cloudera OPSAPS-61660.

Best bet for you would be to open a ticket with support to have it confirmed.

Regards,

Jason R.

[#3]

Thanks Jason. We upgraded Cloudera and issue is resolved.

[#4]

Hi @roshanbi, Has the reply helped resolve your issue? If so, please mark the appropriate reply as the solution, as it will make it easier for others to find the answer in the future.