Support Questions
Find answers, ask questions, and share your expertise

Nifi: SocketTimeoutException in ReportLineageToAtlas

Nifi: SocketTimeoutException in ReportLineageToAtlas

New Contributor

I am using Apache NiFi 1.8.0 that comes packaged in HDF 3.3.0 in a kerberos secured environment. The NiFI cluster is a single node cluster. While enabling ReportLineageToAtlas reporting task, I am getting following error in nifi logs:

error.png

I went through various posts specifying SocketTimeoutException is due to inability of NiFi nodes to communicate within the specified time. But in my case there is only one node.

Any help will be greatly appreciated.

1 REPLY 1

Re: Nifi: SocketTimeoutException in ReportLineageToAtlas

New Contributor

I faced a similar issue when I was performing ETL on Minio with NiFi 1.9.2. It seems that there are too many lineages to report to Atlas in the default time. But, there are no properties to change it until nifi-atlas-nar-1.11.0.nar released.

Ref:ReportLineageToAtlas.java


My workaround is to change the version of ReportLineageToAtlas from 1.9.2 to 1.11.3.

 

1. Change ReportLineageToAtlas to the version > 1.11.0
Ref:nifi-atlas-nar 1.11.3

 

2. Set Atlas Connect Timeout and Atlas Read Timeout to a higher value.
Ref:NIFI-6910 - Add ReportLineageToAtlas properties for connect timeout and read timeout