Data ingestion to Azure Data Lake Store using NiFi.

[#1]

Hello Team,

I am trying to ingest data to Azure Data Lake Store using NiFi from my laptop. I followed this article (https://community.hortonworks.com/articles/71916/connecting-to-azure-data-lake-from-a-nifi-dataflow.html) and built a template but I get the below error when I run it.

PutHDFS[id=015f1026-453e-1bf8-2a30-9b94c2e08930] failed to invoke @OnScheduled method due to java.lang.RuntimeException: Failed while executing one of processor's OnScheduled task.; processor will not be scheduled to run for 30 seconds: java.lang.RuntimeException: Failed while executing one of processor's OnScheduled task

...........................

Caused by: java.lang.NoSuchMethodError: org.apache.hadoop.security.ProviderUtils.excludeIncompatibleCredentialProviders(Lorg/apache/hadoop/conf/Configuration;Ljava/lang/Class;)Lorg/apache/hadoop/conf/Configuration;"

Please suggest what's wrong.

Thanks

[#2]

Having similar issues, any suggestions?

Thanks

[#3]

Try this

https://hadoop.apache.org/docs/current/hadoop-azure-datalake/index.html