Member since
02-21-2018
1
Post
0
Kudos Received
0
Solutions
02-22-2018
02:51 PM
Hi All, I try to ingest data from a cluster Nifi 1.5 (hosted in 3 Vms -not on Hadoop) to Azure Data Lake Store. I followed this wonderful tutorial but i still have problem. I get these jar files (not exactly the same versions than in this tutorial): adls2-oauth2-token-provider-1.0.jar azure-data-lake-store-sdk-2.1.4.jar hadoop-azure-datalake-2.7.3.2.6.2.25-1.jar jackson-core-2.2.3.jar
okhttp-2.4.0.jar okio-1.4.0.jar I do not have hdfs-site.xml (because Nifi is not part of the Hadoop) ; so I referenced my Azure Datalake Store in core-site.xml like this: <property>
<name>fs.defaultFS</name>
<value>adl://xxxx.azuredatalakestore.net</value>
</property> I'm right ? When I start the PutHDFS, I have this error in log file : java.lang.NoClassDefFoundError: Could not initialize class org.apache.hadoop.fs.adl.AdlFileSystem (with jar tf, I saw that this method is referenced in hadoop-azure-datalake-2.7.3.2.6.2.25-1.jar). In the property tab of the PutHDFS, the "Additional Classpath Resources" is filled with /usr/lib/hdinsight-datalake (where I copy the jar files). What is wrong with this configuration ? Thanks, Olivier.
... View more