Hi @slachterman To let you know, with current HDP setup I have, i'm able to lift/connect to Azure Datalake using hdfs command. But using NiFi it is not working as you mentioned i'm using PutHdfs and GenerateFlowFile processors. I'm getting below error. From the error we can make out permission issue, But I have provided full rights/permission to whole world on the ADLS i'm using. Can you please suggest and help me resolve this issue.
Failed to write to HDFS due to org.apache.hadoop.security.AccessControlException Permission denied: user=root, access=WRITE, Inode="/hdp-lake":hdfs:hdfs:drwx-r-xr-x at
org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.check(FSPermissionChecker.java:319) Thanks in advance for your help!.
... View more
Hi slachterman, Can you please confirm if this scenario works when Nifi is local to HDI Cluster which is configured to Datalake? More details on the architecture. I was trying with below steps and didn't work. 1) We have HDP & NiFi Installed on Azure VM. 2) using above NiFi trying to connect to azure HDInsight (another VM) which can talk to datalake. 3) All VM's are on same Azure VNET and subscription. 4) when I followed the instructions and tested files are writing to the HDFS of HDP cluster but not to Datalake of HDI cluster. Can you please let me know exactly how to write files to Azure Datalake? Thanks in advance. Regards Mahesh.
... View more