Support Questions
Find answers, ask questions, and share your expertise

connecting HDFS from hdp3.0 sandbox to pentaho data integration 8.3

New Contributor

Hi,

Can someone help me in setting up connection between hdfs from hdp 3.0 to pentaho 8.3

1) i copied the site xml files from hdp 3.0 to plugins directory of pentaho.

2) made a hadoop connection connection and below is the test result.connection.PNG

3) however getting below message in the job log

Shim Configuration Verification: WARNING The Hadoop File System URL does not match the URL in the shims core-site.xml.

The Hadoop File System URL hdfs://sandbox-hdp.hortonworks.com:8020 does not match the defaultFS Hadoop config property in the shims core-site.xml. Be sure to get the site configuration files from the Hadoop cluster.

 

4) below is the parameter from core-site.xml file

<property>
<name>fs.defaultFS</name>
<value>hdfs://sandbox-hdp.hortonworks.com:8020</value>
<final>true</final>
</property>

 

Thanks,

Anilsingh073

0 REPLIES 0