Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Apache Oozie Distcp Action with Kerberos enabled clusters

Solved Go to solution
Highlighted

Re: Apache Oozie Distcp Action with Kerberos enabled clusters

Mentor

@Predrag Minovic & @Venkat Ranganathan the only way this works with secure and insecure cluster is if core-site.xml has the property below on the secured cluster side.

    <property>
      <name>ipc.client.fallback-to-simple-auth-allowed</name>
      <value>true</value>
    </property>

uploading core-site.xml with this property in it in the lib folder of the workflow doesn't work. <arg> and <java-opts> for this property take no effect. job config would not update, the only way to make it work was to update on the hdfs side globally.

Thank you both for your recommendations, eventually it was Predrag who suggested to update HDFS with the property. This is not optimal but for lack of better option will do. It's best to have either two unsecure or two secure clusters.

Highlighted

Re: Apache Oozie Distcp Action with Kerberos enabled clusters

Can you try to put your copy of core-site.xml with that property set to true in the Oozie share lib folder for distcp?

Highlighted

Re: Apache Oozie Distcp Action with Kerberos enabled clusters

Mentor

adding to sharelib of distcp core-site.xml with this property does not take effect and including it in lib directory of the workflow doesn't take effect either.

Highlighted

Re: Apache Oozie Distcp Action with Kerberos enabled clusters

That's good to know! Many restrictions with Oozie...

Don't have an account?
Coming from Hortonworks? Activate your account here