Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Does kerberos allows sqoop to migrate the remote mysql/sql server data into hdfs?

Does kerberos allows sqoop to migrate the remote mysql/sql server data into hdfs?

Expert Contributor

I want to migrate the relational data from sqlserver using sqoop into hdfs while kerberos is enabled.

 

the concept of kerberos is to have a ticket granting ticket/service to authenticate and be able to enter he cloudera's services.

 

Any idea?

7 REPLIES 7

Re: Does kerberos allows sqoop to migrate the remote mysql/sql server data into hdfs?

Expert Contributor

it donesn't matter.

 

if you run sqoop in OS level, you can use kinit to get ticket in advance( and don;t forget renewal and ticket remain days function, it means you needn't kinit to get ticket everytime. ),  if you run sqoop in HUE, this will be done by hue, you needn't worry about it/ 

Re: Does kerberos allows sqoop to migrate the remote mysql/sql server data into hdfs?

Expert Contributor

i saw when i run sqoop in kerberized cluster it gave me an error like this:-

 

Error: org.apache.hadoop.security.AccessControlException: SIMPLE authentication is not enabled. Available:[TOKEN, KERBEROS]

 

also,there is no principal made for sqoop when i checked in kerberos configurations.

Re: Does kerberos allows sqoop to migrate the remote mysql/sql server data into hdfs?

Expert Contributor

Also, in the documentation i found that sqoop 2 does not support security in cdh 5.2

I am using cdh 5.2 and kerberos security is enabled.

 

http://www.cloudera.com/content/cloudera/en/documentation/core/latest/topics/cdh_sg_sqoop_pig_whirr_...

 

what is the way to use sqoop 2 in cdh 5.2,chd 5.2 only has gateways for sqoop 1 client.

I am talking about using sqoop 2 from HUE and not the linux terminal.

Highlighted

Re: Does kerberos allows sqoop to migrate the remote mysql/sql server data into hdfs?

Expert Contributor
Sqoop2 doesn't support Kerberos currently. This will be available in CDH 5.3.0.

Check out https://issues.apache.org/jira/browse/SQOOP-1527 for more info on Kerberos support.

Re: Does kerberos allows sqoop to migrate the remote mysql/sql server data into hdfs?

Expert Contributor

So you are saying is i will not be able to use sqoop2 from HUE with kerberos security enabled ?

 

 

Re: Does kerberos allows sqoop to migrate the remote mysql/sql server data into hdfs?

Expert Contributor
Yes

Re: Does kerberos allows sqoop to migrate the remote mysql/sql server data into hdfs?

Expert Contributor
This will be possible in CDH 5.3.0.
Don't have an account?
Coming from Hortonworks? Activate your account here