Archives of Support Questions (Read Only)

This is an archived board for historical reference. Information and links may no longer be available or relevant
Announcements
This board is archived and read-only for historical reference. To ask a new question, please post a new topic on the appropriate active board.

Sqoop jobs ask for passward even when record password is set to true in sqoop-site.xml

avatar
Expert Contributor

I have created some sqoop jobs and have set record password to true. I am running these jobs through oozie. I have 10-12 jobs which I am running from oozie and after executing around 6-7 jobs, it throws

Could not connect to user@host (using password NO).

How come it stops using the recorded password after executing a couple of times? When I recreate job again, ti works fine a couple of time 'and then again the same problem with the same error.

I really need to know what is causing this issue?There has to be a valid reason for this,ain't it? Recreating the job is certainly not the fix neither is restarting the SQL server I am connecting to.

My sqoop jobs look like this:

sqoop job --meta-connect jdbc:hsqldb:hsql://FQDN:16000/sqoop --create sample_job -- import --driver com.mysql.jdbc.Driver --connect jdbc:mysql://IP/db?zeroDateTimeBehavior=convertToNull --username USERNAME --password 'PASSWORD' --table tableName --merge-key id --split-by id --hive-import --hive-overwrite --hive-database erpdb

My typical sqoop job execution command look like this in workflow:

job --meta-connect jdbc:hsqldb:hsql://FQDN:16000/sqoop  --exec sample_job -- --warehouse-dir DIRNAME
1 ACCEPTED SOLUTION

avatar
Expert Contributor

Alright! It took fair amount of time to come up with this fix. I have shared the problem with an elaborate solution here:http://www.yourtechchick.com/sqoop/sqoop-job-fails-to-record-password-after-running-for-the-first-ti...

View solution in original post

1 REPLY 1

avatar
Expert Contributor

Alright! It took fair amount of time to come up with this fix. I have shared the problem with an elaborate solution here:http://www.yourtechchick.com/sqoop/sqoop-job-fails-to-record-password-after-running-for-the-first-ti...