Support Questions
Find answers, ask questions, and share your expertise

sqoop job is failing with --query and where clause and Hcatalog storage stang


My Sqoop job is as follows

sqoop job --create KHL_SOE_FINANCIAL_TRAN_JOB -- import --options-file '/home/hdfs/sqoopimport/DBConnections/connectionDetails.txt' --password-file 'hdfs://' --query "select * from ad.soe_financial_tran where ACCOUNT_CURRENCY_CODE in ('GHS', 'UGX') and \$CONDITIONS" -m 1 --incremental lastmodified --check-column POSTED_AT --last-value '2018-08-02 21:11:31.759' --hcatalog-home /usr/hdp/current/hive-webhcat --hcatalog-database SNDPD --hcatalog-table SND_SOE_FINANCIAL_TRAN --hcatalog-storage-stanza 'stored as orcfile'

If I run this job Im getting following error.

ERROR sqoop.Sqoop: Got exception running Sqoop: java.lang.NullPointerException java.lang.NullPointerException at org.apache.hadoop.fs.FileSystem.fixRelativePart( at org.apache.hadoop.hdfs.DistributedFileSystem.fixRelativePart( at org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus( at org.apache.hadoop.fs.FileSystem.exists( at org.apache.sqoop.tool.ImportTool.initIncrementalConstraints( at org.apache.sqoop.tool.ImportTool.importTable( at at org.apache.sqoop.tool.JobTool.execJob( at at at at org.apache.sqoop.Sqoop.runSqoop( at org.apache.sqoop.Sqoop.runTool( at org.apache.sqoop.Sqoop.runTool( at org.apache.sqoop.Sqoop.main(

Connection details are correct, If I run with out sqoop job I can able to import.

Thanks in Advance..


@Ravikiran Dasari

It seems like this could be a permission error. Confirm the user that is executing the sqoop command has proper permissions to access sqoop command parameter files.

Good luck, and if this answer helps, please choose ACCEPT.

I can able run this with out sqoop job and with out ACCOUNT_CURRENCY_CODE in ('GHS', 'UGX') this condition also.surly its not permission issues.

New Contributor

Sqoop is meant to “Fail speedy” unless you use Oozie or every other workflow essay help engine to configure movements to take upon a failure. a normal Sqoop process this is eating information from a supply database into HDFS will copy the information to a target directory. The copied report goes to be deleted if sqoop fails without completing.

; ;