FAILURE_ON_SUBMIT Exception: java.lang.IllegalArgumentException: Unable to parse '/hdp/apps/${hdp.version}/mapreduce/mapreduce.tar.gz#mr-framework' as a URI

[#1]

I have a problem, somebody can help me?

My softwares are Sqoop-1.99.6 HDP-2.4.0.0-169

I used sqoop to start a job,i got a problem like this:

Who can help me,please!

Thank you !

[#2]

and i found this

which is mean that in the directory"/hdp/apps/${hdp.version}/mapreduce/", No "mapreduce.tar.gz" package

[#3]

the flowing is the property in my mapred-site.xml

[#4]

@da li /hdp/apps/${hdp.version}/mapreduce/mapreduce.tar.gz should be a file in your HDFS system, you can use hdfs dfs -ls /hdp/apps/${hdp.version}/mapreduce/mapreduce.tar.gz to check whether it is there. In the meantime, make sure your hdp.version has been setup accordingly with your file location.

[#5]

Hey,my X.tar.gz in here

so,I modify "/usr/hdp/2.4.0.0-169/hadoop/conf/mapred-site.xml" like this

When I restart the HDP, it doesn't work,and the value of XXX.framework.path return to "<value>/hdp/apps/${hdp.version}/mapreduce/mapreduce.tar.gz#mr-framework</value>"again.

Can you tell which file should i to modify?

[#6]

You may check on the linux command, to see whether ${hdp.version} does match your HDP version 2.4.0.0-169. If they match, then no need to change the value.

To change the value, you better to change it in the Ambari, and then make it effect.

[#7]

hey，thaks Frank Lu.

I have checked the version of hdp on the linux command,and it match my HDP version 2.4.0.0-169

so I Re- start the sqoop job,but it‘s still throws same error

I have no idea, can you help me fix it pelease.

[#8 · Accepted solution]

@da li Sorry, I didn't look at your original post carefully. It seems that you are using Sqoop 2 on HDP 2.4. HDP 2.4 is only currently support Sqoop 1.4.6. Install Sqoop 2 on HDP 2.4 obviously cause some incompatible issue there. Did you install it yourself?

[#9]

Yes,I installed Sqoop-2 myself.

Thank you very very much!