Created on 11-19-2014 11:50 AM - edited 09-16-2022 02:13 AM
Hi guys,
have anybody tried to rename the output of the sqoop import command? It is always named as QueryResult.jar.
When we run multiple sqoop import commands in parallel, in Cloudera Manager the Yarn applications does not distinct between them, every command is named as QueryResult.jar.
The sqoop import command looks like:
sqoop import --connect jdbc:sqlserver://OUR.SQL.SERVER.COM --username XXX --query 'select * from XXXXZZZ where Start_Time >= getdate()-7 and $CONDITIONS' -m 6 --split-by Start_Time --as-textfile --fields-terminated-by '\t' --delete-target-dir -z --target-dir /user/sql2hadoop/ext_xxxxzzzz
sqoop import --connect jdbc:sqlserver://OUR.SQL.SERVER.COM --username XXX --query 'select * from XXXXYYY where Start_Time >= getdate()-7 and $CONDITIONS' -m 6 --split-by Start_Time --as-textfile --fields-terminated-by '\t' --delete-target-dir -z --target-dir /user/sql2hadoop/ext_xxxxyyyyyy
I would like to see in YARN that for example there are two applications running: Import_XXXZZZ.jar and Import_XXXXYYY.jar
Is there any parameter for setting the application name?
Thanks
Created 11-19-2014 04:14 PM
Hey there,
Have you fiddled with the code generation options? I think you're looking for "--class-name".
http://sqoop.apache.org/docs/1.4.5/SqoopUserGuide.html#idp6782480
-Abe
Created 11-20-2014 08:16 AM
Works great! Simply setting the --class-name overrides the name of the jar file.
Thanks!
Created 11-19-2014 04:14 PM
Hey there,
Have you fiddled with the code generation options? I think you're looking for "--class-name".
http://sqoop.apache.org/docs/1.4.5/SqoopUserGuide.html#idp6782480
-Abe
Created 11-20-2014 08:16 AM
Works great! Simply setting the --class-name overrides the name of the jar file.
Thanks!