Using the command soley or args soley should work. The DTD for sqoop looks like this: <xs:complexType name="ACTION"> <xs:sequence> <xs:element name="job-tracker" type="xs:string" minOccurs="1" maxOccurs="1"/> <xs:element name="name-node" type="xs:string" minOccurs="1" maxOccurs="1"/> <xs:element name="prepare" type="sqoop:PREPARE" minOccurs="0" maxOccurs="1"/> <xs:element name="job-xml" type="xs:string" minOccurs="0" maxOccurs="unbounded"/> <xs:element name="configuration" type="sqoop:CONFIGURATION" minOccurs="0" maxOccurs="1"/> <xs:choice> <xs:element name="command" type="xs:string" minOccurs="1" maxOccurs="1"/> <xs:element name="arg" type="xs:string" minOccurs="1" maxOccurs="unbounded"/> </xs:choice> <xs:element name="file" type="xs:string" minOccurs="0" maxOccurs="unbounded"/> <xs:element name="archive" type="xs:string" minOccurs="0" maxOccurs="unbounded"/> </xs:sequence> </xs:complexType> Choice means it's either one or the other. ... View more

I believe this option controls where the data is written in HDFS before it's loaded into Hive. When the data is loaded into Hive, it will be moved again. For details on where it's loaded into HDFS before it's loaded into Hive, see http://sqoop.apache.org/docs/1.4.6/SqoopUserGuide.html#_connecting_to_a_database_server ... View more

Hey there, what do your task logs say? ... View more

Ah yes, I'm sorry about that. Have you tried using the Sqoop codeget tool to see the result HQL? You can run the HQL and dig deeper into the root of the problem? ... View more

There should be more information in the task/attempt logs and if you provide the "--verbose" option. My best guess is that it's a permissions issue. ... View more

We're still working on better facilities to look at Sqoop2 logs, but there are currently a few locations you can look (depending on your error). I'm assuming Sqoop2 starts fine, but a job you're running is failing. If that is the case, then your logs should be under /var/log/sqoop2/ and in its associated task/attempt logs. You can view these logs through the Yarn UIs (usually on port 8088. e.g. http://example.com:8088) or through Hue (http://gethue.com/). ... View more

It should be. The Generic JDBC Connector should be able to connect to MS SQL server. It's important to make sure the SQL server JDBC jar is included in Sqoop2 server's classpath via /var/lib/sqoop2 directory. ... View more

Hmm I'd ask this question in the "Batch" forum. This seems like a Yarn misconfiguration or resourcing issue. ... View more

Hey man, I'd take a look at the resource manager UI either from the resource manager or via Hue. The resource manager UI is available on port 8088 usually. Via Hue, it would be through the JobTracker app. If the job stays in "SUBMITTED" or "ACCEPTED" state (consequently never reaches "RUNNING" state), then there's likely a utilization or configuration issue. Could you check the resource manager through one of the above UIs while running your sqoop job and provide screen shots? ... View more

There is an open Jira for getting Sqoop2 to output data in a format that Hive will accept: https://issues.apache.org/jira/browse/SQOOP-1579. In reality, this shouldn't stop you, but the Jira does have an example that you might be able to use. This will affect you if you have content that needs to be escaped though. I'm on it! Here's an example of "Table SQL Statement": "SELECT * FROM example WHERE ${CONDITIONS}". - "Table column names" is used to provide a list of table columns from a table that should be extracted. This should not be used in conjunction with "Table SQL Statement". It should only be used if you provide a "Table name". - "Partition column name" defines which column should be used to partition the data transfer operation. By default, the primary key of the table will be used. If your table doesn't have a primary key, then this must be set. - "Null in partition column" is a boolean that defines whether the partition column should accept NULL values. Hope this helps... ... View more

Assuming you're using CDH 4? I'd upgrade to CDH 5 and use the Sqoop2 app.   If you're prefer to use the shell, then make sure the user you're logged in as has a linux account with an ID larger than 500 on the Hue server. ... View more

This seems like a connectivity error between the Sqoop MR job and the database. A few of questions for you: 1. Do you have your database credentials exactly right? 2. Is your database service running? ... View more

Could you run your command with --verbose right after "import"? Then copy paste the contents to this thread? ... View more

Glad it worked. Does that mean your job is running now? ... View more

You shouldn't need to provide '--driver'. Try removing it from your sqoop command. ... View more

This will be possible in CDH 5.3.0. ... View more

Sqoop2 doesn't support Kerberos currently. This will be available in CDH 5.3.0. Check out https://issues.apache.org/jira/browse/SQOOP-1527 for more info on Kerberos support. ... View more