Member since
05-15-2014
8
Posts
0
Kudos Received
1
Solution
My Accepted Solutions
Title | Views | Posted |
---|---|---|
12162 | 05-29-2014 05:30 PM |
02-08-2022
07:20 PM
Hello Adre', is there any Academic version of Cloudera? Thanks, Dr. Owns
... View more
05-29-2014
05:30 PM
Finally I got it working: Lessons learned..... Import table to HDFS using sqoop2: Create connection …. Name: Connection1 JDBC Driver: com.microsoft.sqlserver.jdbc.SQLServerDriver JDBC Connection String: jdbc:sqlserver://192.168.1.9\DSSSQL2012 User Name: yourDBUsername Password: YourDBPassword Create job, after clicking "Create Job" …. Job Name: TableLoad Connection: Connection1 Schema Name: Leave it blank/null Table Name: DimAccount OR Table SQL Statement: SELECT+*+FROM+DimAccount+where+${CONDITIONS} Table Column Name: AccountKey,AccountDescription,AccountType Partition Column Name: AccountKey Null in Partition Column: No Boundary Query: Select min(AccountKey),max(AccountKey) from DimAccount Storage Type: HDFS Output Format: Text File Output Directory: /tmp/sqoop2-outpout/TableLoad1 ; This is a HDFS directory and you should not create it. The job process will create the folder and related files. The node folder should not exist Extractors: ?? I don't what this is, and is not a show stopper Loaders: ?? I don't what this is, and is not a show stopper Goodluck to the new explorers....
... View more
05-29-2014
03:00 PM
FYI.... here is how one can get the logfile of the job; http://localhost.localdomain:8888/logs I will let you how I resolve the issue, if and when I do. Thanks
... View more
05-23-2014
05:16 AM
Thanks Jason for your reply. After lots of trial and error, we got all the jinx out or sqoop functionality from terminal. We can import/export from table, database and with SQL scripts. However, we cannot do the same thing from sqoop UI. In Hue/sqoop interface, we can create connection without any error; create a job without any error; running a job without any error; however, no outputs. As I have mentioned, we have created many outputs in /usr/Cloudera/{one folder for each job} when running sqoop from terminal. Any idea where we should look for the issue? Thanks.
... View more
05-15-2014
06:14 PM
Hi Foks, I am not that savy in Linux. I am trying to creat a new connection to SQL Server on my laptop and Cloud. Niether of them working. Here is what I have done: - Using Quickstart VM CDH 4.6 - Usoing VMWare Player for quess session - Installed/copied sqljdbc.jar in /usr/lib/sqoop/lib/ - export CLASSPATH=/usr/lib/sqoop/lib/sqljdbc4.jar in a terminal - run this command on the same terminal... $ sqoop eval --connect jdbc:sqlserver://XXXX.cloudapp.net,1433\\XXXX(instance name) --username <myuser> --password <maypassword> --driver com.microsoft.sqlserver.jdbc.SQLServerDriver --query "SELECT * FROM [ContosoRetailDW].[dbo].[DimAccount]" - I do the same for local machine, the host machine Here is the error i get for both cases: WARN tool.EvalSqlTool: SQL exception executing statement: com.microsoft.sqlserver.jdbc.SQLServerException: The connection to the host dssvmprod.cloudapp.net,1433, named instance DSSPRODDB failed. Error: "java.net.UnknownHostException: dssvmprod.cloudapp.net,1433". Verify the server and instance names and check that no firewall is blocking UDP traffic to port 1434. For SQL Server 2005 or later, verify that the SQL Server Browser Service is running on the host. Info... I can connect to Cloud database from guess VM without any issue Here are my questions: 1- What am I doing wrong connecting from a terminal? 2- When I open another terminal the $CLASSPATH won't be recognized. How can I make the CLASSPATH perminant. 2- What should I do or set that the SQL Server driver can be loaded by Sqoop2 user interface? Does sqoop2 interface uses $CLASSPATH? Many thanks for your help
... View more
Labels: