Options
- Subscribe to RSS Feed
- Mark Question as New
- Mark Question as Read
- Float this Question for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page
Solved
Go to solution
Sqoop runs in local mode while calling it from java
Labels:
- Labels:
-
Apache HBase
-
Apache Sqoop
Contributor
Created on ‎07-14-2014 11:40 AM - edited ‎09-16-2022 02:02 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
I've a java programs which calls the sqoop . It runs fine and import the data to hbase. But it runs in localmode though I've specified options.setNumMappers(5);
Please suggest how to run it in distributed mode.
1 ACCEPTED SOLUTION
Mentor
Created ‎07-14-2014 11:46 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Your java program needs to include cluster client configs on its
classpath for the Configuration class to be able to read and discover
the actual MR cluster automatically.
Typically you can achieve this by adding the directory
/etc/hadoop/conf to your classpath, if you are not launching your
custom application using the 'hadoop jar' command (which auto-sets the
desirable classpath).
classpath for the Configuration class to be able to read and discover
the actual MR cluster automatically.
Typically you can achieve this by adding the directory
/etc/hadoop/conf to your classpath, if you are not launching your
custom application using the 'hadoop jar' command (which auto-sets the
desirable classpath).
2 REPLIES 2
Mentor
Created ‎07-14-2014 11:46 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Your java program needs to include cluster client configs on its
classpath for the Configuration class to be able to read and discover
the actual MR cluster automatically.
Typically you can achieve this by adding the directory
/etc/hadoop/conf to your classpath, if you are not launching your
custom application using the 'hadoop jar' command (which auto-sets the
desirable classpath).
classpath for the Configuration class to be able to read and discover
the actual MR cluster automatically.
Typically you can achieve this by adding the directory
/etc/hadoop/conf to your classpath, if you are not launching your
custom application using the 'hadoop jar' command (which auto-sets the
desirable classpath).
Contributor
Created ‎07-15-2014 02:59 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Thanks. It is now working in distributed mode.
