Member since
06-20-2016
251
Posts
196
Kudos Received
36
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
9567 | 11-08-2017 02:53 PM | |
2025 | 08-24-2017 03:09 PM | |
7745 | 05-11-2017 02:55 PM | |
6283 | 05-08-2017 04:16 PM | |
1901 | 04-27-2017 08:05 PM |
09-10-2016
06:10 PM
Hi Suzanne, if the Sandbox is in Azure, I am confused about the use of localhost in the command. To access a Sandbox on Azure, I would think you'd need to find the SSH port in Settings > Endpoints (it's set dynamically) and use the publicly-resolvable hostname (as in this guide). Am I missing something about the setup? How are you successfully ssh'ing?
... View more
09-07-2016
07:06 PM
@Jonathan Kaufman if you are a Hortonworks customer, this would be great detailed information to submit to Support to assist with this issue within your environment.
... View more
09-07-2016
06:39 PM
Based on the behavior, it seems to be the case that the execution environment for sqoop list-databases is local to the client host and so has access to the user's ticket cache on that host. Sqoop is a wrapper for the creation and submission of MapReduce jobs (and everything here is with respect to MRv2 on YARN).
When sqoop import is invoked from the client, resources for the associated Map tasks are allocated by the YARN Resource Manager in the form of YARN containers that are scheduled to run on the cluster's worker nodes. These containers are not forwarded Kerberos tickets, instead they are given delegation tokens (requested by the client and associated with the container's launch context). More details are available here and here. These delegation tokens can be used to access Hadoop resources, such as HDFS, under the authorization context of the client. My speculation is that since the execution context for the Map tasks does not contain the original TGT, this poses an issue for authenticating via Kerberos to services outside of Hadoop that don't interact with Hadoop delegation tokens, like SQL Server.
... View more
09-01-2016
02:30 PM
1 Kudo
No, one can only whitelist the hosts and groups that can be impersonated by the proxy user. You may want to define a new group in this case.
... View more
08-17-2016
08:12 PM
@Khera according to this HCC post, Windows Authentication is not yet supported by Sqoop, with the JDBC driver provided by Microsoft, and SQL Authentication must be used.
... View more
08-05-2016
04:29 PM
@Luis Size yes, this is supported in Zeppelin 0.60 (included in HDP 2.5), using the Livy interpreter. See https://zeppelin.apache.org/docs/0.6.0/interpreter/livy.html#impersonation
... View more
08-02-2016
07:28 PM
Within VirtualBox, navigate to Settings > Shared Folders. Choose a directory path on the host machine, give the directory a name and choose applicable options (such as Auto Mount). For this example, I used the name 'share'.
Note this doesn't require restarting your VM.
Now establish an SSH session to your guest. Run the following command (see this article) to mount the shared directory to the local directory ~/host on the guest. You can now access and transfer files from guest to host and vice versa.
sudo mount -t vboxsf share ~/host
... View more
07-27-2016
03:34 PM
1 Kudo
@Ravikumar Kumashi please see the --delete-target-dir option for sqoop import.
... View more
07-27-2016
02:47 PM
@Ravikumar Kumashi please see these docs. By default, Sqoop will import a table named foo to a directory named foo inside your home directory in HDFS. For example, if your username is someuser , then the import tool will write to /user/someuser/foo/(files) . You can adjust the parent directory of the import with the --warehouse-dir argument. For example: $ sqoop import --connnect <connect-str> --table foo --warehouse-dir /shared \
You can also explicitly choose the target directory, like so: $ sqoop import --connnect <connect-str> --table foo --target-dir /dest \
... View more
07-27-2016
01:41 PM
@Ravikumar Kumashi
Please try including the below option in the sqoop import command and let us know the results. --driver com.mysql.jdbc.Driver
... View more