So my team and I have been using sqoop. We found the location where the data is supposed to be imported to and we changed the directory to that. Then we ran the import string specifying the location, port, username, password, table to import, and -m 1.
After we press enter, it takes a long time to import. One table consists of maybe 4,000 records. Now I have done this previously on a VM before moving to Microsoft Azure. The time it took on the VM was about 10 minutes or less to import.
Shouldn't it take about this time?
I need suggestions!!!!
... View more
Hi! So the past few days have bee a little bit troubling for me and my team. We successfully installed Hortonworks Sandbox HDP 2.4 on the VirtualBox. Everything is working correctly, we managed to import tables from a SQL server to Hadoop and the results were being displayed on both Ambari and in the machine. All was well until we tried getting Hue working on the system. We created an IP address and port number to access it. It worked too we were getting an interface similar to Ambari and it was saving queries in Hive. However, when we went to transform the data in Oozie with a workflow, we got an error saying that the Web HDFS could not create workflow for oozie. At first we thought that we should upgrade the newest version of Hue to HDP 2.4.0 but we did some research and the Hortonworks Community was saying that you should stick with the version of Hue that came with sandbox. Then we saw that people were running Hue 3.7.1 on HDP 2.2.0. It seemed odd that the newest version of HDP (2.4.0) is not compatible with 3.7.1. Maybe it is, which leads to the question: Is it possible to install Hue 3.7.1 or newer on HDP 2.4.0 and be able to access all the features on Hue like adding tables, databases, and creating workflows??? If so, HOW????
... View more