Member since
01-31-2016
91
Posts
29
Kudos Received
1
Solution
My Accepted Solutions
Title | Views | Posted |
---|---|---|
2151 | 02-05-2016 04:47 PM |
02-02-2016
12:02 AM
ok @Ancil McBarnett -- Thanks for your ideas. I was able to do a sqoop import of the tables using --hive-import onto hive and then I created a orc table. Is there anyway I can access these imported files on hive? Because I'm able to find the files I imported on hdp but not hive. hdfs-imported-tables.png
... View more
02-01-2016
11:20 PM
I reviewed these links. I can follow those steps if my data has been imported to hdp and I want to create an orctable in hive. But what you're suggesting is to import the data on hive and then create an orc table.
... View more
02-01-2016
11:16 PM
@Ancil McBarnett -- I'm having a bit of a confusion in interpreting your suggestions. Let me know if I have interpreted your answers well. 1. In both the following cases the tables you have referred to as 'employees' and 'employee_hive' is the mysql table imported using sqoop directly onto hive (sqoop import --connect jdbc:mysql://localhost:3306/employees --username xxx--password xxx --table employees --hive-import --driver com.mysql.jdbc.Driver). Am I correct? 2. Once I'm done with importing the employees table on hive mentioned in step 1, I can create an orcemployees table. Am I right?
... View more
02-01-2016
10:55 PM
The reason I'm asking you is , what's the difference between doing a --hive-import of the employees table and then copying that same data into hive orc employees table? I understand that ORC helps in performance improvement but can I see the difference visually when I do a select * from employees vs select * from employees_orc?
... View more
02-01-2016
10:50 PM
thanks @Artem Ervits
... View more
02-01-2016
10:49 PM
@Ancil McBarnett - Thanks for your reply. Are you suggesting to do a sqoop import of the employees table onto HDP or Hive?
... View more
02-01-2016
10:33 PM
My first step was to create an ORC table on Hive with the same schema as the one imported on hdp : CREATE TABLE IF NOT EXISTS orcemployees( emp_no int, birth_date date,
first_name string, last_name string, gender string, hire_date date)
STORED AS ORC; My second step was to copy the data from employees into orcemployees: insert into table orcemployees select * from employees; The problem is when I execute select * from orcemployees; the schema is displayed and not the associated data.
... View more
Labels:
- Labels:
-
Apache Hadoop
-
Apache Hive
-
Apache Sqoop
02-01-2016
03:18 AM
Whenever I execute this query : sqoop list-databases --connect jdbc:mysql://localhost:3306 --username xxx -password xxx . Only the following tables are displayed information_schema, hive, mysql, ranger, ranger_audit,test but not the databases which I created inside mysql workbench. Your guidance will be appreciated.
... View more
02-01-2016
01:31 AM
@Neeraj Sabharwal -- It worked. Thanks a lot for your time and suggestions:)
... View more
02-01-2016
12:38 AM
@Neeraj Sabharwal Do you know how to fix this?
... View more
- « Previous
- Next »