question Re: SQOOP - MySQL - AWS Practice Instance in Archives of Support Questions (Read Only)

SQOOP - MySQL - AWS Practice Instance

vidyaranya_kupp — Wed, 06 Jan 2016 11:57:32 GMT

I am working on HDPCD practice test instance. Can anybody let me know -

a) Is there anything I should do before issue sqoop command on AWS practice instance.

b) what is the parameter I should use for --connect jdbc:?????

Re: SQOOP - MySQL - AWS Practice Instance

nsabharwal — Wed, 06 Jan 2016 22:21:10 GMT

The exam is based on the Hortonworks Data Platform 2.2 installed and managed with Ambari 1.7.0, which includes Pig 0.14.0, Hive 0.14.0, Sqoop 1.4.5, and Flume 1.5.0. Each candidate will be given access to an HDP 2.2 cluster along with a list of tasks to be performed on that cluster.

you will be using localhost or hostname for --connect jdbc:host

Re: SQOOP - MySQL - AWS Practice Instance

aervits — Wed, 03 Feb 2016 03:25:43 GMT

@rich @Vidya SK are you still having issues with this? Can you accept best answer or provide your own solution?

Re: SQOOP - MySQL - AWS Practice Instance

rich1 — Fri, 12 Feb 2016 11:09:37 GMT

@Vidya SK

The connection URL for the practice exam is:

--connect jdbc:mysql://namenode/flightinfo

There is nothing special you need to do prior to running the Sqoop command. The environment is configured properly for Sqoop to connect to MySQL. The entire working Sqoop command can be found in the /home/horton/solutions/ folder.

Re: SQOOP - MySQL - AWS Practice Instance

ashok_padmanabh — Tue, 23 Feb 2016 00:55:10 GMT

Hi Rich - the practice instance MYSQL seems to have issues.

When I launch mysql it gives an error - Error 2002 - Cannot Connect to MYSQL Server through Socket /var/run/mysqld/mysqld.com

I tried ssh into root@namenode

I am able to launch mysql from there. Can you please help ?

Re: SQOOP - MySQL - AWS Practice Instance

rich1 — Tue, 23 Feb 2016 01:00:37 GMT

MySQL works fine on the practice exam. It is not running on the Ubuntu client - mysqld is running on the namenode server, so if you want to view the databases and tables in MySQL then you must ssh onto the namenode:

$ ssh root@namenode (password is hadoop)
# mysql --user=root --password=hadoop

Let me know if that answers your question.

Re: SQOOP - MySQL - AWS Practice Instance

ashok_padmanabh — Tue, 23 Feb 2016 01:47:47 GMT

Thanks Rich for the prompt response. The issue i have is once i login to root , all the hdfs folders do not have access. So when i run Sqoop export as root it fails on hdfs side. Alternatively i have do a chmod 777 on the hdfs directories so that sqoop run as root can get into it. Is that the intended way to do it?

Re: SQOOP - MySQL - AWS Practice Instance

rich1 — Tue, 23 Feb 2016 01:51:59 GMT

You do not run the Sqoop command as root on the namenode. Run the Sqoop command as the "horton" user on the Ubuntu client.

Re: SQOOP - MySQL - AWS Practice Instance

ashok_padmanabh — Tue, 23 Feb 2016 02:00:42 GMT

Hi Rich - That is the issue. When i run as horton mysql doesnt work. it only works under root. The error is Error 2002 - Cannot Connect to MYSQL Server through Socket /var/run/mysqld/mysqld.com

Re: SQOOP - MySQL - AWS Practice Instance

ashok_padmanabh — Tue, 23 Feb 2016 02:02:48 GMT

Please ignore. i think i know what your saying. if i need to run mysql i have to be in root and if i need to run sqoop i have to be horton.

Re: SQOOP - MySQL - AWS Practice Instance

rich1 — Tue, 23 Feb 2016 02:03:25 GMT

Please share your Sqoop command. Have you tried comparing your Sqoop command to the solution in the /home/horton/solutions folder?

Re: SQOOP - MySQL - AWS Practice Instance

prasad4u_com — Tue, 23 Feb 2016 02:23:54 GMT

where can i find the sample questions?

Re: SQOOP - MySQL - AWS Practice Instance

rich1 — Tue, 23 Feb 2016 02:25:54 GMT

The tasks for the practice exam are a part of the Amazon AMI image. The details are here:

http://hortonworks.com/wp-content/uploads/2015/02/HDPCD-PracticeExamGuide1.pdf