28788
DISCUSSIONS
102044
MEMBERS
3161
ARTICLES
Created 01-10-2016 08:37 PM
Hello, please see red highlight text below. I will proceed to Tutorial Execersize 2 using Hue to see whether these errors will stop me from going forward with the next step in the tutorial. I look forward to hearing from you. Thank you. George
[cloudera@quickstart ~]$ sqoop import-all-tables \
> -m 1 \
> --connect jdbc:mysql://quickstart:3306/retail_db \
> --username=retail_dba \
> --password=cloudera \
> --compression-codec=snappy \
> --as-avrodatafile \
> --warehouse-dir=/user/hive/warehouse
Warning: /usr/lib/sqoop/../accumulo does not exist! Accumulo imports will fail.
Please set $ACCUMULO_HOME to the root of your Accumulo installation.
16/01/10 20:05:26 INFO sqoop.Sqoop: Running Sqoop version: 1.4.5-cdh5.4.2
16/01/10 20:05:26 WARN tool.BaseSqoopTool: Setting your password on the command-line is insecure. Consider using -P instead.
16/01/10 20:05:26 INFO manager.MySQLManager: Preparing to use a MySQL streaming resultset.
16/01/10 20:05:27 INFO tool.CodeGenTool: Beginning code generation
16/01/10 20:05:27 INFO manager.SqlManager: Executing SQL statement: SELECT t.* FROM `categories` AS t LIMIT 1
16/01/10 20:05:27 INFO manager.SqlManager: Executing SQL statement: SELECT t.* FROM `categories` AS t LIMIT 1
16/01/10 20:05:27 INFO orm.CompilationManager: HADOOP_MAPRED_HOME is /usr/lib/hadoop-mapreduce
Note: /tmp/sqoop-cloudera/compile/3db93774560bd8239db95846fece57c5/categories.java uses or overrides a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
16/01/10 20:05:30 INFO orm.CompilationManager: Writing jar file: /tmp/sqoop-cloudera/compile/3db93774560bd8239db95846fece57c5/categories.jar
16/01/10 20:05:30 WARN manager.MySQLManager: It looks like you are importing from mysql.
16/01/10 20:05:30 WARN manager.MySQLManager: This transfer can be faster! Use the --direct
16/01/10 20:05:30 WARN manager.MySQLManager: option to exercise a MySQL-specific fast path.
16/01/10 20:05:30 INFO manager.MySQLManager: Setting zero DATETIME behavior to convertToNull (mysql)
16/01/10 20:05:30 INFO mapreduce.ImportJobBase: Beginning import of categories
16/01/10 20:05:30 INFO Configuration.deprecation: mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
16/01/10 20:05:30 INFO Configuration.deprecation: mapred.jar is deprecated. Instead, use mapreduce.job.jar
16/01/10 20:05:31 INFO manager.SqlManager: Executing SQL statement: SELECT t.* FROM `categories` AS t LIMIT 1
16/01/10 20:05:31 INFO mapreduce.DataDrivenImportJob: Writing Avro schema file: /tmp/sqoop-cloudera/compile/3db93774560bd8239db95846fece57c5/sqoop_import_categories.avsc
16/01/10 20:05:31 INFO Configuration.deprecation: mapred.map.tasks is deprecated. Instead, use mapreduce.job.maps
16/01/10 20:05:32 INFO client.RMProxy: Connecting to ResourceManager at /0.0.0.0:8032
16/01/10 20:05:32 WARN security.UserGroupInformation: PriviledgedActionException as:cloudera (auth:SIMPLE) cause:org.apache.hadoop.mapred.FileAlreadyExistsException: Output directory hdfs://quickstart.cloudera:8020/user/hive/warehouse/categories already exists
16/01/10 20:05:32 ERROR tool.ImportAllTablesTool: Encountered IOException running import job: org.apache.hadoop.mapred.FileAlreadyExistsException: Output directory hdfs://quickstart.cloudera:8020/user/hive/warehouse/categories already exists
[cloudera@quickstart ~]$ hadoop fs -ls /user/hive/warehouse
Found 5 items
drwxr-xr-x - cloudera hive 0 2016-01-10 20:02 /user/hive/warehouse/categories
drwxr-xr-x - cloudera hive 0 2016-01-10 20:03 /user/hive/warehouse/customers
drwxr-xr-x - cloudera hive 0 2016-01-10 20:03 /user/hive/warehouse/departments
drwxr-xr-x - cloudera hive 0 2016-01-10 20:03 /user/hive/warehouse/order_items
drwxr-xr-x - cloudera hive 0 2016-01-10 20:04 /user/hive/warehouse/orders
[cloudera@quickstart ~]$ hadoop fs -ls /user/hive/warehouse/categories/
Found 2 items
-rw-r--r-- 1 cloudera hive 0 2016-01-10 20:02 /user/hive/warehouse/categories/_SUCCESS
-rw-r--r-- 1 cloudera hive 1344 2016-01-10 20:02 /user/hive/warehouse/categories/part-m-00000.avro
[cloudera@quickstart ~]$ ls -l *.avsc
-rw-rw-r-- 1 cloudera cloudera 541 Jan 10 20:02 sqoop_import_categories.avsc
-rw-rw-r-- 1 cloudera cloudera 1324 Jan 10 20:02 sqoop_import_customers.avsc
-rw-rw-r-- 1 cloudera cloudera 409 Jan 10 20:03 sqoop_import_departments.avsc
-rw-rw-r-- 1 cloudera cloudera 980 Jan 10 20:03 sqoop_import_order_items.avsc
-rw-rw-r-- 1 cloudera cloudera 632 Jan 10 20:03 sqoop_import_orders.avsc
[cloudera@quickstart ~]$ sudo -u hdfs hadoop fs -mkdir /user/examples
[cloudera@quickstart ~]$ sudo -u hdfs hadoop fs -chmod +rw /user/examples
[cloudera@quickstart ~]$ hadoop fs -copyFromLocal ~/*.avsc /user/examples/