Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Warning: ...accumulo does not exist! AND only 5 instead of 6 Hive files product file missing

Warning: ...accumulo does not exist! AND only 5 instead of 6 Hive files product file missing

New Contributor

Hello, please see red highlight text below.  I will proceed to Tutorial Execersize 2 using Hue to see whether these errors will stop me from going forward with the next step in the tutorial.  I look forward to hearing from you.  Thank you.  George

 

[cloudera@quickstart ~]$ sqoop import-all-tables \
>     -m 1 \
>     --connect jdbc:mysql://quickstart:3306/retail_db \
>     --username=retail_dba \
>     --password=cloudera \
>     --compression-codec=snappy \
>     --as-avrodatafile \
>     --warehouse-dir=/user/hive/warehouse
Warning: /usr/lib/sqoop/../accumulo does not exist! Accumulo imports will fail.
Please set $ACCUMULO_HOME to the root of your Accumulo installation.
16/01/10 20:05:26 INFO sqoop.Sqoop: Running Sqoop version: 1.4.5-cdh5.4.2
16/01/10 20:05:26 WARN tool.BaseSqoopTool: Setting your password on the command-line is insecure. Consider using -P instead.
16/01/10 20:05:26 INFO manager.MySQLManager: Preparing to use a MySQL streaming resultset.
16/01/10 20:05:27 INFO tool.CodeGenTool: Beginning code generation
16/01/10 20:05:27 INFO manager.SqlManager: Executing SQL statement: SELECT t.* FROM `categories` AS t LIMIT 1
16/01/10 20:05:27 INFO manager.SqlManager: Executing SQL statement: SELECT t.* FROM `categories` AS t LIMIT 1
16/01/10 20:05:27 INFO orm.CompilationManager: HADOOP_MAPRED_HOME is /usr/lib/hadoop-mapreduce
Note: /tmp/sqoop-cloudera/compile/3db93774560bd8239db95846fece57c5/categories.java uses or overrides a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
16/01/10 20:05:30 INFO orm.CompilationManager: Writing jar file: /tmp/sqoop-cloudera/compile/3db93774560bd8239db95846fece57c5/categories.jar
16/01/10 20:05:30 WARN manager.MySQLManager: It looks like you are importing from mysql.
16/01/10 20:05:30 WARN manager.MySQLManager: This transfer can be faster! Use the --direct
16/01/10 20:05:30 WARN manager.MySQLManager: option to exercise a MySQL-specific fast path.
16/01/10 20:05:30 INFO manager.MySQLManager: Setting zero DATETIME behavior to convertToNull (mysql)
16/01/10 20:05:30 INFO mapreduce.ImportJobBase: Beginning import of categories
16/01/10 20:05:30 INFO Configuration.deprecation: mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
16/01/10 20:05:30 INFO Configuration.deprecation: mapred.jar is deprecated. Instead, use mapreduce.job.jar
16/01/10 20:05:31 INFO manager.SqlManager: Executing SQL statement: SELECT t.* FROM `categories` AS t LIMIT 1
16/01/10 20:05:31 INFO mapreduce.DataDrivenImportJob: Writing Avro schema file: /tmp/sqoop-cloudera/compile/3db93774560bd8239db95846fece57c5/sqoop_import_categories.avsc
16/01/10 20:05:31 INFO Configuration.deprecation: mapred.map.tasks is deprecated. Instead, use mapreduce.job.maps
16/01/10 20:05:32 INFO client.RMProxy: Connecting to ResourceManager at /0.0.0.0:8032
16/01/10 20:05:32 WARN security.UserGroupInformation: PriviledgedActionException as:cloudera (auth:SIMPLE) cause:org.apache.hadoop.mapred.FileAlreadyExistsException: Output directory hdfs://quickstart.cloudera:8020/user/hive/warehouse/categories already exists
16/01/10 20:05:32 ERROR tool.ImportAllTablesTool: Encountered IOException running import job: org.apache.hadoop.mapred.FileAlreadyExistsException: Output directory hdfs://quickstart.cloudera:8020/user/hive/warehouse/categories already exists
[cloudera@quickstart ~]$ hadoop fs -ls /user/hive/warehouse
Found 5 items
drwxr-xr-x   - cloudera hive          0 2016-01-10 20:02 /user/hive/warehouse/categories
drwxr-xr-x   - cloudera hive          0 2016-01-10 20:03 /user/hive/warehouse/customers
drwxr-xr-x   - cloudera hive          0 2016-01-10 20:03 /user/hive/warehouse/departments
drwxr-xr-x   - cloudera hive          0 2016-01-10 20:03 /user/hive/warehouse/order_items
drwxr-xr-x   - cloudera hive          0 2016-01-10 20:04 /user/hive/warehouse/orders
[cloudera@quickstart ~]$ hadoop fs -ls /user/hive/warehouse/categories/
Found 2 items
-rw-r--r--   1 cloudera hive          0 2016-01-10 20:02 /user/hive/warehouse/categories/_SUCCESS
-rw-r--r--   1 cloudera hive       1344 2016-01-10 20:02 /user/hive/warehouse/categories/part-m-00000.avro
[cloudera@quickstart ~]$ ls -l *.avsc
-rw-rw-r-- 1 cloudera cloudera  541 Jan 10 20:02 sqoop_import_categories.avsc
-rw-rw-r-- 1 cloudera cloudera 1324 Jan 10 20:02 sqoop_import_customers.avsc
-rw-rw-r-- 1 cloudera cloudera  409 Jan 10 20:03 sqoop_import_departments.avsc
-rw-rw-r-- 1 cloudera cloudera  980 Jan 10 20:03 sqoop_import_order_items.avsc
-rw-rw-r-- 1 cloudera cloudera  632 Jan 10 20:03 sqoop_import_orders.avsc
[cloudera@quickstart ~]$ sudo -u hdfs hadoop fs -mkdir /user/examples
[cloudera@quickstart ~]$ sudo -u hdfs hadoop fs -chmod +rw /user/examples
[cloudera@quickstart ~]$ hadoop fs -copyFromLocal ~/*.avsc /user/examples/

2 REPLIES 2

Re: Warning: ...accumulo does not exist! AND only 5 instead of 6 Hive files product file missing

New Contributor

in Hue Impala i executed per instructions in step 2 the following with the following results ie Show Tables on 5 and missing #6 or products:

0categories
1customers
2departments
3order_items
4orders

 

CREATE EXTERNAL TABLE categories STORED AS AVRO
LOCATION 'hdfs:///user/hive/warehouse/categories'
TBLPROPERTIES ('avro.schema.url'='hdfs://quickstart/user/examples/sqoop_import_categories.avsc');

CREATE EXTERNAL TABLE customers STORED AS AVRO
LOCATION 'hdfs:///user/hive/warehouse/customers'
TBLPROPERTIES ('avro.schema.url'='hdfs://quickstart/user/examples/sqoop_import_customers.avsc');

CREATE EXTERNAL TABLE departments STORED AS AVRO
LOCATION 'hdfs:///user/hive/warehouse/departments'
TBLPROPERTIES ('avro.schema.url'='hdfs://quickstart/user/examples/sqoop_import_departments.avsc');

CREATE EXTERNAL TABLE orders STORED AS AVRO
LOCATION 'hdfs:///user/hive/warehouse/orders'
TBLPROPERTIES ('avro.schema.url'='hdfs://quickstart/user/examples/sqoop_import_orders.avsc');

CREATE EXTERNAL TABLE order_items STORED AS AVRO
LOCATION 'hdfs:///user/hive/warehouse/order_items'
TBLPROPERTIES ('avro.schema.url'='hdfs://quickstart/user/examples/sqoop_import_order_items.avsc');

CREATE EXTERNAL TABLE products STORED AS AVRO
LOCATION 'hdfs:///user/hive/warehouse/products'
TBLPROPERTIES ('avro.schema.url'='hdfs://quickstart/user/examples/sqoop_import_products.avsc');

Re: Warning: ...accumulo does not exist! AND only 5 instead of 6 Hive files product file missing

New Contributor

And as expected here are the Query results.  See below.  How do I get the products table into the system or better question is how come given that I used the exact code per Tutorial Instructions why was the products table not included?  Thank you?

 

Your query has the following error(s):

AnalysisException: Table does not exist: default.products

 

-- Most popular product categories
select c.category_name, count(order_item_quantity) as count
from order_items oi
inner join products p on oi.order_item_product_id = p.product_id
inner join categories c on c.category_id = p.product_category_id
group by c.category_name
order by count desc
limit 10;