question Re: Exercise 3 : no response from intermediate_access_logs table creation query in Archives of Support Questions (Read Only)

Exercise 3 : no response from intermediate_access_logs table creation query

Mohan Reddy — Fri, 16 Sep 2022 09:42:37 GMT

Hi, 

Not getting any response When I execute below query. Its more than 3 hrs now and no response yet. I am running this query on Quick Start VM.

Could you please help me with this issue.

CREATE EXTERNAL TABLE intermediate_access_logs (
 ip STRING,
 date STRING,
 method STRING,
 url STRING,
 http_version STRING,
 code1 STRING,
 code2 STRING,
 dash STRING,
 user_agent STRING)
 ROW FORMAT SERDE 'org.apache.hadoop.hive.contrib.serde2.RegexSerDe'
 WITH SERDEPROPERTIES (
 'input.regex' = '([^ ]*) - - \\[([^\\]]*)\\] "([^\ ]*) ([^\ ]*) ([^\ ]*)" (\\d*) (\\d*) "([^"]*)" "([^"]*)"',
 'output.format.string' = "%1$s %2$s %3$s %4$s %5$s %6$s %7$s %8$s %9$s"
 )
 LOCATION '/user/hive/warehouse/original_access_logs';

Re: Exercise 3 : no response from intermediate_access_logs table creation query

jogalez — Sun, 04 Oct 2015 03:31:56 GMT

This is what i get when executing the query:

Error: Error while processing statement: FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask. MetaException(message:hdfs://quickstart.cloudera:8020/user/hive/warehouse/original_access_logs is not a directory or unable to create one) (state=08S01,code=1)
0: jdbc:hive2://quickstart:10000/default>

Re: Exercise 3 : no response from intermediate_access_logs table creation query

Mohan Reddy — Sun, 04 Oct 2015 04:12:26 GMT

It took around 4 Hrs to finish the query with errors.

I got an error saying that Failed to acquire locks

Re: Exercise 3 : no response from intermediate_access_logs table creation query

jogalez — Sun, 04 Oct 2015 04:22:54 GMT

This worked for me:

--remove existing directory

sudo -u hdfs hadoop fs rm /user/hive/warehouse/original_access_logs

--create the directory again

--see the results. must be drwxr ...

hadoop fs -ls /user/hive/warehouse

--Found 9 items
drwxr-xr-x - cloudera hive 0 2015-10-03 18:51 /user/hive/warehouse/categories
drwxr-xr-x - cloudera hive 0 2015-10-03 18:52 /user/hive/warehouse/customers
drwxr-xr-x - cloudera hive 0 2015-10-03 18:53 /user/hive/warehouse/departments
drwxr-xr-x - cloudera hive 0 2015-10-03 18:53 /user/hive/warehouse/order_items
drwxr-xr-x - cloudera hive 0 2015-10-03 18:54 /user/hive/warehouse/orders
drwxr-xr-x - hdfs hive 0 2015-10-03 21:17 /user/hive/warehouse/original_access_logs
drwxr-xr-x - hdfs hive 0 2015-10-03 19:33 /user/hive/warehouse/originala_access_logs
drwxr-xr-x - cloudera hive 0 2015-10-03 18:55 /user/hive/warehouse/products
drwxrwxrwx - admin hive 0 2015-10-03 20:37 /user/hive/warehouse/tokenized_access_logs

Re: Exercise 3 : no response from intermediate_access_logs table creation query

Mohan Reddy — Sun, 04 Oct 2015 15:08:45 GMT

No luck with the solution. Verified the permissions 9drwxr )

Any help?

Re: Exercise 3 : no response from intermediate_access_logs table creation query

Mohan Reddy — Sun, 04 Oct 2015 16:48:08 GMT

Resolved the issue. Issue is because Zookeeper service is not running.

Re: Exercise 3 : no response from intermediate_access_logs table creation query

jogalez — Mon, 05 Oct 2015 00:46:44 GMT

Sorry for the delay. Glad you find the solution.

Re: Exercise 3 : no response from intermediate_access_logs table creation query

Mohan Reddy — Mon, 05 Oct 2015 14:37:47 GMT

jogalez

No problem and thanks a log for all your prompt replies to my queries