Member since
09-22-2017
4
Posts
0
Kudos Received
0
Solutions
10-19-2017
09:44 AM
Step 4 from the instructions above will lead to data loss if you was using the VM, so please backup your VM first! I am supporting training VM for my organization, where users have imported some data and installed apps. Now we have to restore the VM, because the default image does not contained user data and administration changes.
... View more
09-23-2017
12:19 PM
We should use Hive Query Editor since some of the Examples syntax is not compatible with Impala and the tables are not created correctly. i.e. https://community.cloudera.com/t5/Hadoop-101-Training-Quickstart/Unable-to-execute-add-jar-command-as-mentioned-in-Exercise-2/m-p/60237#M5644
... View more
09-22-2017
05:33 PM
I have removed the ADD JAR command (not supported in Impala) for the Tutorial Exercise 2 and Impala at Hue. It worked, but the data has not been parsed correctly so we should use Hive query editor. Also there is note for HiveServer2 (https://www.cloudera.com/documentation/enterprise/5-6-x/topics/cm_mc_hive_udf.html) We can find the library location in Linux: [cloudera@quickstart hive]$ sudo su - [root@quickstart ~]# find / -name hive-contrib.jar /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/filecache/1019/hive-contrib.jar /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/filecache/114/hive-contrib.jar /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/filecache/476/hive-contrib.jar /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/filecache/295/hive-contrib.jar /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/filecache/838/hive-contrib.jar /var/lib/hadoop-yarn/cache/yarn/nm-local-dir/usercache/cloudera/filecache/657/hive-contrib.jar /usr/lib/hive/lib/hive-contrib.jar /usr/lib/oozie/oozie-sharelib-mr1/lib/hive/hive-contrib.jar /usr/lib/oozie/oozie-sharelib-yarn/lib/hive/hive-contrib.jar
... View more
09-22-2017
05:02 PM
I was able to create the table with Impala in Hue using this syntax: CREATE EXTERNAL TABLE intermediate_access_logs ( ip STRING, `date` STRING, method STRING, url STRING, http_version STRING, code1 STRING, code2 STRING, dash STRING, user_agent STRING) WITH SERDEPROPERTIES ( 'input.regex' = '([^ ]*) - - \\[([^\\]]*)\\] "([^\ ]*) ([^\ ]*) ([^\ ]*)" (\\d*) (\\d*) "([^"]*)" "([^"]*)"', 'output.format.string' = "%1$$s %2$$s %3$$s %4$$s %5$$s %6$$s %7$$s %8$$s %9$$s") LOCATION '/user/hive/warehouse/original_access_logs'; I was using the backquote (backward apostrophe) ` on line 3 Also I have removed the row format clause since it is not needed in Impala (check the doc: https://www.cloudera.com/documentation/enterprise/5-5-x/topics/impala_create_table.html#create_table).
... View more