In the hive node I don't have a jdbc folder there: This is what I have: drwxr-xr-x 7 root root 4096 Sep 27 13:31 ./ drwxr-xr-x 35 root root 4096 Sep 27 15:16 ../ drwxr-xr-x 3 root root 4096 Sep 27 13:28 bin/ lrwxrwxrwx 1 root root 23 Sep 27 13:31 conf -> /etc/hive/2.6.2.0-205/0/ drwxr-xr-x 3 root root 4096 Sep 27 13:28 doc/ -rw-r--r-- 1 root root 106117252 Aug 26 12:31 hive.tar.gz drwxr-xr-x 5 root root 12288 Sep 27 15:25 lib/ drwxr-xr-x 2 root root 4096 Sep 27 13:28 man/ drwxr-xr-x 3 root root 4096 Sep 27 13:28 scripts/ ... View more

Thanks. Is this is for simba specifically? My app is a jdbc based app - and I get the jars using maven and just set the driver in config and expect the code to just work. From the zip for jdbc 4.1 not clear which version of hive-jdbc is used? For example this zip uses the HS1Driver while I thought I should use: org.apache.hive.jdbc.HiveDriver ... View more

Super, Thanks. ... View more

@Shu That that the initial loads works for me - what are the parquet format pros and cons? Is the creating new table and copying data from the text based table into it worth the trouble? ... View more

@Shu hadoop fs -ls /apps/hive/ Yields Found 1 items drwxrwxrwx - hive hadoop 0 2017-10-02 14:00 /apps/hive/warehouse You mean the Load statement and not the insert, right? Attached is the error and last lines from log. ... View more

@Shu the ls output: Found 1 items drwxrwxrwx - hive hadoop 0 2017-10-01 18:01 /apps/hive/warehouse/csvdemo which of these do you need? drwxr-xr-x 2 hive hadoop 4096 Oct 2 00:00 ./ drwxrwxr-x 40 root syslog 4096 Oct 2 06:25 ../ -rw-r--r-- 1 hive hadoop 0 Oct 1 13:51 atlas_hook_failed_messages.log -rw-r--r-- 1 hive hadoop 312 Oct 1 14:36 hive.err -rw-r--r-- 1 hive hadoop 581226 Oct 2 11:51 hivemetastore.log -rw-r--r-- 1 hive hadoop 290424 Sep 28 23:57 hivemetastore.log.2017-09-28 -rw-r--r-- 1 hive hadoop 1195294 Sep 29 23:57 hivemetastore.log.2017-09-29 -rw-r--r-- 1 hive hadoop 1173882 Sep 30 23:57 hivemetastore.log.2017-09-30 -rw-r--r-- 1 hive hadoop 1309208 Oct 1 23:57 hivemetastore.log.2017-10-01 -rw-r--r-- 1 hive hadoop 31 Oct 1 14:36 hive.out -rw-r--r-- 1 hive hadoop 112944 Oct 1 18:02 hive-server2.err -rw-r--r-- 1 hive hadoop 1189192 Oct 2 11:51 hiveserver2.log -rw-r--r-- 1 hive hadoop 32095865 Sep 27 16:30 hiveserver2.log.2017-09-27 -rw-r--r-- 1 hive hadoop 88093181 Sep 28 23:57 hiveserver2.log.2017-09-28 -rw-r--r-- 1 hive hadoop 2368106 Sep 29 23:57 hiveserver2.log.2017-09-29 -rw-r--r-- 1 hive hadoop 2368598 Sep 30 23:57 hiveserver2.log.2017-09-30 -rw-r--r-- 1 hive hadoop 23657102 Oct 1 23:57 hiveserver2.log.2017-10-01 -rw-r--r-- 1 hive hadoop 0 Oct 1 14:37 hive-server2.out ... View more

@Shu I run hadoop fs -chmod 777 /apps/hive/warehouse/csvdemo Still ,same error in my java client: java.sql.SQLException: Error while processing statement: FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.MoveTask ... View more

Thanks @Shu. Is the parquet worth the double load? I mean If I run just the first load it seems to work fine - so what am I loosing here? Also - I have an issue running this load from java client (permissions issue?) java.sql.SQLException: Error while processing statement: FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.MoveTask at org.apache.hive.jdbc.HiveStatement.execute(HiveStatement.java:283) ~[hive-jdbc-2.0.0.jar:2.0.0] ... View more