I will be getting data from network via snmp or serial. Loading data from file is very fast , I did it manually first to check and it worked however when I try to do the same with my java code I get different errors.    I am trying few steps but getting error --   1. I wrote 1 miilion records into text file through java. 2. I tried to upload the generate text file into HDFS through my java code. 3. I am executing LOAD query through code.   However I am unable to execute step 2- 1. I tried java method of ProcessBuilder(), getRuntime.exec() but it didn't worked. Then I tried searching for some API to do following task but I was getting error-   java.io.IOException: No FileSystem for scheme: file at org.apache.hadoop.fs.FileSystem.getFileSystemClass(FileSystem.java:2584) at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:2591) at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:91) at org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:2630) at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:2612) at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:370) at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:169) at HdfsWriter.run(impala_crt.java:935) at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70) at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84) at impala_crt.writeFile(impala_crt.java:861) at impala_crt.main(impala_crt.java:106) Do you have any solution for this or there is some better method ?  ... View more

I agree that is super confusing ... View more

Hi Mogiking, On the version I was testing (CDH 6.2) the duration looks correct, but the queries do not show up until they are completely closed. I was able to force this from the Impala Daemon Web UI, or by waiting, or by closing hue. -Andrew     ... View more

Hi vaccarinicarlo, In the hadoop world where different components may have different rules about  cases sensitivity, it may be best to do as Alex Behm said above: "It's just easier to accept one canonical casing". I agree with you that it might be better to issue more warnings when anythign other than lower case is used. ... View more

Hi Andrew,   thanks for you reply.  We already use INVALIDATE METADATA <db>.<table>. In the meantime we saw this issue not only on invalidate statements but also on REFRESH,TRUNCATE or even SELECT commands.   Each time execution lasts for about 15 minutes until finished.   Any idea whats wrong here?   Thanks Ralf   ... View more

Hi Yasmin,   there's not much information there but it does sound like your HS2 can't connect to the HMS. If you didn't fix the space issues for HMS then maybe HMS isn't running well. You may find useful information in the HMS logs   -Andrew ... View more

I created https://issues.apache.org/jira/browse/IMPALA-7511 to track this issue -Andrew ... View more