Hi all, When I use both hive and impala to query 10000 lines data from one table which has 80000 lines. The result is like following: 1) First query using Hive: 9995 name9995 9996 name9996 9997 name9997 9998 name9998 9999 name9999 Time taken: 1.242 seconds, Fetched: 10000 row(s) hive> 2) Second query using Hive: 9995 name9995 9996 name9996 9997 name9997 9998 name9998 9999 name9999 Time taken: 0.092 seconds, Fetched: 10000 row(s) 3) First query using impala: | 9995 | name9995 | | 9996 | name9996 | | 9997 | name9997 | | 9998 | name9998 | | 9999 | name9999 | +------+----------+ WARNINGS: Backend 0:Unknown disk id. This will negatively affect performance. Check your hdfs settings to enable block location metadata. Fetched 10000 row(s) in 2.45s 4) Second query using impala: | 9995 | name9995 | | 9996 | name9996 | | 9997 | name9997 | | 9998 | name9998 | | 9999 | name9999 | +------+----------+ WARNINGS: Backend 0:Unknown disk id. This will negatively affect performance. Check your hdfs settings to enable block location metadata. Fetched 10000 row(s) in 2.45s I noted the warnings, and i have already set the value of dfs.datanode.hdfs-blocks-metadata.enabled true. This is the part of the configuration pasted from page https://192.168.10.11:25000/hadoop-varz dfs.datanode.hdfs-blocks-metadata.enabled true Sorry for that I cann't adjust the format of the form. I don't know why impala still reports this warnings when my hdfs settings to enable block location metadata By the way, number of machines of impala cluster is 4, machine whose ip is 192.168.10.11 runs statestore, impalad, catalogd, machine whose ip are from 192.168.10.12-192.168.10.14 run impalad service. And I use the way of building tar ball of impala-2.0.0-cdh5.2.0 which is downloaded from github. Also I replace the cdh hadoop using apache hadoop. Do I use impala rightly? Regards ... View more

Hi all, I have built impala-2.2.0-cdh5.2.0 successfully, but now encoutering such an error when start impala:   ./bin/start-impalad.sh -use_statestore=false   ls: cannot access /root/tmp/impala-2.0.0-cdh5.2.0/testdata/target/dependency/*.jar: No such file or directory WARNING: Logging before InitGoogleLogging() is written to STDERR E1124 10:02:56.927497 32634 init.cc:117] CPU does not support the Supplemental SSE3 instruction set, which is required. This could lead to instability. E1124 10:03:01.697876 32634 impala-server.cc:213] ERROR: short-circuit local reads is disabled because - Impala cannot read or execute the parent directory of dfs.domain.socket.path E1124 10:03:01.698104 32634 impala-server.cc:215] Aborting Impala Server startup due to improper configuration he   By the way, i build impala using option -skiptests, so the first warning will not have affect.   the part configuration of hdfs-site.xml is: <property> <name>dfs.domain.socket.path</name> <value>/root/cdhhadoop/dn</value> <description></description> </property>   and the permission of directory of /root/cdhhadoop and /root/cdhhadoop/dn is: ls  /root/ -lh drwxr-xr-x  4 root root 4.0K Nov 24 09:48 cdhhadoop ls /root/cdhhadoop/ -lh drwxr-xr-x 2 root root 4.0K Nov 24 09:48 dn both of them have r+x permisson.   Is there anything i miss?   Regards ... View more

Hi everyone, I am now encoutering such errors when i compile the impala-2.0.0-cdh5.2.0 src tarball, which is download from  http://archive.cloudera.com/cdh5/cdh/5/impala-2.0.0-cdh5.2.0-src.tar.gz . This is part of the errors:   [INFO] ------------------------------------------------------------- [WARNING] COMPILATION WARNING : [INFO] ------------------------------------------------------------- [WARNING] package com.cloudera.impala.thrift /root/workplace/impala-2.0.0-cdh5.2.0/fe/src/main/java/com/cloudera/impala/util/UnsafeUtil.java:[21,15] Unsafe is internal proprietary API and may be removed in a future release [WARNING] /root/workplace/impala-2.0.0-cdh5.2.0/fe/src/main/java/com/cloudera/impala/util/UnsafeUtil.java:[30,22] Unsafe is internal proprietary API and may be removed in a future release [WARNING] /root/workplace/impala-2.0.0-cdh5.2.0/fe/src/main/java/com/cloudera/impala/util/UnsafeUtil.java:[37,14] Unsafe is internal proprietary API and may be removed in a future release [WARNING] /root/workplace/impala-2.0.0-cdh5.2.0/fe/src/main/java/com/cloudera/impala/util/UnsafeUtil.java:[42,24] Unsafe is internal proprietary API and may be removed in a future release [INFO] 4 warnings [INFO] ------------------------------------------------------------- [INFO] ------------------------------------------------------------- [ERROR] COMPILATION ERROR : [INFO] ------------------------------------------------------------- [ERROR] /root/workplace/impala-2.0.0-cdh5.2.0/fe/src/main/java/com/cloudera/impala/analysis/TableName.java:[20,33] error: cannot find symbol [ERROR] package com.cloudera.impala.thrift /root/workplace/impala-2.0.0-cdh5.2.0/fe/src/main/java/com/cloudera/impala/analysis/TableName.java:[88,37] error: cannot find symbol [ERROR] class TableName /root/workplace/impala-2.0.0-cdh5.2.0/fe/src/main/java/com/cloudera/impala/analysis/TableName.java:[92,9] error: cannot find symbol [ERROR] class TableName /root/workplace/impala-2.0.0-cdh5.2.0/fe/src/main/java/com/cloudera/impala/analysis/CreateDropRoleStmt.java:[19,33] error: cannot find symbol [ERROR] package com.cloudera.impala.thrift   And I found that there isn't one direcotry named thrift in the path /root/workplace/impala-2.0.0-cdh5.2.0/fe/src/main/java/com/cloudera/impala/, I think it should have. Is there anything I miss?   By the way, the system information is: 1) OS LSB Version: :base-4.0-amd64:base-4.0-noarch:core-4.0-amd64:core-4.0-noarch Distributor ID: CentOS Description: CentOS release 6.5 (Final) Release: 6.5 Codename: Final   Linux version 2.6.32-431.el6.x86_64 (mockbuild@c6b8.bsys.dev.centos.org) (gcc version 4.4.7 20120313 (Red Hat 4.4.7-4) (GCC) ) #1 SMP Fri Nov 22 03:15:09 UTC 2013   2) jdk java version "1.7.0_71" Java(TM) SE Runtime Environment (build 1.7.0_71-b14) Java HotSpot(TM) 64-Bit Server VM (build 24.71-b01, mixed mode)   3) gcc Using built-in specs. COLLECT_GCC=gcc COLLECT_LTO_WRAPPER=/usr/libexec/gcc/x86_64-unknown-linux-gnu/4.8.3/lto-wrapper Target: x86_64-unknown-linux-gnu Configured with: ./configure --prefix=/usr --enable-checking=release --enable-languages=c,c++,java --disable-multilib --with-gmp=/usr/local/gmp-4.3.2 --with-mpfr=/usr/local/mpfr-2.4.2 --with-mpc=/usr/local/mpc-1.0.2 Thread model: posix gcc version 4.8.3 (GCC)   4) llvm llvm-3.3.src.tar.gz   5) boost boost_1_56_0.tar.bz2   Can anyone give me a hand? By the way, I have modified some of the cpp source code due to the cpp compile errors. The java code compile errors come out after the cpp compile errors disappear. Maybe I shouldn't change the cpp code, is there any specific configuration about both of cpp and java code that i miss? ... View more