Hi dear experts!   i trying to play with Impala optimizations and for optimizing datastore want to apply order by construction during insert operation, like:     create table tab_parquet like tab_text stored as parquet; insert into tab_parquet select * from tab_text order by col1;   but got:   An ORDER BY appearing in a view, subquery, union operand, or an insert/ctas statement has no effect on the query result unless a LIMIT and/or OFFSET is used in conjunction with the ORDER BY   goes anybody know how to bypass this?   PS. i use CDH5.4 # impala-shell --version Impala Shell v2.2.0-cdh5 (2ffd73a) built on Tue Apr 21 12:09:21 PDT 2015   thanks! ... View more

Hi dear experts!   could anybody know does parquet index page available for Impala(https://github.com/Parquet/parquet-format)? if so, where i can find more information about that?   thank you in advance! ... View more

Hi dear experts!   i have interest of possobility to force encode for given column: https://github.com/Parquet/parquet-format/blob/master/Encodings.md   is it possible and is it supported?   thank you in adavance! ... View more

Hi dear experts!   does anybody know is there available any VM for Spark/Scala development (with preinstalled IDE - i have some problems with IDEA and Eclipse configuration)?   thanks! ... View more

Hi dear experts!   i following the instruction: http://www.cloudera.com/content/cloudera/en/documentation/core/latest/topics/cm_mc_resource_pools.html   and trying to set some user restrictions for different resource pool. for example i have two dynamic resource pool - production and test + default resourse pool. i would like to allow apply jobs in production pool only for user1 and hdfs users. For test - user2. Other could apply jobs for default pool.   i think this instruction explain how to do this, but i'm not able to do this:       any advice is apreciate!  ... View more

Hi dear community!   i tried to track MR container (mapper) through Java Mission Control (JMC) and through visualvm. In both cases I got some error:   if i would profile spark - no problem. Goal of this action to understand which Java classes consume much more CPU resource. could anybody tell how to fix this profiling or which tool could show which Java Classes use much more resources in MR container.   also add example with visualvm with NodeManager (it doesn't works as well as MR container, and Spark worker profile - it's what i want to get)         what I want to get: thanks in advance!   ... View more