Please use commands mentioned here: https://oozie.apache.org/docs/4.3.0/DG_CommandLineTool.html#Getting_list_of_available_sharelib to check if your sharedlib was installed correctly. Cheers Eric ... View more

Thanks Lars for pointing it out. So solution is to disable HDFS shortcircuit read for coordinator only impala daemons:   a) create a new role group and add all coordinator only impala daemon hosts to this group b) Go to "CM -> Cluster -> Impala services -> Configuration"; c) Add the following property into "Impala Daemon HDFS Advanced Configuration Snippet (Safety Valve)" for the new role group that you just created: <property> <name>dfs.client.read.shortcircuit</name> <value>false</value> </property> d) Save the changes and restart the Impala Daemon instance that are affected. Hope above can help. Cheers Eric ... View more

Hi, The purpose of compression is to save space, not speed up query time. Compression actually adds overhead to decompress the data before data can be read, so I would expect the query against compressed data will be slightly slower than uncompressed. So what you see is totally normal to me. Cheers Eric ... View more

Hi, I do not think there is any different. Spark lazily executes statements, so you second 2 jobs version will behave the same way as the first single job, in my opinion. Cheers Eric ... View more

Hi, It looks like that you have set configuration hive.query.redaction.rules somewhere, though I can't see it from the command you ran. Couple of things to check: 1. run "which beeline" to confirm that you are running original beeline command, not a custom one 2. check under ~/.beeline directory to see if there is any user level files that might override the default settings 3. use different users to run beeline to see if there is any differences. Thanks Eric ... View more