Hi, This is Cloudera Express 5.10.0 ... View more

Hello   An example: https://stackoverflow.com/questions/38086684/hadoop-fs-du-h-sorting-by-size-for-m-g-t-p-e-z-y ... View more

Hello   Check your client library files are in the CLASSPATH   Caused by: java.lang.NoClassDefFoundError: Could not initialize class org.janusgraph.diskstorage.es.rest.RestElasticSearchClient ... View more

Hello   I am not sure the data in your Hive table got duplicates? Maybe try SELECT DISTINCT? ... View more

Hello   Impala doesn't support parameterized view   Some walk arounds been discussed here: https://stackoverflow.com/questions/52063217/create-parameterized-view-in-impala ... View more

Hello   One example: https://stackoverflow.com/questions/44235019/delete-files-older-than-10days-on-hdfs ... View more

Hello   Here is a good post FYR https://medium.com/@goyalsaurabh66/project-tungsten-and-catalyst-sql-optimizer-9d3c83806b63 ... View more

Thank you, I appreciate the comment. This issue occurs after a hive sql query that joins around 15 tables(some of them big) so I think broadcast join do not applies, salting would imply breaking down the query and running the joins on spark functions instead of hive sql, because of the number of tables it can be time consuming, so my question is, is there any other way to force spark do distribute the partitions evenly to executors?  ... View more

After I have checked the permission in Ranger, I noticed that there isn't any policy setup for hive user. I did add a policy to allow access to the folder /user/admin in HDFS to hive user. The problem is I cannot save the new policy due to another security error as show below.  I wonder if the Hortonworks Sandbox HDP 3.0 that I downloaded is working version 😞       ... View more