Hi guys, I still don't get the point of specifying the variable while you provide entire path to the spark2 client. Could you please give me a reason for doing so? On HDP 2.6.2 I use there is enough to specify a path to appropriate spark client and then the version is chosen automatically. ... View more

Hi, I found out that when using Tez (an execution engine on Hive) you should use another parameter to get as an output only 1 file: SET hive.merge.tezfiles=true; Tez in many cases is faster than MR2 engine, to verify what execution engine you use run on Hive: SET hive.execution.engine; if you want to switch to Tez, just set it etiher in hive-site,xml or for each Hive session: SET hive.execution.engine=tez;Best regards, Michał ... View more