@Guillaume Roger Your steps are correct. Please be advised that the Compressed field in your DESCRIBED FORMATTED is not a reliable indicator of whether the table contains compressed data. It typically shows No, because the compression settings only apply during the session that loads data and are not stored persistently with the table metadata. The compression in desc formatted may be input or intermediate compression rather than output. Look at the actual files as they are stored for the Hive table in question. *** If this cleared the dilemma, please vote and accept it as the best answer. ... View more

@Nasheb Ismaily Yes. It is expected for FIFO policy. If you set a FIFO policy, then jobs are executed in the order you submitted them. You have the option to use FAIR policy. In that case, all jobs can be executed sharing fairly available resources and they don't have to wait one after the other. They will still start in the order you submitted, but based on what they do, they may finish in a different order. That assumes your cluster has enough resources and by design you wanted to go that way. I did not include references to various documents because they were already provided and are widely available. ... View more

@Prakash Punj You need to take the NameNode out of the Safe Mode. This is a common error encountered when the NameNode is moved to Safe Mode to take a checkpoint. Documentation instructions should probably be updated to add a warning. sudo su hdfs -l -c 'hdfs dfsadmin -safemode leave' ... View more

@Ken Jiiii You could create another file and call it from h_script.hql, or you just add lines to h_script.hql like the following: This set statements will override the global settings for that specific job session. Example of line: set mapred.reduce.tasks=32; Almost anything that is Hive global environments XML is game for override at session level. Look at this post: https://community.hortonworks.com/articles/22419/hive-on-tez-performance-tuning-determining-reducer.html This shows a lot of these set statements which you can include in your set_h_script.hql invoked from h_script.hql or in the block added the beginning of your h_script.hql. Personally, I prefer a separate file invoked from my job script. ... View more