This method of using yarn command does not cover the use case of running HDInsight cluster on demand when cluster created to run the pipeline and then deleted. One approach is to use https://github.com/shanyu/hadooplogparser . Is there any option to configure YARN logger to produce text and not TFile binary format? ... View more