Can I execute scripts involving 3rd part ETL Tool using Yarn Distributed Shell?
Currently I am able to execute DTL scripts inside shell script (.sh file). But whenever I am trying execute same using yarn distributed shell, it is throwing error as "command not found". Any suggestions to resolve this!
Thanks @gkeys, I am using DMX ETL tool only :). But I am getting " dmexpress: command not found " error while running DMX script using yarn distributed shell. Below observations, I have noted
1. I have DMX installed in all the nodes of the my cluster and able to run scripts in all nodes locally.
2. Although, Same DMX Script is running fine inside shell script, It is throwing above error while running using yarn distributed shell.
Kindly suggest which all areas I need to check to resolve this.
Syncsort is a 3rd party partner of ours. We work very closely with them but we do not support them. I suggest you head over to their support site http://bigdatakb.syncsort.com/Default.htm#KB/FAQ/297_Creating_DMX-h_Job_Tutorial.htm