Support Questions
Find answers, ask questions, and share your expertise

How to identify at cluster side that spark code is using datasets or dataframes

How to identify at cluster side that spark code is using datasets or dataframes

Explorer

Hi Team,

We are using HDP 3.1.0 and spark2.

Is there anyway to identify at cluster side about the spark job that particular job is using datasets or dataframe?

 

Regards,

Satya