I have the following join which is making my spark application hang here and never produces the result. Is OR condition on supported in Spark Dataframes?
DataFrame DFJoin = DF1.join(DF2, DF1.col("device").equalTo(DF2.col("id")).or(DF1.col("device").equalTo(DF2.col("new_id"))), "inner");