https://community.cloudera.com/t5/Support-Questions/Rowwise-manipulation-of-a-DataFrame-in-PySpark/m-p/226333#M188193 <P>If have a DataFrame and want to do some manipulation of the Data in a Function depending on the values of the row.</P><PRE>my_udf(row): threshold = 10 if row.val_x &gt; threshold: row.val_x = another_function(row.val_x) row.val_y = another_function(row.val_y) return row else: return row<BR /></PRE><P style="margin-left: 20px;"></P><P style="margin-left: 40px;"></P><P>Does anyone know how to apply my udf to the DataFrame?</P> Tue, 22 Aug 2017 20:26:47 GMT lukas_mueller02 2017-08-22T20:26:47Z