Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

remove a value from values in a datframe spark

remove a value from values in a datframe spark

Explorer

Hello guys i have the following code i did , i want to get a new dataframe from a dataframe in which each value=176-old value any help please

val spark = SparkSession.builder.master("local").appName("my-spark-app").getOrCreate
val df=spark.read.option("header",true).csv("hdfs://localhost:9000/data1/data_with_missing_values.csv").cache()
val dfNumber= df.describe(df.columns:_*).filter(col("summary") === "count").cache()
dfNumber.show
println("Number of rows :" + df.count())
14398-capture.png
Don't have an account?
Coming from Hortonworks? Activate your account here