Member since
07-12-2023
2
Posts
0
Kudos Received
0
Solutions
07-12-2023
12:02 PM
Thank you so much!
... View more
07-12-2023
09:00 AM
Hello. I am trying to run explorative Pyspark code within a Databricks ApacheSpark environs. I am pretty sure this syntax is correct, but the subject-referenced apache.spark error keeps throwing. Any insights, please? databaseName = "database" desiredColumn = "variable" database = spark.sql(f"show tables in {databaseName} ").collect() display(database) tablenames = [] for row in database: cols = spark.table(row.tableName).columns listColumns= spark.table(row.tableName).columns if desiredColumn in listColumns: tablenames.append(row.tableName)
... View more
Labels:
- Labels:
-
Apache Spark