I am new to HDP Sandbox and also find it quite slow. Using the example csv file from the getting started tutorial (https://hortonworks.com/tutorial/hadoop-tutorial-getting-started-with-hdp/), following cell takes 9 Seconds to execute. %spark2 val geoLocationDataFrame = spark.read.format("csv").option("header", "true").load("hdfs:///tmp/data/geolocation.csv") geoLocationDataFrame.createOrReplaceTempView("geolocation") Took 9 sec. Last updated by anonymous at June 25 2019, 3:02:48 PM. I would expect only a view ms to load some csv file. My VM setup is based on VmWare and has 10 GB Ram and 4 x 3.2 GHz. Is there some benchmark with reference numbers to know expected execution times or some sort of profiling tool to be able to easily find bottlenecks?
... View more
