Member since
04-02-2017
4
Posts
0
Kudos Received
0
Solutions
05-27-2018
10:57 AM
Hi,
I follow this tutorial https://fr.hortonworks.com/tutorial/setting-up-a-spark-development-environment-with-python/ I install 1.sandbox 2.Python 3.Pycham 4.Download and Save Dataset But by executing this code : from pyspark importSparkContext,SparkConf
conf =SparkConf().setAppName('MyFirstStandaloneApp') sc =SparkContext(conf=conf)
text_file = sc.textFile("./shakespeare.txt")
counts = text_file.flatMap(lambda line: line.split(" ")) \.map(lambda word:(word,1)) \.reduceByKey(lambda a, b: a + b)print("Number of elements: "+ str(counts.count())) counts.saveAsTextFile("./shakespeareWordCount") I get this error After that, I downloaded Winutilis and a create a folter C:\winutils\bin and i copied it Inside. Second i edited the enviroment variable by creating Hadoop_home and this path : C:\winutils\bin (See the picture I rexecute the code and i have the same error…:(
... View more
05-25-2018
07:36 PM
Hi, I follow the tutorial but i get this error ERROR Shell:397 - Failed to locate the winutils binary in the hadoop binary path
java.io.IOException: Could not locate executable null\bin\winutils.exe in the Hadoop binaries. How can i fix it ? Thks
... View more
Labels: