About mesteph6

mesteph6 · ‎05-17-2016

Ahhh. Originally I loaded on windows machine and was getting the "incorrect/corrupt format" error so i thought switching over to the sandbox would help. i didn't realize by default that it loads from hdfs! so now, i have edited the JSON document and re-tried loading it in the spark-shell in windows, it works 🙂 so u answered both questions i had! thank u sir.

mesteph6 · ‎05-17-2016

hi - i am trying to load my json file using spark and cannot seem to do it correctly. the path at the end of this bit of scala. the file is located on my sandbox in the tmp folder. i've tried: val df2 = sqlContext.read.format("json").option("samplingRatio", "1.0").load("/tmp/rawpanda.json") any help would be great thanks. mark

mesteph6 · ‎05-16-2016

hi - i am trying to load my json file using spark and cannot seem to do it correctly. the path at the end of this bit of scala. the file is located on my sandbox in the tmp folder. i've tried: val df2 = sqlContext.read.format("json").option("samplingRatio", "1.0").load("/tmp/rawpanda.json") any help would be great thanks. mark

Online	Offline
Last Visited	‎06-22-2016 06:55 PM

Member Since	‎05-16-2016 03:37 AM
Last Visited	‎06-22-2016 06:55 PM
Posts	3

Cloudera Community

Re: input path on sandbox for loading data into sp...

input path on sandbox for loading data into spark ...

json file input path for loading into spark