I am trying to update the value of a record using spark sql in spark shell I get executed the command Update tablename set age=20 where name=justin, and I am getting the following errors scala> val teenagers = sqlContext.sql("UPDATE people SET age=20 WHERE name=Justin") java.lang.RuntimeException: [1.1] failure: ``with'' expected but identifier UPDATE found UPDATE people SET age=20 WHERE name=Justin ^ at scala.sys.package$.error(package.scala:27) at org.apache.spark.sql.catalyst.AbstractSparkSQLParser.parse(AbstractSparkSQLParser.scala:36) ...... Thanks Sridhar ... View more

When I am trying to import CreateSchemaRDD from SQL Context it is creating error in spark shell scala> sc res4: org.apache.spark.SparkContext = org.apache.spark.SparkContext@4345fd45 scala>val sqlContext = new org.apache.spark.sql.SQLContext(sc) sqlContext: org.apache.spark.sql.SQLContext = org.apache.spark.sql.SQLContext@293432e6 scala> import sqlContext.createSchemaRDD <console>:31: error: value createSchemaRDD is not a member of org.apache.spark.sql.SQLContext import sqlContext.createSchemaRDD however, createSchemaRDD is not shown as a member when I press TAB button, but this is given in the Spark SQL Documentation as a correct command. Thanks Sridhar ... View more

I am trying to access a file in HDFS with the help of Spark Scala command in Spark Shell Hadoop HDFS file URL is localhost:50070/sridhar/hadoop/sample.txt I executed scala> val file = sc.textFile("hdfs://localhost:50070/sridhar/hadoop/sample.txt") then executed scala> file.foreach(println) , got the following errors java.io.IOException: Failed on local exception: com.google.protobuf.InvalidProtocolBufferException: Protocol message end-group tag did not match expected tag.; Host Details : local host is: "sridhar25/127.0.1.1"; destination host is: "localhost":50070; at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:772) at org.apache.hadoop.ipc.Client.call(Client.java:1472) at org.apache.hadoop.ipc.Client.call(Client.java:1399) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at com.sun.proxy.$Proxy33.getFileInfo(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getFileInfo(ClientNamenodeProtocolTranslatorPB.java:752) How to access the files without errors? Thanks! ... View more