I am trying to load csv file to pyspark through the below query. sample = sqlContext.load(source="com.databricks.spark.csv", path = '/tmp/test/20170516.csv', header = True,inferSchema = True) But I am getting a error saying py4j.protocol.Py4JJavaError: An error occurred while calling o137.load. : java.lang.ClassNotFoundException: Failed to find data source: com.databricks.spark.csv. Please find packages at http://spark-packages.org ... View more

Yarn Web Interface reporting '0' for many metrics for successfully completed applications. { "id": "application_1480114771287_15299", "user": "xx", "name": "usr", "queue": "default", "state": "FINISHED", "finalStatus": "SUCCEEDED", "progress": 100, "trackingUI": "History", "trackingUrl": "http://<HOST>:8088/proxy/application_1480114771287_15299/", "diagnostics": "", "clusterId": 1480114771287, "applicationType": "MAPREDUCE", "applicationTags": "", "startedTime": 0, "finishedTime": 0, "elapsedTime": 0, "allocatedMB": 0, "allocatedVCores": 0, "runningContainers": 0, "memorySeconds": 172160, "vcoreSeconds": 49, "queueUsagePercentage": 0, "clusterUsagePercentage": 0, "preemptedResourceMB": 0, "preemptedResourceVCores": 0, "numNonAMContainerPreempted": 0, "numAMContainerPreempted": 0 } ... View more

Not able to insert data into hive table through spark scala> sqlContext.sql("insert into table results_test_hive values('XXXXXXXXXX', 'm:X', 0.0)") Failed with below error, org.apache.spark.sql.AnalysisException: Unsupported language features in query: insert into table results_test_hive values('XXXXXXXXXX', 'm:X', 0.0) ... View more

While granting user permission in HBase, it is failing with error. Recently we have de-kerberized and kerberized the Cluster. "ERROR ArgumentError: DISABLED: Security features are not available" ... View more