@prsingh You need to pass databricks csv dependencies, either you need to download the jar or pass dependencies at run time. 1) download the dependency at run time pyspark --packages com.databricks:spark-csv_2.10:1.2.0 df = sqlContext.read.load('file:///root/file.csv',format='com.databricks.spark.csv',header='true',inferSchema='true') or 2) pass the jars while starting a) downloaded the jars as follow: wget http://search.maven.org/remotecontent?filepath=org/apache/commons/commons-csv/1.1/commons-csv-1.1.jar -O commons-csv-1.1.jar wget http://search.maven.org/remotecontent?filepath=com/databricks/spark-csv_2.10/1.0.0/spark-csv_2.10-1.0.0.jar -O spark-csv_2.10-1.0.0.jar b) then start the python spark shell with the arguments: ./bin/pyspark --jars "spark-csv_2.10-1.0.0.jar,commons-csv-1.1.jar" c) load as dataframe df = sqlContext.read.load('file:///root/file.csv',format='com.databricks.spark.csv',header='true',inferSchema='true') Let me know if above helps! ... View more

@prsingh That seems to be a bug, let's disable the ACL for ZK, by adding below in zookeeper-env.sh -Dzookeeper.skipACL=yes 1) Stop HBase 2) Add -Dzookeeper.skipACL=yes in zookeeper-env.sh export SERVER_JVMFLAGS="$SERVER_JVMFLAGS -Dzookeeper.skipACL=yes -Djava.security.auth.login.config={{zk_server_jaas_file}}" 3) rmr /hbase-secure/table/hbase:acl 4)revert back the change in step 2 -Dzookeeper.skipACL=yes 5) Restart HBase again 6) Try grant it should work now ... View more

thanks for confirming , so what i wrote is correct that is changing dfs.blocksize . restart anyways will happen ... View more