Hi I had the same problem, this means that spark can not find the R directory. The Hortonworks Spark version comes without the R directory: drwxr-xr-x 2 root root 4096 Dec 9 13:33 lib drwxr-xr-x 6 root root 4096 Dec 3 21:30 python drwxr-xr-x 3 root root 4096 Jul 8 22:58 R My solution was to download the Spark standalone version and copy the R directory to my Hortonworks Spark client. ... View more

Hi, yes you are right, .hbck is for offline meta repair. I guess you know the hbck tool: To check to see if your HBase cluster has corruptions, run hbck against your HBase cluster: $ ./bin/hbase hbck At the end of the commands output it prints OK or tells you the number of INCONSISTENCIES present. As you said after the deletion you don't have the option to do a offline meta repair, but in my opinion I would still keep the fail and delete some other stuff. ... View more