The codec should be associated to the Hadoop configuration. In Scala: val hadoopConfig = new org.apache.hadoop.conf.Configuration() val hdfs = org.apache.hadoop.fs.FileSystem.get (hadoopConfig) val bzCodec = new org.apache.hadoop.io.compress.BZip2Codec() bzCodec.setConf (hadoopConfig) val outputFile = hdfs.create (new org.apache.hadoop.fs.Path (uriDest)) val outputStream = bzCodec.createOutputStream (outputFile) ... View more

It includes Spark 1.6 and 2.1. Hbase 1.1.2 https://2xbbhjxc6wk3v21p62t8n4d4-wpengine.netdna-ssl.com/wp-content/uploads/2017/03/Asparagus-2.6.png ... View more