Reply
Highlighted
Contributor
Posts: 26
Registered: ‎03-31-2017

Installing HDFS Google Cloud Connector

Hi,

 

I'm looking to ingest a large amount of data from a public google cloud bucket, but our cluster is currently missing the google cloud connector. I thought copying the connector jar to /opt/cloudera/parcels/CDH/lib/hadoop would be sufficient, but after running the below command I am receiving the following error: No FileSystem for scheme: gs.

 

hdfs dfs -cp gs://gnomad-public/release-170228/gnomad.genomes.r2.0.1.sites.vds /my/local/hdfs/filesystem

 

Are any additional steps beyond this necessary?

Announcements