Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

[NIFI] - GCPCredentialsControllerService - ListGCSBucket

Highlighted

[NIFI] - GCPCredentialsControllerService - ListGCSBucket

New Contributor

Hi all,

Anybody already used google ControllerService and GCSBucket ?

I don't know how use it to list bucket.

Without NIFI, i've used gsutil and a configuration file how has these parameters

gs_oauth2_refresh_token
proxy
proxy_port

Any help welcome

3 REPLIES 3

Re: [NIFI] - GCPCredentialsControllerService - ListGCSBucket

New Contributor

I am interested in this question as well...

an example will be highly appreciated

Re: [NIFI] - GCPCredentialsControllerService - ListGCSBucket

New Contributor

steps I took to get things working... I was trying to access cloud storage from a laptop running linux... ultimate goal was to put files from the laptop to the gcp using nifi.

1. generate a private key in JSON (https://cloud.google.com/storage/docs/authentication#service_accounts)

69427-screenshot-from-2018-04-10-10-02-02.png

2. private key (as json file) was loaded onto my local computer

3. made a reference to it in the configure controller service

69428-screenshot-from-2018-04-10-10-04-34.png

69429-screenshot-from-2018-04-10-10-05-17.png

4. loaded a file onto the gcp bucket and the action was recorded in data provenance

69430-screenshot-from-2018-04-10-10-06-25.png

I am new to using NiFi...

Re: [NIFI] - GCPCredentialsControllerService - ListGCSBucket

New Contributor

Hi Anand,

 

I just saw your post about NiFi to GCP. I repeated the same process and the ControllerService showed errors to me: 

 

Failed to invoke@OnEnabled method due to org.apache.nifi.reporting.InitializationException: java.io.lOException: Error reading credentials from stream, 'type' field not specified .java.io.lOException: Error reading credentials from stream, 'type' field not specified

 

Do you have 'type' field on your credentials json file? Thanks.