Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

[NIFI] - GCPCredentialsControllerService - ListGCSBucket

Highlighted

[NIFI] - GCPCredentialsControllerService - ListGCSBucket

New Contributor

Hi all,

Anybody already used google ControllerService and GCSBucket ?

I don't know how use it to list bucket.

Without NIFI, i've used gsutil and a configuration file how has these parameters

gs_oauth2_refresh_token
proxy
proxy_port

Any help welcome

3 REPLIES 3

Re: [NIFI] - GCPCredentialsControllerService - ListGCSBucket

New Contributor

I am interested in this question as well...

an example will be highly appreciated

Re: [NIFI] - GCPCredentialsControllerService - ListGCSBucket

New Contributor

steps I took to get things working... I was trying to access cloud storage from a laptop running linux... ultimate goal was to put files from the laptop to the gcp using nifi.

1. generate a private key in JSON (https://cloud.google.com/storage/docs/authentication#service_accounts)

69427-screenshot-from-2018-04-10-10-02-02.png

2. private key (as json file) was loaded onto my local computer

3. made a reference to it in the configure controller service

69428-screenshot-from-2018-04-10-10-04-34.png

69429-screenshot-from-2018-04-10-10-05-17.png

4. loaded a file onto the gcp bucket and the action was recorded in data provenance

69430-screenshot-from-2018-04-10-10-06-25.png

I am new to using NiFi...

Re: [NIFI] - GCPCredentialsControllerService - ListGCSBucket

New Contributor

Hi Anand,

 

I just saw your post about NiFi to GCP. I repeated the same process and the ControllerService showed errors to me: 

 

Failed to invoke@OnEnabled method due to org.apache.nifi.reporting.InitializationException: java.io.lOException: Error reading credentials from stream, 'type' field not specified .java.io.lOException: Error reading credentials from stream, 'type' field not specified

 

Do you have 'type' field on your credentials json file? Thanks.

 

Don't have an account?
Coming from Hortonworks? Activate your account here