Skip to main content
nabilraza456
Silver ⭐️⭐️
Mar 27, 2023 7:50 PM UTC
Question

How to get Processor ID in CDF

Hi All,

 

I am new to CDF Nifi(1.18) and it doesn't support API calls I wanted to save variable data as the link of the flow. I need the processor ID to concatenate it to the link of the Nifi. 


In HDF I was able to do that using API calls in bulk but in CDF I am not able to do due to the limitations of API. Can we do anything to fetch the processor ID of the current processor group? 

 

CFM: 2.2.6.0

Nifi: 1.18.0

Public Cloud

 

Thanks in advance

6 replies

DianaTorres
Community Manager
Community Manager
Mar 28, 2023 12:27 AM UTC

@nabilraza456 Welcome to the Cloudera Community!

To help you get the best possible solution, I have tagged our NiFi experts @SAMSAL @cotopaul and @MattWho  who may be able to assist you further.

Please keep us updated on your post, and we hope you find a satisfactory solution to your query.

Translate
Regards, Diana Torres, Senior Community Moderator
MattWho
Titanium ⭐️⭐️
Titanium ⭐️⭐️
Mar 30, 2023 8:37 PM UTC

@nabilraza456 
I am curious about the solution you said worked in HDF? Can you share that with me?
I'd like to explore how that capability changed going to CFM.

Thanks,

Matt

Translate
nabilraza456
Silver ⭐️⭐️
Mar 30, 2023 9:58 PM UTC

Hi @MattWho  - Actually, I was migrating the flows from HDF to CDP and in HDF we were creating the complete URL along with the processor_group_id. 

 

I achieve the same using nipyapi in HDF but cannot do the same on CDP. Can you help me in CDP how can I fetch the processor ID in CDP as you know the processor ID is unique and changed when we upload the template to the Nifi. 

Translate
nabilraza456
Silver ⭐️⭐️
Apr 8, 2023 9:42 PM UTC

Any update? @DianaTorres @MattWho 

Translate
DigitalPlumber
Gold ⭐️
Gold ⭐️
Apr 10, 2023 7:02 PM UTC

Could you explain more what limitations you have on CDP?

Is this Public Cloud?

We certainly expect there to be no limitations ....

To get PG ID's you can run API call:

 

flow/process-groups/root/status?recursive=true

Translate
nabilraza456
Silver ⭐️⭐️
Apr 16, 2023 2:15 PM UTC

Hi @DigitalPlumber  - Yes it is Public Cloud. I use NiPyAPI on HDF where I was able to add any variable etc using that library. 

 

In CDP, I want to get the current processor ID. It can be via expression language or by API. How can I achieve that? For example, I want to fetch all the PutS3 processors ID then how can I get that? 

 

Translate