Member since
04-15-2021
30
Posts
1
Kudos Received
0
Solutions
08-25-2021
04:34 AM
is it possible to fetch the data from application , which does not provide RestAPI endpoint? From browser, I am able to get the data but not from InvokeHttp Processor. Please suggest how to implement this scenario in Nifi. thanks!
... View more
Labels:
- Labels:
-
Apache NiFi
08-19-2021
11:24 PM
is it possible to fetch/get data from application which does not provide any REST API endpoint, using Invokehttp processor . Please help me in this case. Looking forward to get reply over this. thanks!
... View more
Labels:
- Labels:
-
Apache NiFi
08-13-2021
08:16 AM
We have Self-service desk (SSD) to raise support ticket. I wanted to integrate SSD with nifi.Like as soon as any user submit any request, it should trigger the nifi pipeline. Require guidance how to achieve this task. Thanks!
... View more
- Tags:
- NiFi
Labels:
- Labels:
-
Apache NiFi
08-12-2021
03:19 AM
I have installed Nifi locally and recieved the below error, could some one please let me know what need to be done. It would be great help if provided in detailed. thanks!
... View more
Labels:
- Labels:
-
Apache NiFi
08-11-2021
09:46 AM
I have to validate value of some attribute of flowfile against MSSQl database. Attribute Keys are Key_project and Project_Name and Table name is CreateProject with column as Projectkeys(it will have all the values of Key_project) and Name(contain the ProjectName). I have to check the values of attributes from upstream processor whether they are present in database or not. I have used LookupAttribute processor along with SimpledatabaseLookup service, but no success. Could someone help me how to configure SimpledatabaseLookup service along with examples. thanks!
... View more
Labels:
- Labels:
-
Apache NiFi
08-10-2021
12:45 AM
@DennisJaheruddi , Thanks for your reply and will implement your suggestion. thanks! Deepak
... View more
08-06-2021
07:00 AM
Hi @MattWho , Thanks for your reply. However, when I put the expression mentioned in your reply under condition block. It throws error. Could you please provide the expression mentioned under " Conditions " . thanks!
... View more
08-06-2021
05:15 AM
I have to create a new csv file after removing first column from incoming CSV file and this has to be implemented using Python script. I am not much aware of python scripting and tried to write python code after following some sites. The python code is mentioned below: ***************************************************** from org.apache.commons.io import IOUtils from java.nio.charset import StandardCharsets from org.apache.nifi.processor.io import StreamCallback import csv # Define a subclass of StreamCallback for use in session.write() class PyStreamCallback(StreamCallback): def __init__(self): pass def process(self, inputStream, outputStream): cols_to_remove = [0] # Column indexes to be removed (starts at 0) cols_to_remove = sorted(cols_to_remove, reverse=True) # Reverse so we remove from the end first row_count = 0 # Current amount of rows processed newText ='' Text = IOUtils.toString(inputStream, StandardCharsets.UTF_8) reader = csv.reader(Text,delimiter=",") with open(filePath, "w", newline='') as result: writer = csv.writer(result) for row in reader: row_count += 1 print('\r{0}'.format(row_count), end='') # Print rows processed for col_index in cols_to_remove: del row[col_index] writer.writerow(row) outputStream.write(newText.encode('utf-8')) flowFile = session.get() if(flowFile != None): flowFile = session.write(flowFile, PyStreamCallback()) session.transfer(flowFile, REL_SUCCESS) ******************************************************** However, i am not getting the result as expected. Could someone look into the code and let me know what is to be modified.
... View more
- Tags:
- csv
- NiFi
- Python Script
Labels:
- Labels:
-
Apache NiFi
08-04-2021
03:27 AM
I have to implement one scenario using Nifi flow. 1. There is one attribute from upstream processor like KeyValue : KGPYT 2. I have to find whether KeyValue is unique in the system or not , by validation from Database. If it is not found in the database, the flowfile should be proceed to success and if the value is present in database, it should be proceed to failure. Please suggest me how to proceed in this case. thanks!
... View more
Labels:
- Labels:
-
Apache NiFi
08-03-2021
12:01 AM
I have to extract the first character from each string provided in the Flowfile attribute. Suppose I have one attribute as: KeyValue : Nifi Test Project Expected output : Key1: NTP Please let me know how to get this and which processor to be used. Thanks in advance.
... View more
Labels:
- Labels:
-
Apache NiFi
07-26-2021
08:42 AM
Is it possible to mask or greyed out the Token passed in Custom Property (Authentication )? I have one Token received from one API and have to pass it to another request. Issue: If I pass the token in custom property, it will be visible to all users who can access the flowfile. I need to mask these token as these value are displayed in Attribute and Content. Thanks for early response.
... View more
Labels:
- Labels:
-
Apache NiFi
07-23-2021
08:19 AM
Please help me out in this scenario: Token is returned from InvokeHttp processor. The value of Token is displayed in Attribute and Content. is there any mechanism by which token value can be masked, so that anonymous user can not see the value. Thanks in advance.
... View more
Labels:
- Labels:
-
Apache NiFi
07-23-2021
12:38 AM
1 Kudo
@DennisJaheruddi , Thanks for your reply. I a able to resolve this issue with your suggestion. Thanks!
... View more
07-21-2021
08:10 AM
I have to create one attribute with the following details: 1. There are two attributes are flowing from EvaluateJson Proecessor : Location1 = $.place1 and Location2 = $.place2 2. There is one string like folder1 is to be append in these attributes as mentioned below: Place : /folder1/Location1/Location2 I am trying with the below expression: path: ${path: append("folder1/"):append(${Location1}):append('/'):append(${Location2})} Please let me know where I am doing wrong. Early reply will be highly appreciated. thanks & regards
... View more
- Tags:
- NiFi
Labels:
- Labels:
-
Apache NiFi
07-14-2021
11:22 PM
@MattWho Thanks for your reply and let me know about the correct flow.
... View more
07-08-2021
06:00 AM
I need immediate help for the below use case: To perform POST activity with one of the system we have to follow the below steps: Step 1: Request a Token: To obtain a token by submitting an Authenticate request. The authentication request must be sent to http://today/authentication/v1/login using the GET method. The request header must contain an Authorization header in the following format: Authorization: Basic <EncodedCredentials> where <EncodedCredentials> is the Base 64 encoded string for the credentials in the following format: <username>:<password> The token expiry is stored in the Authenticate response header. Step2: To Call subsequent API request: With a request token in hand, you can now submit a request (example: Create Projects) to update data to System We must include your access token in the Authorization header of every request. The authorization header must look like this: Authorization: System <TokenValue> ...where <TokenValue> is the token obtained from the authentication call. My query is that How to pass both the details (Authorization Key which is output from one processor and BODY part which we get from GetFile processor) to a single InvokeHTTP processor. Looking for early Response. Thanks in advance.
... View more
- Tags:
- invokehttp
- NiFi
Labels:
- Labels:
-
Apache NiFi
07-06-2021
06:46 AM
Please help me out in this scenario: 1. I have to create a new project. The details are accessed using GetFileProcessor. 2. I have passed two input to Invokehttp Processor(one Authorization token using CustomField and other as data to be used for POST action). However, this process is not working as expected. Please find the attached screenshot for reference. Data To be used for POST: Early Response much appreciated! Thanks!
... View more
Labels:
- Labels:
-
Apache NiFi
06-22-2021
05:45 AM
@MattWho , When I applied the solution provided by you on the flowfile (formatted json ), it works as expected. However, when the same expression was applied to the flowfile in original form(one line json file), it was not working as expected. Could you please let me know this unexpected behavior.
... View more
06-16-2021
11:59 PM
@MattWho , Thanks for your response and it work as per my requirement. thanks!
... View more
06-09-2021
06:49 AM
@MattWho , Yes, your analysis is correct. So you are asking that this 1 FlowFile with both null and non-null "customfield_" fields is routed to the path A because at least one "customfield_" field as a non-null string? The content would remain unedited. ..Yes, the flowfile which will contain at least one non-null value should be moved to other processor without content modification. And you want other FlowFiles where the content contains nothing but all "customfield_" fields with null value routed to path B ? The content would remain unedited. --Yes, it is the same. Please suggest on this. Thanks!
... View more
06-08-2021
07:47 AM
@MattWho Please advise me on this issue. Issue: In the flow file which contain at least customfield_ with some value other than null should be routed to another processor and the flowfile which has all null value should be moved to other processor. thanks in advance!
... View more
06-06-2021
07:59 AM
I have dataflow files which has to be routed on the basis of certain criteria. It has multiple field like ("Customefied_23456: "Null") in the key: value pair. My query is how to filter out the flowfile which contain the some value for customfield ("customfield_33749": "this is required value",). i.e it does not contain null like ("Customefied_23456: "Null"). Please let me know how to proceed in this case. thanks in advance.
... View more
Labels:
- Labels:
-
Apache NiFi
05-31-2021
06:05 AM
Hi, I have many flow file which has multiple field like mentioned below customefields_12345 : null customefields_12346: { "welcome to this issue"} I have to route these flow files on the condition : if customfield is null --> navigate to other processor if customfield is notnull or having some value other than null should be navigate to other processor. Please let me know how to achieve this. early response will be appreciated. Note: customfield should be used rather than customfield_12345. thanks!
... View more
Labels:
- Labels:
-
Apache NiFi
05-21-2021
04:47 AM
Hi @MattWho , Thanks for reply. However, I am looking how to implement controller (OAuth2TokenProviderImpl) in nifi. Like how to use this controller with processer and let me know which processer will link with this controller. Thanks
... View more
05-20-2021
06:27 AM
Can somebody show me how to implement controller ( OAuth2TokenProviderImpl) in Nifi Flow or provide any example with template.
... View more
Labels:
- Labels:
-
Apache NiFi
04-15-2021
04:44 AM
I am looking how to implement the below scenario using ApacheNiFi: 1. To get Authentication token using InvokeHTTP processor 2. Save this token in some file as this token expired in 30 min(how to write logic for checking received token is not expired or not) 3. Use this token for subsequent RESTApi call. Thanks!
... View more
Labels:
- Labels:
-
Apache NiFi