Member since
02-01-2022
274
Posts
97
Kudos Received
60
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
438 | 05-15-2025 05:45 AM | |
3469 | 06-12-2024 06:43 AM | |
6087 | 04-12-2024 06:05 AM | |
4174 | 12-07-2023 04:50 AM | |
2237 | 12-05-2023 06:22 AM |
07-12-2023
08:44 AM
1 Kudo
@rupeshh , make a new post and describe your solution, then click Accept As Solution!! Then this post will be available in future for anyone experiencing similar. Great job getting it rectified!
... View more
07-10-2023
05:32 AM
@cotopaul This may be worthy of a JIRA and a fix. PutBigQueryBatch is going away, so if there is some function missing in PutBigQuery we need to get it in there. I just did some work on PutBigQuery, let me have a discussion with @davidh and I will get back to this asap. If you can, share an example flow.
... View more
06-30-2023
09:22 AM
2 Kudos
@TaxcalcRanjit I have a flow that demos how to take a CSV flowfile and format into html table. That flow is here: https://raw.githubusercontent.com/cldr-steven-matison/NiFi-Templates/main/CSV_to_Table_Demo.json In this example I am using GenerateFlowfile to send some CSV data to a ReplaceText to replace the , (commas) with html code for separating each column in the table (</td><td>), and end of line and new line with html to end each row and start another ( </tr><tr>). The end result is a full html table with the results of the csv as rows and columns. You need to do something similar here to solve your use case to build the html source for your table's data. I am not sure if your upstream flowfiles are all lines in one flowfile or one flowfile per result. Either way you have to manipulate those flowfiles into html for the table structure matching your data Once the flowfile is formatted correctly as html, then you can send to PutEmail.
... View more
06-30-2023
06:25 AM
@wallacei That is correct. NiFi is not part of CDP Base. You need a trial for CFM.
... View more
06-26-2023
09:18 AM
@Ghilani You should know these 3 articles intimately if you want to use Execute Script https://community.cloudera.com/t5/Community-Articles/ExecuteScript-Cookbook-part-1/ta-p/248922 https://community.cloudera.com/t5/Community-Articles/ExecuteScript-Cookbook-part-2/ta-p/249018 https://community.cloudera.com/t5/Community-Articles/ExecuteScript-Cookbook-part-3/ta-p/249148 That said, it's sometimes helpful for me to see a working example and modify from there. As such, here is a github with a sample flow definition file (01_Fraud_Detection_Demo_Params_ExecuteScript.json) and script file(Fraud Demo ExecuteScript.py) that should work out of the box: https://github.com/cldr-steven-matison/Fraud-Prevention-With-Cloudera-SSB/tree/main/Templates Pay attention to imports and, then line 160 is what you want to get the flowfile. My flow ignores the content, but you should be able to find references in the Part 1 cookbook for anything you want to do w/ flowfile content.
... View more
06-26-2023
09:04 AM
@madhs @joseomjr A great example of the configuration is above. Here is a full flow definition file/example showing how to get values from JSON and prepare ahead of an InvokeHTTP processor: Flow Def File: https://raw.githubusercontent.com/cldr-steven-matison/NiFi-Templates/main/InvokeHttp_Demo_2.json
... View more
06-23-2023
09:48 AM
@Wpq To enable nifi to use the mysql driver jar, you should copy that jar file into the nifi node file system. Additionally, the file will need to be owned by the same user running nifi. For example: usually the "nifi" user. If you have a multi node cluster, the file should exist in all nodes in the same location. Once you get into nifi UI. Configure a Database Connection Pool Controller Service referencing your driver. When the path and permissions are right, you will be able to enable that Controller Service. Once enabled you can use it with many processors such as ExecuteSQL.
... View more
06-23-2023
06:02 AM
@bhadraka Check out this flow definition example for how to prepare and test JSON ahead of an invokeHttp post. Flow Def File: https://raw.githubusercontent.com/cldr-steven-matison/NiFi-Templates/main/InvokeHttp_Demo_2.json As far as the post itself goes. I highly recommend that you test API calls with something like Postman so that you can clearly test what headers and such are required so that the API call works. Only then try to make it work with InvokeHttp duplicating all headers. Figuring out how to get the call to work and how to configure InvokeHTTP at same time is not fun. TIP: in Invoke HTTP click the + to add key value pairs corresponding to your headers or values you need to pass.
... View more
06-22-2023
02:32 PM
@Juanes I believe you just need to resolve the missing dependency. Check out this solution: > pip3 install python-setuptools
> yum install impala-shell https://community.cloudera.com/t5/Support-Questions/How-to-install-impala-shell-on-RHEL-8-3-to-communicate-with/m-p/313665
... View more
06-22-2023
02:25 PM
@Manimaran Wait/Notify should be able to do what you are describing in the deeper dialouge. Based on your current flow complexity, I would recommend that you build a new sample to learn how wait/notify behavior works in nifi. This is very difficult setup, so having a learning flow w/o context of the existing functionality is highly optimal. Then you can refactor your sql flow accordingly, without having to figure out how to get wait/notify working during that refactor.
... View more