About Faerballert

Faerballert · ‎05-04-2020

Looks like there is on a table 2 or more PRIMERY_KEY columns. You can check it with: SHOW CREATE TABLE MYSQL_TABLE_NAME The Problem occurs if the same value is entered for several primary key columns. So you have to remove some of them

Faerballert · ‎05-04-2020

Hi, i think your data-format .xlsx is Content of your Flowfile and you don´t have to convert it firtstly? So you can easy add a UpdateAttribute Processor and add the Dynamic-Property "filename" With this Property you overwrite the actually set Filename (you can see there is already an Attribute called "filename" from beginning). As Value you can set the name via Attribute and add the format there e. g. ${filename:append('.xlsx')} or just hard coded like file123.xlsx And after that you add a PutFile or FTP or whatever Processor and send it to the Path you set there.

Faerballert · ‎04-30-2020

You can clone the processor bundle you need from https://github.com/apache/nifi/tree/master/nifi-nar-bundles and clone it to the filearchive. That would be solve your problem, because after every update you have the processors you need and if they came back to default, the new code will be merged in your repo. Greets

Faerballert · ‎04-23-2020

maybe you should set for all or just for t1/t2.. fields an Alias like t1.CODE_CLOCK_ID as CODE_CLOCK_ID_s26, t1.COMPANY_CD as COMPANY_CD_s26, t1.GROUP_SEGMENT_L1 as GROUP_SEGMENT_L1_s26, t1.GROUP_SEGMENT_CD as GROUP_SEGMENT_CD_s26, t2.CODE_CLOCK_ID asCODE_CLOCK_ID_s27, t2.COMPANY_CD as COMPANY_CD_s27, t2.GROUP_SEGMENT_L1 as GROUP_SEGMENT_L1_s27, t2.GROUP_SEGMENT_CD as GROUP_SEGMENT_CD_s27 Greets

Faerballert · ‎04-20-2020

Is it possible that you can send clean code without confusing codelines and lost brackets?

Faerballert · ‎03-25-2020

thanks @MattWho for your answer. The goal for me is to create an output with the merged attributes so that I can notify myself what elements have been edited. My thought was to mail me something like this: Postion 1,2,3,5,8,13 has been changed *1,2,3,5,8,13 are the attribute values of each flowfile Dont know how i can solve this otherwise in one Flow/Notification

Faerballert · ‎03-18-2020

Hello together, I splitted a flow file for each x value. With value x I fetch value y and set it to the Attribute. Is it possible if I merge the FlowFiles together, that the Attribute values can be merged comma-seperated too?

Faerballert · ‎03-10-2020

Hello, I use the QueryDatabaseTable Processor for fetching the Delta of a MSSQL-DB. My input is a SQL-Query which is based on a SQL-VIEW. At the Property " Maximum-value Columns" I set a date value. My Problem is that the initial Fetch is working and at "View state" the date is set. But if I change some dates to a actually one it doesnt fetch the dataset.. Is the Problem because it is based on a View? Because locally it works.. The mistery is that if I delete the "View State" and run the Processor again it gets all data and the new date I set is now at the "view state" set. Thanks for help

Faerballert · ‎02-18-2020

Maybe your version with template have (lower) version than 1.9.0 and other one is higher? There some bundles removed from the default. You can find it here: https://github.com/apache/nifi/tree/master/nifi-nar-bundles/nifi-kite-bundle

Faerballert · ‎02-17-2020

Go to the Processor and select "Scheduling". As Scheduling strategy you can use "Cron driven" and at the run schedule there you can set, when the Processor should be check for a Delta. Examples: Every 2 hours 0 0 0/2 1/1 * ? * Daily at 1 a.m. 0 0 1 1/1 * ? * Weekly at 3 p.m. on every monday 0 0 15 ? * MON *

Faerballert · ‎01-27-2020

Currently it works with two decoupled Flows. But you seen the problem of the scheduling, because if NiFi is going down for maintance and is started again the manual scheduling is cancelled and the two Flows starts at the same time. It´s seems like it is not possible to work with Apache Oozie for this reason. I need a solution to handle it in one Flow but thanks!

Faerballert · ‎01-22-2020

Hello everybody, I´m starting my Flow with the Processor " QueryDatabaseTable" and set the Property "Maximum-value Columns" to fetch the Delta of new Rows after a first initial import. Now I need to get the Delta of updated Rows too in the same Flow, but I can´t use the Processor "QueryDatabaseTable" again because there can´t be get a input Relationship. Is there any solution to get 2 Delta checks in one single Flow?

Faerballert · ‎01-16-2020

You can use " ConvertAvroToJSON" and then the "EvaluateJsonPath" Processor and add there the Property like "workingHours" and as Value you set your JsonKey like $.hours With this you add it to the attribute of your FlowFile.

Faerballert · ‎01-16-2020

You can use " QueryDatabaseTable" as input processor, but you can´t use it twice in one flow (Im searching for a solution that I can get a delta in one flow for 2 Fields btw. :D). You have to set the Property "Maximum-value Columns". It can be a date, id or something else to have the maximum of a value. At "view state" you can see the value of "Maximum-value Columns" field you set. To set up the runtime you can go to "Schedule" at the processor and change the "Run Schedule" If you need more input, please let me know

Faerballert · ‎01-15-2020

Hello, I use the QueryDatabaseTable as starting processor to fetch for new rows.The main problem for me is now, that I can´t use the same process for another field in one single flow to get another fetch for changed rows. Is there any solution how I can solve it? Thanks for your help. If you need more Information, please tell me

Faerballert · ‎08-27-2019

You don´t need a particular exception. In catch block of onTrigger method you add like session.transfer(flowFile , REL_ FAILURE ) ;

Faerballert · ‎08-20-2019

Another instance is running and blocking in background. Check running processes and kill them ps -ef | grep nifi after that, restart.

Faerballert · ‎08-19-2019

You specify the string "JSON_PATH" as the path, which cannot be resolved and thus leads to a nullpointer. Should be like: String jsonPath = context.getProperty(JSON_PATH).getValue(); Object obj = new JSONParser().parse(new FileReader(jsonPath));

Faerballert · ‎08-19-2019

If you run NiFi in an Docker Container you can link the path in docker-compose file. Otherwise you can try to share your folder to network, then it should be like smb://machine-name/nifi_output

Online	Offline
Last Visited	‎06-09-2020 02:27 AM

Date Registered	‎08-18-2019 11:53 PM
Last Visited	‎06-09-2020 02:27 AM
Total Messages Posted	19
Total Kudos Received	3

Re: Select query on ExecuteSQL processor throws ou...

Re: NIFI custom processor error - can not upload t...

Re: CFM- Nifi service is not starting due to "ERRO...

Re: Delete data issue with PutdatabaseRecord

Re: How to save flowfile as filename.xlsx in Nifi?

Re: Processors not available in the latest Nifi Ve...

Re: Select query on ExecuteSQL processor throws ou...

Re: Nifi Custom processor showing error “ the loca...

Re: Merge Attribute values from FlowFiles

Merge Attribute values from FlowFiles

Don´t incremental fetch with MSSQL View

Re: NIFI custom processor error - can not upload t...

Re: How to display the delta changes for a db usin...

Re: Fetch delta of two different columns in one F...

Fetch delta of two different columns in one Flow

Re: How to use a calculated value with QueryRecord...

Re: How to display the delta changes for a db usin...

Two seperated "Maximum-value Columns" processor st...

Re: How make Custom Processor follow failure relat...

Re: CFM- Nifi service is not starting due to "ERRO...

Re: Nifi Custom processor

Re: NiFi Putfile 1.9.2 not saving to local desktop