Member since
01-27-2023
229
Posts
73
Kudos Received
45
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
675 | 02-23-2024 01:14 AM | |
862 | 01-26-2024 01:31 AM | |
590 | 11-22-2023 12:28 AM | |
1344 | 11-22-2023 12:10 AM | |
1556 | 11-06-2023 12:44 AM |
10-03-2023
09:34 PM
Yes correct, and thank you worked.
... View more
10-03-2023
11:00 AM
Thanks a lot for your response.
... View more
09-25-2023
11:17 PM
@LKBand if you try the below select, what error do you encounter? Unfortunately I have no MS SQL database with which I could test so I can only somehow help you debug your situation, one step at a time. select
"06 QQQ" as 66_QQQ,
"11 JJJ" as 11_JJJ,
"12 KKK" as 12_KKK,
"13 JJJ" as 13_JJJ
from DB_TEST.dbo.FGRID
-- or with ` instead of "
-- or QQQ_66, sending the number at the back of the column, instead of the front. I assume that you have your Record Writer configured as Inherit Record Schema.
... View more
09-25-2023
04:27 PM
@need_help Has the reply helped resolve your issue? If so, please mark the appropriate reply as the solution, as it will make it easier for others to find the answer in the future. Thanks.
... View more
09-25-2023
10:33 AM
2 Kudos
@charliekat, this discussion is far from easy and most likely it will be a quite general one, with no specific answer to your question 🙂 There are plenty of things you could monitor and automate, starting from the CPU Usage, RAM Usage, CPU and RAM Temperature, I/O on your SSD, network packages and so on. Directly from NiFi you won't be able to perform many tasks, as it was not created for such things. However, if you are good enough with PowerShell (Gamer=Windows in 95% cases) you can create some scripts and execute them directly in NiFi. Now, depending on your script Output, you will call other scripts which will perform the desire action: like killing long running processes, or processes which are consuming to much CPU while you are gaming and so on. These actions only represent around 5-10% of what you can do. The other 90-95% are actually related to your hardware: GPU, OS, SSD, Mouse(DPI), Screen(resolution+frame rate), Keyboard, Ethernet Connection, CPU and the overall Cooling System, Windows Updates , Game settings, GPU Updates and so on .... and unfortunately, for these actions, NiFi won't be much of a friend 😞 Nevertheless, don't take my answer as a discouragement, but take it as an action to prove me wrong and go play with NiFi and make something amazing 🙂
... View more
09-25-2023
10:11 AM
1 Kudo
I managed to solve my issue using UpdateRecord with Literal Value replacement strategy. I have defined the following EL: ${field.value:toDate('dd-MMM-yy'):format('yyyy-MM-dd')} On the other hand, the avro schema remained the same, "type": "int" and "logicalType": "date". As for replacing the month letters, I have hard coded a very ugly IF-ELSE statement: ${field.value:contains('IAN'):ifElse(${field.value:replace('IAN','JAN')},${field.value:contains('IUN'):ifElse(${field.value:replace('IUN','JUN')},${field.value:contains('IUL'):ifElse(${field.value:replace('IUL','JUL')},${field.value})})}):toDate('dd-MMM-yy'):format('yyyy-MM-dd')} PS: this link helped me a lot: https://docs.oracle.com/javase/8/docs/api/java/text/SimpleDateFormat.html
... View more
09-25-2023
04:56 AM
1 Kudo
@BerniHacker, I did not even take into consideration the state 🙂 I figured you were trying to execute it for the first time and I assumed from the start that you had nothing saved in your state. Congrats on solving your issue.
... View more
09-14-2023
11:10 AM
1 Kudo
@LKB You would get better traction/feedback if you start your own community question. Your query is not very related to issue in this post. As far as the one question related to this post about encrypted manager password, @mks27 simply masked it by using "***" in his post. NiFi does not replace actual password with * when encrypting sensitive passwords. The NiFi Encrypt-Config Toolkit can be used to encrypt passwords used in various NiFi configuration files: https://nifi.apache.org/docs/nifi-docs/html/toolkit-guide.html#encrypt_config_tool Thank you, Matt
... View more
09-13-2023
09:07 AM
I'm glad to announce that finally i have solved my issue. Thanks again for the community support received. I would like to explain the workaround applied hoping to be useful for other guys affected by same issue. The issue was related to a missing authentication by ranger. I don't understand why the solution "Policy ranger in Kudu" described here https://docs.cloudera.com/cdp-private-cloud-base/7.1.8/kudu-security/topics/kudu-ranger-policies.html doesn't work. Anyway ..... So i decided to follow this guide "Specifying trusted users" ( https://docs.cloudera.com/cdp-private-cloud-base/7.1.8/kudu-security/topics/kudu-security-trusted-users.html ) By cloudera manager (kudu service) i set following properties "Master Advanced Configuration Snippet (Safetz Valve) for gflagfile" to this value: --trusted_user_acl=impala,hive,kudu,rangeradmin,nifi then i restarted kudu. After this settings, command work fine sudo -u nifi kudu table describe nautilus-bigdata-h02 default.gianni TABLE default.gianni ( id INT64 NOT NULL, name STRING NULLABLE, PRIMARY KEY (id) ) OWNER hueadmin REPLICAS 1 COMMENT even NIfi PutKudu processor work fine and i can write my row on the table. Thanks to all !!
... View more
09-11-2023
07:30 AM
1 Kudo
@BillyG, set the property "Use Avro Logical Types" to true if you would like to use anything else besides STRINGS :).
... View more