1973
Posts
1225
Kudos Received
124
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
773 | 04-03-2024 06:39 AM | |
1424 | 01-12-2024 08:19 AM | |
771 | 12-07-2023 01:49 PM | |
1326 | 08-02-2023 07:30 AM | |
1920 | 03-29-2023 01:22 PM |
07-21-2021
01:59 PM
Livy and the sparkinteractive connector aren't stable at this point. it only works with Scala code and a jar. it's hacky. i recommend you call cloudera's CDE envirnment
... View more
06-16-2021
09:50 AM
How are you ingesting the rpm, you need to get it in a flowfile as binary and then send it as body
... View more
06-03-2021
07:11 AM
Regex remove those bad characters https://community.cloudera.com/t5/Support-Questions/nifi-regex-replace-special-characters/td-p/103404 https://community.cloudera.com/t5/Support-Questions/How-do-I-enter-an-unprintable-byte-into-a-nifi-property-that/td-p/203936 https://community.cloudera.com/t5/Support-Questions/Remove-from-a-flow-file-in-Nifi/td-p/109503 https://nifi.apache.org/docs/nifi-docs/html/expression-language-guide.html http://apache-nifi-users-list.2361937.n4.nabble.com/ReplaceText-and-special-characters-td480.html https://community.cloudera.com/t5/Support-Questions/ReplaceText-quot-processor-does-not-replace-special/td-p/171544 https://community.cloudera.com/t5/Support-Questions/remove-special-characters-from-xml-text-node-using-nifi/td-p/241008 https://community.cloudera.com/t5/Support-Questions/Regex-Special-Character-Escape/m-p/239556#M201365 Could also use UpdateRecord on Json with infer with replace or replaceregex https://nifi.apache.org/docs/nifi-docs/html/record-path-guide.html
... View more
06-01-2021
02:29 PM
1 Kudo
CountText will count lines (\r\n). QueryRecord will count # of records, even if it is two records on a line
... View more
06-01-2021
10:12 AM
1 Kudo
it's only for new saves. you probably need to export those with NiFi Cli and reimport after adding git and restart
... View more
06-01-2021
10:07 AM
1 Kudo
if it's csv, use QueryRecordProcessor with csv reader then just do SELECT COUNT(*) FROM FLOWFILE
... View more
06-01-2021
10:05 AM
This is azure error for storage https://social.msdn.microsoft.com/Forums/en-US/a9225a04-7a7c-46f6-ae7b-45168119c0a4/not-able-to-listen-on-azure-eventhostprocessor?forum=servbus
... View more
05-27-2021
07:55 AM
what version of NiFi are you using? There are some bugs with InvokeHttp in older versions. Can you access that url from that machine via curl? There may be a networking or firewall issue. https://www.datainmotion.dev/2021/01/flank-real-time-transit-information-for.html https://www.datainmotion.dev/2021/03/using-cloudera-flow-management-powered.html https://community.cloudera.com/t5/Community-Articles/Real-Time-Stock-Processing-With-Apache-NiFi-and-Apache-Kafka/ta-p/249221 https://community.cloudera.com/t5/Community-Articles/Smart-Stocks-with-FLaNK-NiFi-Kafka-Flink-SQL/ta-p/308223
... View more
05-24-2021
12:02 PM
wrap your SQL in a view / procedure / function or other Database native grouping of statements is smartest. With running multiple sql statements you may want to use Cloudera CDE, Cloudera Machine Learning jobs, YARN Spark Jobs or Airflow. https://www.datainmotion.dev/2019/10/migrating-apache-flume-flows-to-apache_15.html https://www.datainmotion.dev/2020/12/simple-change-data-capture-cdc-with-sql.html
... View more