CountText will count lines (\r\n).   QueryRecord will count # of records, even if it is two records on a line ... View more

what version of NiFi are you using?   There are some bugs with InvokeHttp in older versions.   Can you access that url from that machine via curl?  There may be a networking or firewall issue.   https://www.datainmotion.dev/2021/01/flank-real-time-transit-information-for.html https://www.datainmotion.dev/2021/03/using-cloudera-flow-management-powered.html https://community.cloudera.com/t5/Community-Articles/Real-Time-Stock-Processing-With-Apache-NiFi-and-Apache-Kafka/ta-p/249221 https://community.cloudera.com/t5/Community-Articles/Smart-Stocks-with-FLaNK-NiFi-Kafka-Flink-SQL/ta-p/308223 ... View more

wrap your SQL in a view / procedure / function or other Database native grouping of statements is smartest.   With running multiple sql statements you may want to use Cloudera CDE, Cloudera Machine Learning jobs, YARN Spark Jobs or Airflow.   https://www.datainmotion.dev/2019/10/migrating-apache-flume-flows-to-apache_15.html   https://www.datainmotion.dev/2020/12/simple-change-data-capture-cdc-with-sql.html     ... View more

Some examples https://community.cloudera.com/t5/Support-Questions/How-Extract-text-from-a-multiline-flow-and-create-only-one/td-p/104706   https://nathanlabadie.com/recombining-multiline-logs-with/   https://github.com/tspannhw/EverythingApacheNiFi/blob/main/README.md ... View more

good suggestion ! This apps really helpful in tracking and storing location of own ... Also reference are very helpful to me.   http://owntracks.org/booklet/ http://owntracks.org/booklet/tech/json/ http://osmand.net/build_it post office near me tracking N.Miller ... View more

Use UpdateRecord (csv reader, json writer) to change date PutDatabaseRecord to save to oracle   https://www.datainmotion.dev/2020/12/simple-change-data-capture-cdc-with-sql.html https://www.datainmotion.dev/2019/10/migrating-apache-flume-flows-to-apache_15.html https://www.datainmotion.dev/2021/01/flank-real-time-transit-information-for.html https://www.datainmotion.dev/2020/12/smart-stocks-with-flank-nifi-kafka.html https://github.com/tspannhw/EverythingApacheNiFi https://www.datainmotion.dev/2021/03/processing-fixed-width-and-complex-files.html https://www.datainmotion.dev/2020/06/no-more-spaghetti-flows.html   ... View more

Thanks @MattWho    Sure, I will consider your suggestion to not running multiple nifi on the same machine.   I tried the variable registry approach as well but the problem is the same with that as well that we can not use the EL parameter. ... View more

VMs are not optimal.   Run microservices in Kafka Connect, NiFi Stateless, Flink, Spark or Python in CML, Jupyter Notebooks. SQL Stream builder.   all good options ... View more

I am using NiFi 1.11.4  Currently log of "Input port" is available in the log file but the count of the flow file is not present. Do you think log level will help there?  ... View more