About TimothySpann

TimothySpann · ‎10-22-2020

https://nifi.apache.org/docs/nifi-docs/html/nifi-in-depth.html Maybe shrink your provenance repo and send everything you need via: https://www.datainmotion.dev/2020/04/sql-reporting-task-for-cloudera-flow.html Or via Atlas

TimothySpann · ‎10-22-2020

provenance is for every step of every flowfile in every flow. I recommend rolling those logs

TimothySpann · ‎10-22-2020

you need to restart your servers after making the setting changes. do you have space?

TimothySpann · ‎10-09-2020

https://www.datainmotion.dev/2020/09/devops-working-with-parameter-contexts.html download the flow/backup up/store in git copy a flow to archive remove from production https://www.datainmotion.dev/2019/11/nifi-toolkit-cli-for-nifi-110.html

TimothySpann · ‎10-06-2020

https://docs.cloudera.com/runtime/7.2.1/integrating-hive-and-bi/topics/hive-kafka-integration.html

TimothySpann · ‎10-06-2020

I believe you need to be running HDP 3.1 or CDP for the Hive-Kafka integration since it's part of Hive 3.x and CDH has Hive 1 or 2.

TimothySpann · ‎09-29-2020

It looks like it does normal error checking https://github.com/apache/nifi/blob/c396927299586b896df4ebc745793b4c451f3898/nifi-nar-bundles/nifi-mongodb-bundle/nifi-mongodb-processors/src/main/java/org/apache/nifi/processors/mongodb/GetMongoRecord.java

TimothySpann · ‎09-28-2020

Fork the processor

TimothySpann · ‎09-28-2020

Maybe a bug or oversite. GetMongo is a community processor, post or update a JIRA https://issues.apache.org/jira/browse/NIFI-5916

TimothySpann · ‎09-15-2020

Upgrade to newer, make sure NiFi has 2GB+ of RAM. On my laptop NiFi 1.11.4 is pulling in 1,500 records a second. How large are those Kafka messages? What format? example? Don't use threads for that.

Online	Offline
Last Visited	‎05-20-2024 05:42 PM

Member Since	‎01-07-2019 11:58 AM
Last Visited	‎05-20-2024 05:42 PM
Posts	1,973
Kudos received	1122

Cloudera Community

Re: Has anyone tried NiFi consuming (JMSConsume) f...

Re: NiFi Crash after runing chain of lookups

Re: Recommend approach for listening to RSS Feed i...

Re: NiFi ListenFTP Processor Default Data Port

Re: Nifi: Kafka Producer with Avro format in both ...

Re: HDF 3.4.1 NIFI 1.9 - NIFI Provenance Repositor...

Re: HDF 3.4.1 NIFI 1.9 - NIFI Provenance Repositor...

Re: HDF 3.4.1 NIFI 1.9 - NIFI Provenance Repositor...

Re: Move Flows to another bucket in NiFi Registry

Re: Kafka Hive integration error related most poss...

Re: Kafka Hive integration error related most poss...

Re: How to verify required parameters is valid in ...

Re: How to verify required parameters is valid in ...

Re: How to verify required parameters is valid in ...

Re: ConsumeKafkaRecord_2_0 1.9.0.3.4.1.1-4 - slow...