- Subscribe to RSS Feed
- Mark Question as New
- Mark Question as Read
- Float this Question for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page
Unable to connect ConsumeKafka to ReplaceText
- Labels:
-
Apache Kafka
-
Apache NiFi
Created ‎11-09-2016 07:43 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
I am trying to create a flow to take the entire content of my kafka message and insert in one column in Cassandra. I have configured ConsumeKafka so that I get one message per FlowFile. I am trying to connect the Processors as shown below:
ConsumeKafka -> ReplaceText -> PutCassandraQL
I am unable to connect ConsumeKafka to ReplaceText. Why is that?
Created ‎11-09-2016 02:22 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
There is nothing that would prevent that connection from being allowed. Try dragging the connection again. If it still does not highlight green try the following:
Try making a copy of your replaceTEXT processor and see if you can connect to the copy. Right click on replace TEXT and select "copy" then right click on empty graph space and click "paste".
Matt
Created ‎11-09-2016 01:01 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Could you elaborate on what you mean by "I am unable to connect ConsumeKafka to ReplaceText." Are you seeing an error when trying to do so?
Created ‎11-09-2016 02:22 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
There is nothing that would prevent that connection from being allowed. Try dragging the connection again. If it still does not highlight green try the following:
Try making a copy of your replaceTEXT processor and see if you can connect to the copy. Right click on replace TEXT and select "copy" then right click on empty graph space and click "paste".
Matt
Created ‎11-09-2016 02:22 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
No. When I try to connect the relationship from ConsumeKafka to ReplaceText, it does not highlight it for me to be able to connect. But If I try to connect from ConsumeKafka to PutCassandraQL it highlights and lets me establish relationship. Is there something that prevents from the output of ConsumeKafka to go to ReplaceText. I thought ReplaceText could take any FlowFile with content and that is what ConsumeKafka produces.
Created ‎11-09-2016 02:23 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Is this a standalone NiFi install or a NifI cluster?
Created ‎11-09-2016 02:48 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Tried it. No luck.I even tried with creating a GenerateFlowFile processor and connect to ReplaceText. That also does not work. Is there some processor that needs to be used in conjunction with ReplaceText like ExtractText or something?
Created on ‎11-09-2016 02:56 PM - edited ‎08-18-2019 03:44 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
What you are trying to do definitely works. What version of NiFi/HDF are you using? Is this a standalone NiFi or a cluster?
When you drag the connection from ConsumeKafka to ReplaceText are you seeing any component get highlighted green including the ConsumeKafka processor itself?
If so, without letting go of the mouse button drag you cursor back over the ConsumeKafka and then back to the ReplaceText. Did the highlighting of the ConsumeKafka go away? Did ReplaceText now highlight?
Thanks,
Matt
Created ‎11-09-2016 03:11 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Processor have not notion of what processors come before or after them in a dataflow. A processor simply has an establish set of rules governing its configuration.
For example: Required properties XYZ must be set, all downstream relationships must be defined, and/or at least one upstream connection must be connected.
So in the case of the ReplaceText processor it does not know who the source of the upstream connection is. It simply cares that one exists from which to pull FlowFiles from its queue.
Created ‎11-09-2016 03:37 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
I do not believe this. I did two things. Deleted all ReplaceText processors. Created a new one. Then I just came out of the process group and went back in and now it connected. I did not even have to try what you suggested. I have seen this happen while connecting other processors also. The drag feature is very unstable.
Created ‎11-09-2016 03:38 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Thanks a lot for helping me resolve this and especially for the quick replies.