Member since
02-01-2022
268
Posts
95
Kudos Received
59
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
1633 | 06-12-2024 06:43 AM | |
2169 | 04-12-2024 06:05 AM | |
1707 | 12-07-2023 04:50 AM | |
1030 | 12-05-2023 06:22 AM | |
1739 | 11-28-2023 10:54 AM |
05-16-2023
08:57 AM
@Bhavesh_Solanki Please reference the NiFI Rest API Doc here: https://nifi.apache.org/docs/nifi-docs/rest-api/index.html You will find document blocks for Parameter Contexts & Parameter Providers with the capabilities and requirements for Parameter based API Calls. Outside of the required calls to manage parameters, you may need to complete Access steps if you are accessing the rest api from outside of nifi canvas. If you are using the API within NiFI itself, this step is not necessary.
... View more
05-15-2023
05:07 AM
@RizkyMei @deepaknay Do you all have tickets w/ support on these install issues? Are you working with your Account Team regularly? Please DM me if you are not in touch with your account team on these matters and I will see what I can do to help out.
... View more
05-15-2023
05:04 AM
1 Kudo
@quangbilly79 NO, you should not be adding gateway to every node. This gateway should only be installed on the edge/utility nodes, where you give access to external systems and users. These gateway nodes then are able to reach rest of the service(s) nodes.
... View more
05-12-2023
09:33 AM
@rafy I got the same issues when I tried to create a flow using RPATH. However, here is a solution i found to dial into the data array and match on the room = A: SELECT * FROM FLOWFILE WHERE room = 'A' I used QueryRecord With JSONTreeReader (see below) and JSONRecordSetWriter (default). NiFI Flow Definition here: @gitHub Screenshots:
... View more
05-12-2023
08:40 AM
Can you please show the source json in a : code box Also, try a manual test, without attribute, such as: SELECT *
FROM FLOWFILE
WHERE RPATH(data, '/room') = 'A' This will ensure the query is correct to the json payload. Once that works, start testing adding the attribute.
... View more
05-12-2023
06:59 AM
@rafy I would try this: SELECT * FROM FLOWFILE WHERE RPATH_STRING(data, '/room')='${ip}' Assuming ip is an attribute (${ip}) ofcourse.
... View more
05-11-2023
05:42 AM
1 Kudo
@ushasri I believe the solution here is to use the Record based processors with a specified schema. This allows you to provide the correct schema to the Reader and the Writer regardless of the field names in original excel data source.
... View more
05-10-2023
05:56 AM
@zzeng Great article. Reach out to me on internal channels. I would love to show you my oracle to kudu demo, using kafka and schema registry.
... View more
05-10-2023
05:42 AM
1 Kudo
@SandyClouds ^^ that is how you do it. One important thing to mention. That processor is not meant to be deployed in a set it up and forget it situation. CDC against another database requires a lot more technical attention to how the data is changing over time AFTER you grab data for first time. In my opinion, this processor is meant to be a conversation starter, or a way to take a 1 time shot of data source, where you may be watching it run, but not expecting it to run indefinitely and keep 2 systems synced.
... View more
05-10-2023
05:36 AM
@ryu Excellent questions here. I will address each below: So when I am asked like in an interview or something, they ask what CDH version do you use, and when i say CDH 7.2.16, the people interviewing me asks "are you sure?" Yes, you are sure. Even new versions of CDP, have CDH in the artifact filenames: 7.1.4-1.cdh7.1.4.p37.14288300 So is there a CDP version of CDH vs maybe on prem version of CDH Current versions of our platform are CDP 7.x. Previous versions are CDH 6.x and older. There is On Prem CDP called CDP Private Cloud Base. There is Public Cloud CDP called CDP Public Cloud in Aws, Azure, and GCP. Is there some difference in versioning between on prem or CDP etc? This is my favorite question. The differences between CDP on Prem and CDP in the cloud are going away quickly. It is part of our modern data architecture for workload movement from on prem to the cloud to have the least amount of differences as possible. As such, these 2 different form factors of CDP are getting closer and closer to parity.
... View more