Member since
02-01-2022
223
Posts
71
Kudos Received
48
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
141 | 08-17-2023 06:07 AM | |
177 | 08-14-2023 05:54 AM | |
236 | 08-07-2023 06:51 AM | |
194 | 07-17-2023 08:43 AM | |
311 | 07-17-2023 08:38 AM |
10-25-2022
01:28 PM
You will need to complete the session.commit() call with right details to fit your scenario.
... View more
10-25-2022
12:53 PM
@ryu CDP Public Cloud Azure or CDP Private Cloud on Azure VMs? To link a NiFi outside of the cluster, you will need to provide that nifi with the files from the CDP Cluster. For example core-site.xml, hdfs-site.xml. Outside of that configuration, you will need to do some networking to allow access between systems, and then last but not least deal with access/auth and kerberos. If you are already working on some of these areas, be sure to include screen shots of processors, controller services, configs, etc.
... View more
10-25-2022
09:30 AM
@D5ha I have had a recent similar need and I learned that you use session.commit() after a session.transfer to send a flowfile in an inner loop. In a custom script, without the commit specifically, nifi will assume and do the commit sending all the data in a single end execution flowfile. session.transfer(flowFile, REL_SUCCESS) session.commit()
... View more
10-24-2022
08:50 AM
@MaarufB Using nifi-cli outside of curl on a nifi node is definitely a challenge. There are a lot of things you need to check. Most of them are addressed in a similar post here: https://community.cloudera.com/t5/Support-Questions/Calling-nifi-Api-using-Postman/td-p/343993 Hopefully you can find the solution within that post.
... View more
10-24-2022
06:27 AM
@yoiun Going to go out on a ledge here: It seems like the the sqoop command and hue/sqoop command are executed on different hosts. Does the new host have permissions to mysql? This error here: Access denied for user 'demo'@'152.30.119.754' leads me to believe it does not.
... View more
10-24-2022
06:18 AM
@i_am_dba This is a very difficult one to explain. I think the issue is the string schema, or removing the avro schema you mentioned. My first suggestion would be to try to specific the schema which should help getting the data into the right formats. An alternate solution is to try and do that manually by replacetext/regex,etc but that is not the ideal solution. That said, another higher level suggesting is to update the upstream datasource to permanently solve the instability from '' (blank string), 'null' (string), or actual NULL (not a blank, '', or string at all).
... View more
10-24-2022
06:09 AM
@MaarufB Please make a new post with as much detail as you can around your question and use case. This is an old topic and will not get a good response in the comments. Feel free to @ tag me in the new post.
... View more
10-13-2022
08:05 AM
@sathish3389 Its not entirely clear what you are asking here but I will give it a go. ListenHttp is used to listen to an http port with POST limited capabilities. If you are looking post data to nifi as more of REST API, you may want to check out HandleHttpRequest and HandleHttpResponse, as they have a bit more capability, and some ssl client authentication requirements. They also allow you to program authentication logic before returning the response. T o do that. you would build your data flow (after HandleHttpRequest) to look for an authentication (user,password,key,etc) header, validate that and then if valid, continue to HandleHttpResponse with 200 (success). An invalidate authentication header would then go to HandleHttpResponse with 500 (error). An invalid request (wrong path, missing info, etc) could be routed to HandleHttpReponse with 404 (invalid).
... View more
10-11-2022
03:47 AM
@samrathal Check the docs here: https://nifi.apache.org/docs/nifi-docs/rest-api/index.html Accordingly, make a get request to get the controller service, then using the payload, modify with updates and make the put request to update your controller service.
... View more
10-10-2022
11:51 AM
@raniaa Ambari is no longer part of the Cloudera ecosystem of tools/products. I would recommend you look for community support for ambari on stackoverflow or the ASF Slack.
... View more