Member since
09-24-2017
28
Posts
0
Kudos Received
0
Solutions
08-17-2023
11:17 PM
I was able to resolve this error, by making the below configuration to ExecuteStreamCommand: Command Path: <complete path of python.exe> Command Arguments: <complete path of your script>;<other arg>;<other arg>
... View more
09-28-2020
03:54 PM
@vikrant_kumar24 Based on what you describe you are either exceeding the capabilities of the outbound network connection from nifi, or the receiving end API. I suspect the latter but its hard to tell without seeing the number of nodes and processor scheduling settings. You can try to slow down the execution of invokeHttp to confirm. If it is set to 0 sec it can create a lot of connections to the endpoint. Try 5,10,15 seconds and re-evaluate. Also If you have more than 1 one nifi node, it can create a great deal of concurrent connections. If this answer resolves your issue or allows you to move forward, please choose to ACCEPT this solution and close this topic. If you have further dialogue on this topic please comment here or feel free to private message me. If you have new questions related to your Use Case please create separate topic and feel free to tag me in your post. Thanks, Steven
... View more
08-17-2020
04:34 AM
@vikrant_kumar24 I believe the solution you are looking for is to use ExtractText to check for string matching the country you want in the first row. This uses regex to match the entire file which you only need 1 match to know what country it is. Using ExtractText to get an attribute called "country" you would when use RouteOnAttribute to create different country routes. For example: usa => ${country.equals("usa"). Once your routes are defined you can pull them off RouteOnAttribute and send them down separate flows you create for each country. You also should know that you can achieve the same logic of checking/defining/routing country by using QueryRecord. Either method is suitable, but the latter method is more standard in the newest versions of nifi. If this answer resolves your issue or allows you to move forward, please choose to ACCEPT this solution and close this topic. If you have further dialogue on this topic please comment here or feel free to private message me. If you have new questions related to your Use Case please create separate topic and feel free to tag me in your post. Thanks, Steven @ DFHZ
... View more
08-13-2020
04:44 AM
This message is labeled NiFi, so I assume you have NiFi available? In that case, look at finding the right processor for the job, something like ExecuteSQL may be a good starting point. ---- If your question is purely about how to make python and mariaDB interact, this may not be the best place to ask it.
... View more
06-15-2020
10:48 PM
@JeanGuzman , As this is an older article, you would have a better chance of receiving a resolution by starting a new thread. This will also provide the opportunity to provide details specific to your environment that could aid others in providing a more accurate answer to your question.
... View more
06-05-2020
08:23 AM
@vikrant_kumar24 - Have you found a better way to solve this ? If so would be curious to hear that!
... View more
05-20-2020
11:40 AM
1 Kudo
@vikrant_kumar24 1. Yes, sorry for some reason they didnt get saved in that version of the template. I will update. You should see or set it like this: 2. Yes, you will need to enter the Remote Url, and maybe more properties. You also need to confirm that the json content in flow file is correct. Mine is just an example. I do not know what service you are connect too. That service may require username, passwords, tokens, headers, etc. The configuration for InvokeHttp will depend on these. If you prefer to share more details about the service you are connecting in PM we can discuss in private. Once you have the response from InvokeHttp, if the response is json, you will again do EvaluateJson, grab the values you want for the new Long/Lat, and replace or overwrite the existing attributes and continue downstream with your flow. 3. Converting CSV to JSON is pretty typical. The CSV->JSON Method you are a working on is just fine. You should be able to link the flowfile from that, to EvaluateJson in the flow. My example is just a demo to show you the concepts of EvaluateJson, UpdateAttribute, and AttributesToJson.
... View more
02-13-2020
04:19 PM
Hi @vikrant_kumar24,
Looking over your most recent post it appears that @stevenmatison solved your issue. Once you've had a chance to try out the files he's provided, can you confirm by using the Accept as Solution button which can be found at the bottom of his reply so it can be of assistance to others?
... View more