Member since
01-07-2019
220
Posts
23
Kudos Received
30
Solutions
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 12003 | 08-19-2021 05:45 AM | |
| 3155 | 08-04-2021 05:59 AM | |
| 1543 | 07-22-2021 08:09 AM | |
| 6040 | 07-22-2021 08:01 AM | |
| 5496 | 07-22-2021 07:32 AM |
12-25-2019
08:45 AM
1 Kudo
Just a heads up: Splitting the file into individual records may provide additional flexibility, but if the case is straightforward enough, I do think it is recommended to use processors (like route text) that avoid creating a flow file for each line.
... View more
12-24-2019
04:00 AM
Not sure if this helps, but it looks like you are hitting a general connectivity error. Possibly not even related to MySQL. Are you able to do anything via nifi on that remote node?
... View more
12-24-2019
03:39 AM
1 Kudo
Extract text is for getting some text from the content and putting it in an attribute. This does not sound like what you want. Also it will match the regex to the whole flowfile so again probably not what you want. If you only want to keep certain lines from a flowfile, the processor to use seems to be RouteText. Here is an example of this: https://community.cloudera.com/t5/Support-Questions/Filtering-records-from-a-file-using-NiFi/td-p/184346
... View more
12-24-2019
03:31 AM
This is quite a broad question and hard to troubleshoot all at once. A general approach: 1. Analyze your custom code and identify all bits of complexity/all dependencies 2. Run the standard example 3. Introduce in a very minimal fashion one complexity/dependency from your custom code into the standard 4. If it works, repeat step 3 This should allow you to narrow down exactly what is causing the problem (and hopefully guide the resolution).
... View more
12-24-2019
03:27 AM
1 Kudo
First of all, you are getting an error inside the python file. So we can eliminate several causes (e.g. not being able to access the file, or not being able to find the file). Secondly, I believe you are able to run the file from the command line, that would eliminate a problem in the file itself, or with the general logic and setup. This leaves two likely suspects: 1. You are running from a different place (for instance a different node) 2. You are running with different rights (for instance a different user) or less authentication (for instance no kerberos ticket) Step 1 can be tested easily by manually going to all Nifi nodes and running the command from the command line. Step 2 might be tested by running something like !whoami in python from the command line, and from nifi and inspecting the results. If this does not help, try to get some more info out of python on what goes wrong.
... View more
12-24-2019
03:22 AM
1 Kudo
Judging by the name of all processors, this is the only one that is really built specifically towards Excel.
... View more
12-24-2019
03:20 AM
This is more a Python question than a Nifi one, perhaps this will help: import pyminizip
pyminizip.compress("myfile.txt", "myzippedfile.zip", "mypassword", compression_level) I would recommend you to first see if you can get the python part working, and then worry about how to call it from Nifi.
... View more
12-24-2019
03:15 AM
Please check carefully the documentation you are following. I don't think you are expected to change the deployment configuration, perhaps you need to add something on your local machine. (e.g. in /etc/hosts)
... View more
12-24-2019
03:12 AM
1 Kudo
Based on your input and other cases I found I logged this jira: https://issues.apache.org/jira/browse/NIFI-6969# In short: It appears to be a problem, but not in the execution of the query but in the evaluation of it for lineage purposes. If you have any additional information, consider adding it to the jira.
... View more
12-24-2019
02:52 AM
Please reach out to your local Cloudera contact person. If you don't have one, this is a good starting point. To avoid confusion: The platform is definitely open source, but for the recent (and future) downloads and security patches an agreement with your company is needed to gain access.
... View more