Member since
01-07-2019
220
Posts
23
Kudos Received
30
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
4980 | 08-19-2021 05:45 AM | |
1798 | 08-04-2021 05:59 AM | |
872 | 07-22-2021 08:09 AM | |
3659 | 07-22-2021 08:01 AM | |
3362 | 07-22-2021 07:32 AM |
12-24-2019
03:27 AM
1 Kudo
First of all, you are getting an error inside the python file. So we can eliminate several causes (e.g. not being able to access the file, or not being able to find the file). Secondly, I believe you are able to run the file from the command line, that would eliminate a problem in the file itself, or with the general logic and setup. This leaves two likely suspects: 1. You are running from a different place (for instance a different node) 2. You are running with different rights (for instance a different user) or less authentication (for instance no kerberos ticket) Step 1 can be tested easily by manually going to all Nifi nodes and running the command from the command line. Step 2 might be tested by running something like !whoami in python from the command line, and from nifi and inspecting the results. If this does not help, try to get some more info out of python on what goes wrong.
... View more
12-24-2019
03:22 AM
1 Kudo
Judging by the name of all processors, this is the only one that is really built specifically towards Excel.
... View more
12-24-2019
03:20 AM
This is more a Python question than a Nifi one, perhaps this will help: import pyminizip
pyminizip.compress("myfile.txt", "myzippedfile.zip", "mypassword", compression_level) I would recommend you to first see if you can get the python part working, and then worry about how to call it from Nifi.
... View more
12-24-2019
03:15 AM
Please check carefully the documentation you are following. I don't think you are expected to change the deployment configuration, perhaps you need to add something on your local machine. (e.g. in /etc/hosts)
... View more
12-24-2019
03:12 AM
1 Kudo
Based on your input and other cases I found I logged this jira: https://issues.apache.org/jira/browse/NIFI-6969# In short: It appears to be a problem, but not in the execution of the query but in the evaluation of it for lineage purposes. If you have any additional information, consider adding it to the jira.
... View more
12-24-2019
02:52 AM
Please reach out to your local Cloudera contact person. If you don't have one, this is a good starting point. To avoid confusion: The platform is definitely open source, but for the recent (and future) downloads and security patches an agreement with your company is needed to gain access.
... View more
12-24-2019
02:44 AM
There are several aspects to this question: 1. Number of nodes: As seen in the documentation, production deployments should have at least three nodes (also zookeeper would need 3 nodes, if you start with really low volumes you could consider co-locating). 2. IP addresses: Typically all Nifi nodes need a public IP address (otherwise you can usually not open the firewall from your data sources, but perhaps there are more reasons as well) 3. Data: As long as the disk is not lost, you can attach it to a different Nifi node if one breaks down 4. Deployment: The recommended deployment is via Ambari or Cloudera Manager. If you already have one of these in the cloud you can simply add Nifi as a service. If not it may be good to reach out to your local Cloudera contact person.
... View more
12-04-2019
06:08 AM
I understand this was hard to find. One point that is not relevant now, but may help with the general understanding: If you make a typo in the field names, avro will just ignore the actions of the right field and instead process the new field, which will be empty. This is technically quite a different problem than when you actually make a typo in the Type, as those are possible to check against the list of possible types. So detection of typos in field names is hard, and despite what the name suggests it seems LogicalType is actually a field name from Nifi perspective.
... View more
11-15-2019
05:00 AM
I see, as there are several steps here it is a bit hard to pinpoint the problem. Please check what the timestamp looks like just before you write it to the database. If it still looks like a string, presumably something went wrong with the reading.
... View more
11-14-2019
09:12 AM
The main point that is always communicated is that running our version in a Data Flow platform, brings you direct integration with other components. Both functional and nonfunctional (e.g. with Ranger and Atlas). That being said, as you can see there are also improvements to the product itself, but I am not aware of a clear public list with this, because it fluctuates a lot over time (First we discover points, and then we commit many of these back to the apache project eventually). Of course having the latest Apache Nifi can have some benefits, but overall I recommend using the latest Cloudera version of Nifi as that one has seen more testing and is less likely to see surprises.
... View more