Member since
09-27-2018
138
Posts
23
Kudos Received
10
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
9415 | 02-28-2021 10:23 PM | |
1888 | 02-08-2021 11:53 PM | |
31127 | 12-16-2020 11:31 PM | |
7417 | 12-14-2020 11:02 PM | |
4736 | 12-14-2020 12:18 AM |
06-04-2019
06:20 AM
Hi @Archon Gum thank you so much for your answer and your efforts! Refering to your suggestions: 1. I checked the information and it is correct. BUT when I test to acces the REST-API of registry in an InvokeHTTP-Processor I have to type https. So I changed this in "nipyapi.config.registry_config.host" and ended up with an certification failure. Here a part of it: AttributeError: 'module' object has no attribute 'X509_up_ref'
2019-06-04 05:40:24,709 WARNING Retrying (Retry(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError(SSLError("bad handshake: Error([('SSL routines', 'ssl3_get_server_certificate', 'certificate verify failed')],)",),)': /nifi-registry-api/buckets
2019-06-04 05:40:24,709 WARNING Retrying (Retry(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError(SSLError("bad handshake: Error([('SSL routines', 'ssl3_get_server_certificate', 'certificate verify failed')],)",),)': /nifi-registry-api/buckets
WARNING:urllib3.connectionpool:Retrying (Retry(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError(SSLError("bad handshake: Error([('SSL routines', 'ssl3_get_server_certificate', 'certificate verify failed')],)",),)': /nifi-registry-api/buckets
From cffi callback <function _verify_callback at 0x7f3a008085f0> So I have to speak with the admin. 2. Because I'm not the "master of the installation" I can't do this just like that. But I will bear this in mind. 3. I agree. If I get this work I will let you know. So long!
... View more
05-29-2019
11:02 AM
Hi @Archon Gum do you mind if I ask you one more time for your help? I compared the bucket.py in Python37 (local) and Python275 (DEV-System with Cluster) but there is no difference. Maybe you could give me a hint to solve this problem? Thanks!
... View more
05-23-2019
09:22 AM
Hi, I need some help with JOLT-syntax. JSON-Input {
"nummer": "1073",
"table": [
{
"datum": "20180529",
"zn": 1
},
{
"datum": "20180530",
"zn": 2
},
{
"datum": "20190522",
"zn": 3
}
]
} JOLT-Specification [{
"operation": "shift",
"spec": {
"nummer": "Nummer",
"table": {
"*": {
"zn": "Positionen.[].ZeileNr",
"datum": "Positionen.[].Datum"
}
}
}
}
] JSON-Output {
"Nummer": "1073",
"Positionen": [{
"ZeileNr": 1
}, {
"Datum": "20180529"
}, {
"ZeileNr": 2
}, {
"Datum": "20180530"
}, {
"ZeileNr": 3
}, {
"Datum": "20190522"
}]
} But the JSON-Output what I need is: {
"Nummer": "1073",
"Positionen": [{
"ZeileNr": 1,
"Datum": "20180529"
}, {
"ZeileNr": 2,
"Datum": "20180530"
}, {
"ZeileNr": 3,
"Datum": "20190522"
}]
} Please, how can I manage this, it is driving me crazy... Thanks for any help and information about this syntax!
... View more
Labels:
- Labels:
-
Apache NiFi
05-15-2019
06:08 AM
@Archon Gum Hi, I was told Python 2.7.5 is already available on my DEV. Installed nipyapi and changed CommandPath in ExecuteStreamCommand. On execution this error happens: Question: Is it absolutely necessary having Python3.x or can you see another cause for this exception? Thanks for your help and this solution!
... View more
05-14-2019
06:52 AM
@Archon Gum Hi, thanks for this awsome information! Something like this I was looking for but could not find... Did you develope this solution? Tested it on my local installation (1.9.1) and it worked perfect. Now I have to prepare my offical DEV-Sytem with python and test it there (Cluster with 1.9.2) with more extensive flows. I will let you know here whether the test was successfully. Bye!
... View more
02-11-2019
04:05 PM
Hi @Matt Burgess thanks for Your quick and detailed answer! 1-3: I see, the script was not just to illustrate the DMC - it is NECESSARY to work with it in NiFi. OK I will use it. 4: So I have to prepend some information at "Cache Entry Identifier" on PutDMC to identify the entries coming from different "tables". OK this will work. 5-6: This points I have to clarify with the "techies"...
... View more
02-11-2019
02:43 PM
@Matt Burgess May I ask You whether You have some answers for me (expecially concerning questions 1 and 2)? Thanks.
... View more
02-07-2019
03:09 PM
Hi, currently I'm dealing with the DistributedMapCache-thing... Found this article which gave me an idea of all this, great! https://community.hortonworks.com/articles/71837/working-with-a-nifi-distributedmapcache.html Now I try to involve DistributedMapCache (DMC) in my NiFi-Flow without executing the script.
Found old questions here but maybe in 1.7 or 1.8 there are new possibilities?
Referring to above article, how can I in NiFi... 1. remove a concrete key (like command "remove")? 2. receive a list of existing keys (like command "keys"), maybe inclusive there values? Further questions: 3. How can I clear all content of the DMC at once? Tested to disable the Controller Service for DMC-Server, but after enabeling data still existing. 4. In practice if one wants to use different tables in DMC would they all be in one DMC? Or would I configure DMC-Server and DMC-ClientService for each table? 5. At the moment I work at local installation. Is all this DMC-thing working without difficulty on a nifi-cluster (which will be coming soon I hope)? 6. Technical at the configuration of the DMC-ClientService the hostname and port of the DMC-Server has to be specified fix - which one to choose in a cluster? If someone has further information concerning this subject I would be glad to get them.
Thanks all!
... View more
Labels:
- Labels:
-
Apache NiFi
02-04-2019
09:56 AM
@David Miller Hi David, You are right with being carefull sending to many emails and that there will be situations where monitoring/errorhandling needs to be adjusted individual. But I want a standard process for the majority of always repeated occuring errors. You know, not reinventing the wheel every time again. And if one day my processes are designed further there won't be emails sent just logging everything and give the support some kind of graphical interface (dashboard) - that's the plan.
... View more
02-04-2019
09:44 AM
@Artjom Zab Hi Artjom, thanks for keeping this subject in mind and providing this link to me! I had a quick look at it and noticed that I will have to catch up with some points mentioned there (e.g. Record Reader/Writer). But I will try it.
... View more