Member since
07-10-2023
25
Posts
1
Kudos Received
0
Solutions
10-17-2023
06:36 AM
@cotopaul are you sure this property should look like this : because it didn't work, UUID_1 now look like this : "UUID_1" : ":toString(/UUID_1,\"UTF-8\")"
... View more
10-17-2023
05:15 AM
@cotopaul I used Intellij and have something like that: { "type" : "record", "name" : "USERDATA", "namespace" : "any.data", "fields" : [ { "name" : "Name", "type" : [ "null", "string" ] }, { "name" : "Surname", "type" : [ "null", "string" ] }, { "name" : "Mail", "type" : [ "null", "string" ] }, { "name" : "UUID_1", "type" : [ "null", "bytes" ] }, { "name" : "City", "type" : [ "null", "string" ] } ] } but the column in the data is apparently of type Stryng - it is not my database, I only have access to the views and download them
... View more
10-17-2023
04:45 AM
@cotopaul thank you for your answer, can you tell how can i open this file in AvroReader-should I do it in Nifi?Sorry for my question but I am totally new in NIFI...
... View more
10-17-2023
02:57 AM
Hi @cotopaul Basically, my flow looks like this: first I use QueryDataTable to download the view from the database, then I have the ConvertAvroToJson processor but I don't have anything filled in the AvroSchema field because everything except the UUID field is converted, in the database the UUID appears as a String
... View more
10-15-2023
11:47 PM
Hi, I have the following problem - I download data from the database using QueryDatabaseTable, I receive the data in the avro-binary format, so then I use ConvertAvroToJson - everything converts nicely except the UUID field, I am left with the following json: { "Name":"Mary", "Surname":"Smith", "Mail":"m.smith@google.com", "UUID":{ "bytes":"_쪨Ը¬I³Sñ])º\u000E•" }, "City":"New York" } I tried to extract this UUID as an attribute and replace it with the :toString() method but it doesn't work, does anyone have an idea how to convert it to a string?
... View more
Labels:
- Labels:
-
Apache NiFi
08-03-2023
06:56 AM
hi, i have the following problem - i am creating myself quite a few json files via AttributeToJSON processor. Here, as destination, I have set flow-file content. Now I would like to combine them into one csv file. I used MergeContent in my flow first to combine them into one json and then ConvertRecord to turn it into csv. However, it does not create one file for me, but many, I do not know if the problem lies in the MergeContent processor or ConvertRecord. Or should I approach it differently? There are my settings in MergeContent
... View more
Labels:
- Labels:
-
Apache NiFi
08-01-2023
03:56 AM
hi i have such a problem, i have a flow that downloads a csv file with data and there are columns like:,system name, surname, phone, mail, card name, proffesion. The file looks like this only data is more of course system name surname phone mail proffesion department ABA John Wane 77777777 j.wane@gmail.com accountant accountancy BCA Lilly Black 89898989 l.black@gmail.com recruiter hr I am reading this file record by record and for each record I need to query another system via REST using first name, last name, profession and department, the query looks something like this:
https://system address/data/?name=${name}&surname=${surname}&proffesion=${proffesion}&department=${department} I use Invoke HTTP for this
and now this system should return me json with data:
{
"date": [
{
"name": "John",
"surname": "Wane",
"profession": "ACC",
"department":"ACC01"
}
} As you can see in the answer I get a different profession and department. How can I now create a json for each record that will contain data from the csv file, i.e. system, name, surname, phone mail, but proffesion and department will take the response from the second system that came with jason? So that I have the following result: { "system": "ABA",(data from csv) "phone": 7777777,(data from csv) "mail": "j.wane@gmail.com" (data from csv) "name": "John", (data from csv) "surname": "Wane", (data from csv) "profession": "ACC", (data from json response from other system) "department":"ACC01" (data from json from other system) } In a word, how can I combine the data from the input csv file with the data coming from the response from another system?
... View more
Labels:
- Labels:
-
Apache NiFi
07-12-2023
04:34 AM
hello, I have the following problem - I have a flow and I have a name attribute in it, I need to change it to uppercase. I used UpdateAtribute processor for this, as property I have name and as vaule I have:${name:toUpper()} unfortunately it doesn't work and now instead of having name in capital letters I have Empty string set, anyone know why this is happening?
... View more
Labels:
- Labels:
-
Apache NiFi
07-10-2023
11:02 PM
Hi @MattWho My nifi.properties file looks fine I think: # security properties #
nifi.sensitive.props.key=nN9mVm0kCmsmO1CwC+ODWFNr9kFjHyZX
nifi.sensitive.props.key.protected=
nifi.sensitive.props.algorithm=NIFI_PBKDF2_AES_GCM_256
nifi.sensitive.props.additional.keys=
nifi.security.autoreload.enabled=false
nifi.security.autoreload.interval=10 secs
nifi.security.keystore=./conf/keystore.p12
nifi.security.keystoreType=PKCS12
nifi.security.keystorePasswd=
nifi.security.keyPasswd=
nifi.security.truststore=./conf/truststore.p12
nifi.security.truststoreType=PKCS12
nifi.security.truststorePasswd=
nifi.security.user.authorizer=single-user-authorizer
nifi.security.allow.anonymous.authentication=false
nifi.security.user.login.identity.provider=single-user-provider
nifi.security.user.jws.key.rotation.period=PT1H
nifi.security.ocsp.responder.url=
nifi.security.ocsp.responder.certificate= So I don't know where is problem unfortunately...
... View more
- « Previous
-
- 1
- 2
- Next »