Member since
06-26-2015
515
Posts
140
Kudos Received
114
Solutions
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 2581 | 09-20-2022 03:33 PM | |
| 6974 | 09-19-2022 04:47 PM | |
| 3680 | 09-11-2022 05:01 PM | |
| 4291 | 09-06-2022 02:23 PM | |
| 6801 | 09-06-2022 04:30 AM |
03-02-2022
04:52 PM
@spserd , Are the NiFi 1.11 and 1.15 clusters different clusters or the same cluster that you upgraded? Is the application using the same keystore to connect to both clusters? Would you be able to share the part of your application code where you construct your NiFiSource? Cheers, André
... View more
03-02-2022
04:36 PM
@Sachin Here's another attempt at this (hopefully the last one 🙂 😞 I created the attached example that gets a flowfile and aattribute INDEX as you described above. It then uses an UpdateAttribute to convert the INDEX attribute into a FILTER that we can use in the QueryRecord processor. The QueryRecord process uses a fixed schema that has 100 columns. It's ok if your CSV has less columns. If the CSV can have more than 100 columns you need to update the schema to the maximum of columns you expect to receive in any CSV. The output is a flowfile with the exact columns that were specified in the INDEX attribute. Hope this helps. Cheers, Andre
... View more
03-02-2022
04:57 AM
1 Kudo
@Asim- , Try this one out: [
{
"operation": "shift",
"spec": {
"patientorderitems": {
"*": {
"patientorderlogs": {
"*": {
"@(4,_id)": "[&3]._id",
"@(2,poi_id)": "[&3].poi_id",
"pol_id": "[&3].pol_id",
"useruid": "[&3].useruid",
"modifiedat": "[&3].modifiedat"
}
}
}
}
}
}
] Cheers, André
... View more
03-02-2022
04:43 AM
Hi @Juanes , Here are a couple of examples: To delete a role: curl \
-u admin:admin \
-X DELETE \
"http://cm-host:7180/api/v45/clusters/cluster1/services/impala1/roles/impala-CATALOGSERVER-3b111e1a47149ce566f7225d1120cf85" To create a role for a service in a particular host: ❯ cat role.json
{
"items": [
{
"name" : "impala-CATALOGSERVER-myrole",
"type" : "CATALOGSERVER",
"serviceRef" : {
"clusterName" : "cluster1",
"serviceName" : "impala1",
"serviceDisplayName" : "Impala",
"serviceType" : "IMPALA"
},
"hostRef" : {
"hostId" : "21fd5c51-0fd2-4eb6-97d2-0e498639eb07",
"hostname" : "host-2"
}
}
]
}
❯ curl \
-u admin:admin \
-X POST \
"http://cm-host:7180/api/v45/clusters/cluster1/services/impala1/roles" \
-H 'Content-Type: application/json' \
-d @role.json Cheers, André
... View more
03-02-2022
04:12 AM
@sachin_32 Please check my reply here: https://community.cloudera.com/t5/Support-Questions/Pick-Column-Based-on-Index-Number/m-p/337379/highlight/true#M232559 Cheers, André
... View more
03-02-2022
03:25 AM
@CookieCream , Try these steps below after you delete your current nifi directory: wget "https://downloads.apache.org/nifi/1.15.3/nifi-1.15.3-bin.tar.gz" -P .
tar -zxvf ./nifi-1.15.3-bin.tar.gz
cd nifi-1.15.3
./bin/nifi.sh set-single-user-credentials admin supersecret1
./bin/nifi.sh start I just tested this on my laptop and it works without problems. Cheers, André
... View more
03-02-2022
03:21 AM
@sachin_32 , Here one different attempt. You can send your CSV flowfile to a ReplaceText processor with the following configuration: The Search Value is the following regular expression: (?s)^([^,\n]*),([^,\n]*),([^,\n]*),([^,\n]*),([^,\n]*)(.*$) And the Replacement Value is: $1,$2,$3,$4,col_a$6 Each capture group ([^,\n]*) will match the name of one column. If you want to keep the name of that column you just replace it with $x, where x is the position of the column. If you want to replace the column with another name, e.g. col_a, you just type the name of the new column name in the replacement instead. The last capture group (.*), will match the remaining of the first line. This way you don't need to match every single column, only the ones up to the position you want to replace. As an example, for this input: A,B,C,D,A
1,2,3,4,5
2,3,4,5,6 The above replacement will generate this output: A,B,C,D,col_a
1,2,3,4,5
2,3,4,5,6 HTH, André
... View more
03-01-2022
09:19 PM
@Dilan86 , You can try enabling Kerberos debug log and waiting for it to happen again: -Dsun.security.krb5.debug=true What kind of applications is this? Is it a long running application? Have you noticed any patterns like "the application fails after running for x hours/days"? André
... View more
03-01-2022
08:49 PM
@Dilan86 , If the application is not being affected and you only see this a few times a month, I wouldn't worry about it. It might be due to some intermittent issue, like network connectivity glitches, for example. Unless it's hurting I would just ignore it. André
... View more
03-01-2022
07:09 PM
@Dilan86 Are you specifying a jaas.conf file for your application, through the java.security.auth.login.config property? If so, could you please provide the configuration in it? If not, create a file with your authentication details (principal and keytab) like the example below, save in a location that the application has access to and pass that property to the application using -Djava.security.auth.login.config=/path/to/jaas.conf Client {
com.sun.security.auth.module.Krb5LoginModule required
useKeyTab=true
keyTab="/path/to/appuser.keytab"
storeKey=true
useTicketCache=false
principal="appuser@YOUR-REALM";
}; Cheers, André
... View more