Member since
03-03-2017
74
Posts
9
Kudos Received
2
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
2461 | 06-13-2018 12:02 PM | |
4374 | 11-28-2017 10:32 AM |
06-12-2018
11:27 AM
Hi When executing a select statement in executeSql processor on a posrgresql i get this error Unknown SQL type 1111 cannot be converted to Avro type The column causing this is a json type column, i have tried to google how to cast the json to a string put i doesn't seems to be so simple. It works fine when i does it without that column Does anybody know about a workaround on this.
... View more
Labels:
- Labels:
-
Apache NiFi
03-02-2018
01:51 PM
The NIFI log when i execute the curl string 018-03-02 14:49:51,442 INFO [NiFi Web Server-21012857] o.a.n.w.s.NiFiAuthenticationFilter Attempting request for (eyJhbGciOiJIUzI1NiJ9.eyJzdWIiOiJ3MjA5NjBAQ0NUQS5ESyIsImlzcyI6IktlcmJlcm9zU2VydmljZSIsImF1ZCI6IktlcmJlcm9zU2VydmljZSIsInByZWZlcnJlZF91c2VybmFtZSI6IncyMDk2MEBDQ1RBLkRLIiwia2lkIjoxNSwiZXhwIjoxNTIwMDQxMzczLCJpYXQiOjE1MTk5OTgxNzN9.OX5DsmHY4Y6mpxqEMGIvT4q_FbHJUDzLItMbjM4heBI) PUT https://sktudv01hdf01.ccta.dk:9091/nifi-api/flow/process-groups/a9d5c45f-015b-1000-0000-00006d9844d3 (source ip: 172.20.242.82)
2018-03-02 14:49:51,442 INFO [NiFi Web Server-21012857] o.a.n.w.s.NiFiAuthenticationFilter Authentication success for myuser
2018-03-02 14:49:51,447 INFO [NiFi Web Server-21004041] o.a.n.w.s.NiFiAuthenticationFilter Attempting request for (<myuser><CN=sktudv01hdf01.ccta.dk, OU=CCTA.DK>) PUT https://sktudv01hdf01.ccta.dk:9091/nifi-api/flow/process-groups/a9d5c45f-015b-1000-0000-00006d9844d3 (source ip: 172.20.242.82)
2018-03-02 14:49:51,447 INFO [NiFi Web Server-21004041] o.a.n.w.s.NiFiAuthenticationFilter Authentication success for myuser
2018-03-02 14:49:51,448 INFO [NiFi Web Server-21004041] o.a.n.w.a.c.AccessDeniedExceptionMapper myuser does not have permission to access the requested resource. Returning Forbidden response.
2018-03-02 14:49:51,452 INFO [NiFi Web Server-21012857] o.a.n.w.a.c.AccessDeniedExceptionMapper myuser does not have permission to access the requested resource. Returning Forbidden response.
2018-03-02 14:49:51,452 INFO [NiFi Web Server-21009169] o.a.n.w.s.NiFiAuthenticationFilter Attempting request for (<myuser><CN=sktudv01hdf01.ccta.dk, OU=CCTA.DK>) PUT https://sktudv01hdf01.ccta.dk:9091/nifi-api/flow/process-groups/a9d5c45f-015b-1000-0000-00006d9844d3 (source ip: 172.20.242.82)
2018-03-02 14:49:51,452 INFO [NiFi Web Server-21009169] o.a.n.w.s.NiFiAuthenticationFilter Authentication success for myuser
... View more
03-02-2018
01:18 PM
1 Kudo
It seems to work when i send the header "Authorization: Bearer $token" But then another problem appear I did following: 1. myuser@localhost ~]$ kinit
Password for myuser@CCTA.DK:
myuser@localhost ~]$ 2. myuser@localhost ~]$ klist
Ticket cache: FILE:/tmp/krb5cc_742017602
Default principal: myuser@CCTA.DK Valid starting Expires Service principal 03/02/2018 14:09:46 03/03/2018 00:09:46 krbtgt/CCTA.DK@CCTA.DK
renew until 03/09/2018 14:09:39
myuser@localhost ~]$ 3. myuser@localhost ~]$ token=`curl -k -X POST --negotiate -u : https://sktudv01hdf01.ccta.dk:9091/nifi-api/access/kerberos` % Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0
0 0 0 269 0 0 2112 0 --:--:-- --:--:-- --:--:-- 2112
myuser@localhost ~]$ 4. myuser@localhost ~]$ curl -k --header "Authorization: Bearer $token" -i -H 'Content-Type: application/json' -XPUT -d'{"id":"a9d5c45f-015b-1000-0000-00006d9844d3","state":"STOPPED"}' https://sktudv01hdf01.ccta.dk:9091/nifi-api/flow/process-groups/a9d5c45f-015b-1000-0000-00006d9844d3
HTTP/1.1 403 Forbidden
Date: Fri, 02 Mar 2018 13:10:50 GMT
Content-Type: text/plain
Transfer-Encoding: chunked
Server: Jetty(9.3.9.v20160517)
Unable to perform the desired action due to insufficient permissions. Contact the system administrator.myus
er@localhost ~]$ My user should have admin rights
... View more
03-02-2018
09:14 AM
Hi, I am trying to start and stop my processor-group with a curl commando Im on a hdf 2.1.1 using kerberos curl -k -i -H 'Content-Type: application/json' -XPUT -d '{"id":"cdb54c9a-0158-1000-5566-c45ca9692f85","state":"RUNNING"}' https://localhost:9091//nifi-api/flow/process-groups/a9d5c45f-015b-1000-0000-00006d9844d3 the response from NIFI is following HTTP/1.1 405 JSPs only permit GET POST or HEAD
Date: Fri, 02 Mar 2018 09:10:03 GMT
Content-Length: 0
Server: Jetty(9.3.9.v20160517) If i remove the -k param i got following response curl -i -H 'Content-Type: application/json' -XPUT -d '{"id":"cdb54c9a-0158-1000-5566-c45ca9692f85","state":"RUNNING"}' https://localhost:9091//nifi-api/flow/process-groups/a9d5c45f-015b-1000-0000-00006d9844d3
curl: (60) Peer's certificate issuer has been marked as not trusted by the user.
More details here: http://curl.haxx.se/docs/sslcerts.html
curl performs SSL certificate verification by default, using a "bundle"
of Certificate Authority (CA) public keys (CA certs). If the default
bundle file isn't adequate, you can specify an alternate file
using the --cacert option.
If this HTTPS server uses a certificate signed by a CA represented in
the bundle, the certificate verification probably failed due to a
problem with the certificate (it might be expired, or the name might
not match the domain name in the URL).
If you'd like to turn off curl's verification of the certificate, use
the -k (or --insecure) option. what can i do to obtain this from commandline
... View more
Labels:
- Labels:
-
Apache NiFi
02-12-2018
02:26 PM
2 Kudos
Hi, I need to get the processor-group name in my NIFI flow. I could hardcode it in updateAttribute, but would prefere to get it dynamilly Is that possible using expression langugage or executescript
... View more
Labels:
- Labels:
-
Apache NiFi
01-16-2018
03:41 PM
1 Kudo
Thank you this worked for me
... View more
01-16-2018
03:39 PM
Hi, I having a nifi job which using a getFile to read a hive script into a flowfile and execute it in PutHIVEQL processor I would like my flow to be triggered by something outside nifi My thought was to put a listFile before the getFile processor and activate the flow with i little script touching a file in then listFile folder that would also prevent it to run more than once at a time. But Getfile has no input, i really want to keep my hivescript in a file, is there someway to implement such a functionality Best regards Simon
... View more
Labels:
- Labels:
-
Apache NiFi
01-03-2018
02:15 PM
1 Kudo
Hi I have a listDataBaseTables which gives be 256 flowfiles. In my flow there is a lot of processing going on and i need to process one at the time. Is it possible to trigger a processor only to continue when the flowfile before reach a certain processor, otherwise is it possible to get a processor to continue each flowfile on a period of time so there is a timespand between each flowfile. I have tried with a process eait using routeOnAttribute but it don't work as i want it to do. Best regards Simon
... View more
Labels:
- Labels:
-
Apache NiFi
11-28-2017
10:32 AM
I found that the replacetext processor could do this for me with a very little effort. So i did not use executeScript for this.
... View more
11-22-2017
10:38 AM
Thanks it worked /Simon
... View more