About simon_jespersen

simon_jespersen · ‎06-12-2018

Hi When executing a select statement in executeSql processor on a posrgresql i get this error Unknown SQL type 1111 cannot be converted to Avro type The column causing this is a json type column, i have tried to google how to cast the json to a string put i doesn't seems to be so simple. It works fine when i does it without that column Does anybody know about a workaround on this.

simon_jespersen · ‎03-02-2018

The NIFI log when i execute the curl string 018-03-02 14:49:51,442 INFO [NiFi Web Server-21012857] o.a.n.w.s.NiFiAuthenticationFilter Attempting request for (eyJhbGciOiJIUzI1NiJ9.eyJzdWIiOiJ3MjA5NjBAQ0NUQS5ESyIsImlzcyI6IktlcmJlcm9zU2VydmljZSIsImF1ZCI6IktlcmJlcm9zU2VydmljZSIsInByZWZlcnJlZF91c2VybmFtZSI6IncyMDk2MEBDQ1RBLkRLIiwia2lkIjoxNSwiZXhwIjoxNTIwMDQxMzczLCJpYXQiOjE1MTk5OTgxNzN9.OX5DsmHY4Y6mpxqEMGIvT4q_FbHJUDzLItMbjM4heBI) PUT https://sktudv01hdf01.ccta.dk:9091/nifi-api/flow/process-groups/a9d5c45f-015b-1000-0000-00006d9844d3 (source ip: 172.20.242.82) 2018-03-02 14:49:51,442 INFO [NiFi Web Server-21012857] o.a.n.w.s.NiFiAuthenticationFilter Authentication success for myuser 2018-03-02 14:49:51,447 INFO [NiFi Web Server-21004041] o.a.n.w.s.NiFiAuthenticationFilter Attempting request for (<myuser><CN=sktudv01hdf01.ccta.dk, OU=CCTA.DK>) PUT https://sktudv01hdf01.ccta.dk:9091/nifi-api/flow/process-groups/a9d5c45f-015b-1000-0000-00006d9844d3 (source ip: 172.20.242.82) 2018-03-02 14:49:51,447 INFO [NiFi Web Server-21004041] o.a.n.w.s.NiFiAuthenticationFilter Authentication success for myuser 2018-03-02 14:49:51,448 INFO [NiFi Web Server-21004041] o.a.n.w.a.c.AccessDeniedExceptionMapper myuser does not have permission to access the requested resource. Returning Forbidden response. 2018-03-02 14:49:51,452 INFO [NiFi Web Server-21012857] o.a.n.w.a.c.AccessDeniedExceptionMapper myuser does not have permission to access the requested resource. Returning Forbidden response. 2018-03-02 14:49:51,452 INFO [NiFi Web Server-21009169] o.a.n.w.s.NiFiAuthenticationFilter Attempting request for (<myuser><CN=sktudv01hdf01.ccta.dk, OU=CCTA.DK>) PUT https://sktudv01hdf01.ccta.dk:9091/nifi-api/flow/process-groups/a9d5c45f-015b-1000-0000-00006d9844d3 (source ip: 172.20.242.82) 2018-03-02 14:49:51,452 INFO [NiFi Web Server-21009169] o.a.n.w.s.NiFiAuthenticationFilter Authentication success for myuser

simon_jespersen · ‎03-02-2018

It seems to work when i send the header "Authorization: Bearer $token" But then another problem appear I did following: 1. myuser@localhost ~]$ kinit Password for myuser@CCTA.DK: myuser@localhost ~]$ 2. myuser@localhost ~]$ klist Ticket cache: FILE:/tmp/krb5cc_742017602 Default principal: myuser@CCTA.DK Valid starting Expires Service principal 03/02/2018 14:09:46 03/03/2018 00:09:46 krbtgt/CCTA.DK@CCTA.DK renew until 03/09/2018 14:09:39 myuser@localhost ~]$ 3. myuser@localhost ~]$ token=`curl -k -X POST --negotiate -u : https://sktudv01hdf01.ccta.dk:9091/nifi-api/access/kerberos` % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 269 0 0 2112 0 --:--:-- --:--:-- --:--:-- 2112 myuser@localhost ~]$ 4. myuser@localhost ~]$ curl -k --header "Authorization: Bearer $token" -i -H 'Content-Type: application/json' -XPUT -d'{"id":"a9d5c45f-015b-1000-0000-00006d9844d3","state":"STOPPED"}' https://sktudv01hdf01.ccta.dk:9091/nifi-api/flow/process-groups/a9d5c45f-015b-1000-0000-00006d9844d3 HTTP/1.1 403 Forbidden Date: Fri, 02 Mar 2018 13:10:50 GMT Content-Type: text/plain Transfer-Encoding: chunked Server: Jetty(9.3.9.v20160517) Unable to perform the desired action due to insufficient permissions. Contact the system administrator.myus er@localhost ~]$ My user should have admin rights

simon_jespersen · ‎03-02-2018

Hi, I am trying to start and stop my processor-group with a curl commando Im on a hdf 2.1.1 using kerberos curl -k -i -H 'Content-Type: application/json' -XPUT -d '{"id":"cdb54c9a-0158-1000-5566-c45ca9692f85","state":"RUNNING"}' https://localhost:9091//nifi-api/flow/process-groups/a9d5c45f-015b-1000-0000-00006d9844d3 the response from NIFI is following HTTP/1.1 405 JSPs only permit GET POST or HEAD Date: Fri, 02 Mar 2018 09:10:03 GMT Content-Length: 0 Server: Jetty(9.3.9.v20160517) If i remove the -k param i got following response curl -i -H 'Content-Type: application/json' -XPUT -d '{"id":"cdb54c9a-0158-1000-5566-c45ca9692f85","state":"RUNNING"}' https://localhost:9091//nifi-api/flow/process-groups/a9d5c45f-015b-1000-0000-00006d9844d3 curl: (60) Peer's certificate issuer has been marked as not trusted by the user. More details here: http://curl.haxx.se/docs/sslcerts.html curl performs SSL certificate verification by default, using a "bundle" of Certificate Authority (CA) public keys (CA certs). If the default bundle file isn't adequate, you can specify an alternate file using the --cacert option. If this HTTPS server uses a certificate signed by a CA represented in the bundle, the certificate verification probably failed due to a problem with the certificate (it might be expired, or the name might not match the domain name in the URL). If you'd like to turn off curl's verification of the certificate, use the -k (or --insecure) option. what can i do to obtain this from commandline

simon_jespersen · ‎02-12-2018

Hi, I need to get the processor-group name in my NIFI flow. I could hardcode it in updateAttribute, but would prefere to get it dynamilly Is that possible using expression langugage or executescript

simon_jespersen · ‎01-16-2018

Thank you this worked for me

simon_jespersen · ‎01-16-2018

Hi, I having a nifi job which using a getFile to read a hive script into a flowfile and execute it in PutHIVEQL processor I would like my flow to be triggered by something outside nifi My thought was to put a listFile before the getFile processor and activate the flow with i little script touching a file in then listFile folder that would also prevent it to run more than once at a time. But Getfile has no input, i really want to keep my hivescript in a file, is there someway to implement such a functionality Best regards Simon

simon_jespersen · ‎01-03-2018

Hi I have a listDataBaseTables which gives be 256 flowfiles. In my flow there is a lot of processing going on and i need to process one at the time. Is it possible to trigger a processor only to continue when the flowfile before reach a certain processor, otherwise is it possible to get a processor to continue each flowfile on a period of time so there is a timespand between each flowfile. I have tried with a process eait using routeOnAttribute but it don't work as i want it to do. Best regards Simon

simon_jespersen · ‎11-28-2017

I found that the replacetext processor could do this for me with a very little effort. So i did not use executeScript for this.

simon_jespersen · ‎11-22-2017

Thanks it worked /Simon

Online	Offline
Last Visited	‎01-08-2019 02:20 PM

Member Since	‎03-03-2017 08:44 AM
Last Visited	‎01-08-2019 02:20 PM
Posts	74
Kudos received	9

Cloudera Community

Re: Nifi executeSql on postgresql produce error ca...

Re: manipulate flowfile with executescript process...

Nifi executeSql on postgresql produce error cannot...

Re: how to stop and start processor-group in NIFI ...

Re: how to stop and start processor-group in NIFI ...

how to stop and start processor-group in NIFI usin...

Get the processor-group name in NIFI flow

Re: nifi process one flow file at the time

trigger GetFile in nifi

nifi process one flow file at the time

Re: manipulate flowfile with executescript process...

Re: spcify location in create-hcatalog-table doing...