Member since
08-04-2018
51
Posts
4
Kudos Received
0
Solutions
08-10-2019
10:43 PM
How Apache Nifi delete record from BigQuery? Can we use ExceuteScript processor? if yes, how to import library? any sample script?
... View more
Labels:
08-09-2019
01:49 PM
How Apche Nifi Insert/Update/delete data from BigQuery
... View more
Labels:
07-25-2019
12:56 PM
Sorry, but It dose not work in my side. I guess that you didnot test it $.[2].length() In EvaluateJsonPath is always unmatched
... View more
07-23-2019
08:20 PM
Apache nifi version 1.9.2 issue with PutBigQueryBatch
... View more
Labels:
07-23-2019
07:19 PM
Apache Nifi (version 1.9.2) error when update data in a table (SQL server, MySQL, Postgresql) (it is running well with insert and update operations) With Delete the do correct with Update: They automatic change Primarykey from product_key to PRODUCTKEY (I tested with PutSQL and Putdatabaserecord it have the same issue) Any helps?
... View more
Labels:
07-23-2019
05:14 PM
In this case, you are changing variable manually, my expectation is changing it through any processors (as UpdateAttribute, ExcecuteScript, ... )
... View more
07-22-2019
07:54 PM
thanks @Shu, It doesnot work with when empty json and also nested json
... View more
07-22-2019
12:25 PM
yes, I created variable after now I want to update it with new value, how I can do it?,
... View more
07-21-2019
04:57 PM
Hi all, I am using Apache NIFI, how I can change/modify/replace value of global/environment variables?
... View more
Labels:
07-21-2019
02:50 PM
Apache nifi - Split json error when an array has only one record or empty,
... View more
07-21-2019
02:50 PM
Apache nifi - Split json error when an array has only one record or empty,
... View more
07-21-2019
02:45 PM
Apache nifi - Split json error when an array has only one record or empty, Do you have any suggestions to fix it, many thanks
... View more
Labels:
07-17-2019
03:56 PM
Hi all, I am trying to deploy Apache nifi in GKE, However I meet this issue chmod: changing permissions of '/opt/nifi/nifi-current/conf': Operation not permitted chmod: changing permissions of '/opt/nifi/nifi-current/conf/lost+found': Operation not permitted my yalm file is --- apiVersion: v1 kind: PersistentVolumeClaim metadata: name: nificlaimapachenifi spec: accessModes: - ReadWriteOnce resources: requests: storage: 30Gi --- apiVersion: "apps/v1" kind: "Deployment" metadata: name: "apachenifi" namespace: "default" labels: app: "apachenifi" spec: replicas: 1 selector: matchLabels: app: "apachenifi" template: metadata: labels: app: "apachenifi" spec: securityContext: runAsUser: 1000 runAsGroup: 3000 fsGroup: 2000 containers: - name: "apachenifi" image: "apache/nifi:latest" command: ["/bin/sh","-c"] args: ["chmod -R 0755 /opt/nifi/nifi-current/conf"] imagePullPolicy: Always securityContext: privileged: true ports: - containerPort: 8080 volumeMounts: - mountPath: "/opt/nifi/nifi-current/conf" name: mypdapachenifi volumes: - name: mypdapachenifi persistentVolumeClaim: claimName: nificlaimapachenifi --- apiVersion: "autoscaling/v2beta1" kind: "HorizontalPodAutoscaler" metadata: name: "apachenifi-hpa" namespace: "default" labels: app: "apachenifi" spec: scaleTargetRef: kind: "Deployment" name: "apachenifi" apiVersion: "apps/v1" minReplicas: 1 maxReplicas: 1 metrics: - type: "Resource" resource: name: "cpu" targetAverageUtilization: 80 Please give me a suggestions, many thanks
... View more
Labels:
06-25-2019
08:14 PM
Can we do similar with postgres CDC, MS SQL SERVER CDC using CaptureChangeMySQL processor ?
... View more
05-28-2019
05:55 PM
Hi all, Do you have any suggestions for my case "How Apache Nifi connect to MongoDB changeStream " ? Many thanks
... View more
Labels:
05-28-2019
05:53 PM
Hi all, Do you have any suggestions for my case "How Apache Nifi connect to Cassandra CDC" ? Many thanks
... View more
Labels:
05-04-2019
01:59 AM
I am using docker image on https://github.com/wurstmeister/kafka-docker however, after clone and run docker container exits immediately Any suggestions to solved this situation? Many thanks
... View more
Labels:
03-15-2019
04:01 PM
Hi All, I am using ExecuteSQL to connect with Presto. However, my Presto does not have user and ExecuteSQL need Database user. So, Is there any other way to connect to Presto from Nifi (1.9.0 )? (if no, how to create user from Presto? or how to get/ configure X-Presto-User from presto on docker for example https://hub.docker.com/r/starburstdata/presto/) Many thanks
... View more
- Tags:
- nifi-processor
- presto
Labels:
10-20-2018
04:39 PM
Hi Matt, thanks for your answers, do you think Mongo is native in Groovy or JavaScript? Thanks
... View more
10-09-2018
07:41 AM
Hi all, I am using Python ExecuteScript in Apache NiFi to list all Databases name in Mongo then load all tables name in Mongo, however, they dont have lib mongo. Do you know How to import python libs for ExecuteScript? Or any suggestions to load all Databases name and tables name in Mongo in Nifi Many thanks
... View more
Labels:
10-04-2018
10:07 AM
Hi All, I meet this error when use getMongo on Apache Nifi Would you please give me a solutions for it? Many thanks
... View more
Labels:
10-02-2018
07:52 AM
Hi @Shu, Nice to hear from you, That is great idea, however, .* is not work in AttributeToCSV Do you have any ideas to solved that issue? Many thanks
... View more
09-30-2018
04:27 PM
Hi @Shu, Thank you so much for your answers, however, the example is too manually, I have to specify all needed attributes/keys.
... View more
09-27-2018
06:01 PM
hi all, I have flow content is json [{"a":"IboECKV", "b":"2018-09-14 21:05:02.000Z", "c":"2132a4"}, {"a":"IboECKV_a2", "b":"2018-09-14 21:05:02.000Z", "c":"2132a4_c2"}] is it possible to convert it to csv using Attribute to csv without name each key in json (because it is dynamic array json)? can we use regular expression as $1, $.* or ...?? Many thanks
... View more
Labels:
09-27-2018
11:33 AM
hi all, I am using python script processing data. Fore example, in order to parse date I use lib dateutil. However, Apache NIFI doesnot have that lib, May you give a suggestions to install/add libs to NiFi? Many thanks,
... View more
Labels:
09-27-2018
10:27 AM
Hi all, I meet this error (Java Heap space) when I try to load data from MySQL May you suggest to me the ways to solved that issue? Many thanks,
... View more
Labels:
09-26-2018
09:23 PM
Hi Matt, This case the kind of servers are FTP
... View more
09-26-2018
08:59 PM
Hi all, I have json as:
{"col1":"IboECKV", "col2":"2018-09-14 21:05:02.000Z", "col3":10, "col4":0} now I want to chang to text (2 rows) as col1,col2,col3,col4 "IboECKV","2018-09-14 21:05:02.000Z",10,0 Is there any fast ways to do it? Many thanks
... View more
09-26-2018
08:07 PM
hi all, I have case: in flow content is always json format and the data inside json always change (both kyes and values). Is this possible to convert this flow content to csv? Many thanks,
... View more
Labels:
09-26-2018
11:02 AM
The script on to test in MySQL, in Nifi we use processor PutDatabaseRecord
... View more