Member since
04-20-2016
27
Posts
5
Kudos Received
1
Solution
My Accepted Solutions
Title | Views | Posted |
---|---|---|
7122 | 09-30-2016 03:06 PM |
09-07-2016
05:35 PM
1 Kudo
Hi All, @Pierre Villard ,@mclark, @Bryan Bende, @Brandon Wilson, @jfrazee, @Andrew Grande , @Matt Burgess could you please assist me with the above.Greatly appreciate the help please.I have explained everything thoroughly.
... View more
09-02-2016
09:21 PM
Hi All, @Pierre Villard ,@mclark, @Bryan Bende, @Brandon Wilson, @jfrazee, @Andrew Grande , @Matt Burgess I have been able to insert into MYSQL by setting "Obtain Generated Keys =true" in PutSQL configuration (pics below) but the problem now is, there is an insane number of duplicates that got ingested into the mysql table(pics below). I would like to know what might be going on with my flow to cause this and how to fix it.Thanks a lot!! (i)PutSql Configuration (ii)ExtractText (iii)Original data to be ingested into MYSQL (iv)Table count after PutSQL nifi ingest
... View more
09-02-2016
05:27 PM
Hi All, @mclark, @Bryan Bende, @Brandon Wilson, @jfrazee, @Pierre Villard, @Andrew Grande I would appreciate if you could get assist me on the above.Please refer to the above for details and explanation.Thanks a lot!
... View more
09-02-2016
04:41 PM
Hi @Matt Burgess could there other reasons such as available RAM on this nifi compute? Am currently using a t2 medium in AWS .
... View more
09-01-2016
09:12 PM
Hi @Matt Burgess thanks a lot for responding I updated my workflow with the specifics you suggested but I still cannot insert into mysql db, am getting the same error as mentioned previously.I also attached my configs as well. PutSQL ERROR: failed to update a database due to a failed batch update.There were a total of 1 flow file that failed, 0 that succeeded and 0 that were not excuted and will be rerouted to retry. (i)Updated Workflw (ii)SplitText Config (iii)ExtractText Config (iv) Both ReplaceText and PutSQL remain unchanged. ps: What is the tiny number "1" that appears when processors are running. Cheers
... View more
09-01-2016
05:29 PM
1 Kudo
Hi community, I would like to leverage nifi to ingest a file from sftp and insert its data into mysql database.I currently have been unsuccessful in doing so and will require all assistance in the right direction.Much appreciated for the help in advance and below are the specifics (1)I should be able to list the files on sftp (2) select a particular file or files (3)Fetch the "desired file" (4) Ingest "desired file" into database. Below is more detail. (i)Sample content of sftp file to ingest into via nifi via sftp processors later to insert into MYSQL (ii)Current designed nifi workflow (iii)Error am getting with this workflow ConvertJSONToSQL ERROR: failed to parse standardflowfilerecord due to processor exception as JSON unexpected character (''' (code39)) expected a valid value (number,string,array,object,'true','false' or 'null') PutSQL ERROR: failed to update a database due to a failed batch update.There were a total of 1 flow file that failed, 0 that succeeded and 0 that were not excuted and will be rerouted to retry. (iv)Processor Configs 1. ReplaceTxext sql statement: INSERT INTO NiFiUsecase001 (Column1, Column2, Column3, Column4, Column5)
VALUES ('${Column1}', '${Column2}','${Column3}','${Column4}','${Column5}') 2. ConvertJSONToSQL 3.PutSQL
... View more
Labels:
- Labels:
-
Apache NiFi
04-29-2016
03:22 PM
@Timothy Spann should local master be set to "yarn-client" like it was set in "spark-yarn-interpreter"? The cluster is running spark 1.6 and works perfectly from the command line and yes the green connected light is on on the upper right corner.
... View more
04-27-2016
07:49 PM
@Timothy Spann Yes spark is running in the cluster and on its default port(never changed the default port).I attached the configuration screen for spark interpreter.I can also access spark from the commandline and also from the UI those work perfectly.Thanks!
... View more
04-27-2016
04:34 PM
@Timothy Spann nothing is conflicting with firewall settings and there are no services running on port 9995 except zeppelin.Since server in use I'll restart at down-time
... View more
04-27-2016
03:20 PM
@Yogeshprabhu I attached spark-yarn-client interpreter settings. Thanks
... View more
- « Previous
-
- 1
- 2
- Next »