@jpercivall Since there is a similar thread below , i posted a detailed flow there. i tried to send it as content from a flowfile but still not working. https://community.hortonworks.com/questions/54481/how-to-add-request-headers-and-request-body-to-the.html Regards, Sai ... View more

@Matt Burgess I am trying to follow the same steps to a get a Auth key from an 3rd party API and then subsequently use it in other calls.but still not able to connect to the rest api thri NiFi. I could able to test it successfully thru their test site..here is how it looks.. and i am trying to do the same from NiFi .doing below.. ReplaceText processor UpdateAttribute processor InvokeHTTP other properties of invokeHTTP Content-Type ${mime.type} Send Message Body true is this the correct approach , if yes what am i doing wrong.?? Regards,Sai ... View more

@Timothy Spann, My NiFi is not SSL configured yet , can I still create SSL Context even if my NiFi instance is not.?? ... View more

@mclark , looks like we have finally decided to go with the below configuration. Please let me know if you see any thing alarming. I don't think 1.2 TB is needed for flow file , but with RAID 10 that the default. I will ask our vendor to see if we can some space from it to be allocated to Content repo. HDF Server (RHEL 7) ***128 GB**16 Core 2 x 600GB 15K OS (RAID1) 4 x 600GB 15K FileFlow (RAID10) *** gives us 1.2 TB 6 x 600GB 15K Content (RAID10) *** gives us 1.8 TB 4 x 600GB 15K Provenance (RAID10) **gives us 1.2 TB Thanks, Sai ... View more

@mclark so when the flow file is archived after auto termination at the end of the data flow , it is moved inside content repository from a folder to folder\archive.?? ... View more

@mclark Thanks for your help on this so far.. we are almost there.. does content repository holds all files that are processed during the time period specified in the nifi.conf setting.? or will it only hold the files that have failed or errors in processing.?? if it holds all what is the use of holding all the files that are processed successfully.? is there a setting that i can set to delete files that are processed sucessfully.?? Regards, Sai ... View more

@mclark Let's say if we have 10 disks , 2 RAid 1 and 8 RAID 10..all 600 gb then can I have 3 RAID 10s for content report 1 RAID 10 FOR prov repo And 1 RAID 1 for /var/log/nifi,/opt/nifi/flowfile_repo, /opt/nifi/database_repo I am trying to see how best we can configure with 8 RAID 10 disks and 2 RAid 1 disks..I can add more if need be.. ... View more

@mclark, can you please input your thoughts.. If we go with eight(8) 600 GB RAID 10 disks. I think we only get 4 disks for storage out of 8 as RAID 10 will use the other 4 for mirroring and stripping. Can we point 3 of them to content repo and 1 to provenance repo.? so that makes 1.8 TB for content repo. so our configuration looks like 16 core 128 MB RAM Server One disk 600 GB RAID 1 for OS and Nifi Software (flowfile,data repo etc) One disk 600 GB RAID 10 for Provenance repo Three disks 600 GB RAID 10 for Content repo My main doubt was since RAID 10 comes in 4 disks (2 for storage and 2 for mirroring).i am sure we can use one set 1.2 TB for cont repo. Out of the remaining 2 disks (second set) ,can i point one to cont repo and another one to prov repo.?? Thanks, ... View more

@mclark ,Thank you. also what happens if the server breaks down or we loose the disks because of corruptions or \ failures.?? how do we get back NiFi to its previous state.? can we persist NiFi's state to any database.? i read some where that if we can keep a back up of /conf folder , we should be in good shape .? any help here is much appreciated. ... View more