Member since
08-22-2018
4
Posts
0
Kudos Received
0
Solutions
09-14-2018
07:38 AM
Hi everyone, I'm facing an issue with apache Nifi 1.3.0 when trying to extract files from an ftp to store them in AWS S3. My targeted file's sizes range greatly from very small files (a few Kb) to vers large files (more than 4 Gb). I'm facing an "java.io.ioexception no space left on device" issue with the errors messages available in the screen provided below in the Bulletin Board. After reading this article https://community.hortonworks.com/content/kbentry/82308/understanding-how-nifis-content-repository-archivi.html , I tired to decrease the nifi.content.repository.archive.max.retention.period from 12 hours to one and the nifi.content.claim.max.flow.files from 100 ton 10 with no success. Thanks in advance,
... View more
09-11-2018
04:40 PM
Dear all, I would like to thanks in advance anyone car provide some help. My problem is: I need to merge texts flowfiles with the unicode start of text character as delimteur (0x02). I've tried multiple ways to do it but nifi seems to not recognize this char. Again, thanks in advance
... View more
08-22-2018
02:11 PM
Hi @Shu, First of all, a great thanks for your help. Second of all, the defragment strategy generate a infinit processus because of our filterfing step above. Our hypothesis is : after this filtering, the defragment step wait for the total numbrer of files and did not take into account the decrease due to this filter. When we do some chacks on attributes coming from filter, the fragment.count value seems to be still equal to the total files count. Thank you again.
... View more
08-22-2018
01:09 PM
Hi everybody, We have a list of zip file, and we want to unzip them and filter based on filename. Then we want to concatenate content of each zip ile in file text for each original zip.
for example : fileA.zip, fileB.zip.
- fileA : fileA_1.html fileA_2.html fileA_tofilter.html etc ..
- fileB : fileB_1.html fileB_2.html etc ..
As output we want : two zip fileA.zip => a concatenantion of fileA_1.html fileA_2.html, same thing for B
But our problem is, the mergeContent processor is too fast and concatenate each time the queue has some flowfiles.
We are trying to wait until all files to be filtered. We want to update the fragment.count attribute, after filtering but failed on it. Thanks
... View more
Labels: