Member since
07-14-2017
99
Posts
5
Kudos Received
4
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
1446 | 09-05-2018 09:58 AM | |
1968 | 07-31-2018 12:59 PM | |
1440 | 01-15-2018 12:07 PM | |
1344 | 11-23-2017 04:19 PM |
01-23-2018
11:31 AM
@Matt Burgess Thanks for the suggestion. I can use replace text, but if any unmatched files are present(could be) they will also be processed as they are. In this case how can I get rid off, could you please suggest me. Also I need the attrribute which is being extracted from extract text processor.
... View more
01-22-2018
05:18 PM
Hi, I have 1M files flowing per second. flowfile: This is a standard [flowfile name="11" size="1KB"........ timestamp="2018-01-21 10:00:00.00000000"][end of file] extract text property .*(\[flowfile(.*?")\]).* replacetext $2 As I have "[flowfile" as constant in every file and I need only data between "[flowfile" and "][end of file]", I have set extract text as above. I can see around 1500-2000 files are being processed persecond (concurrent processors=1, if set to 4, 6000-8000 files/sec are processed. As, incoming files are 1M/s and outgoing are only 2000/s. There is a huge difference in incoming and out going. Could you please help me in increasing extract text performance.
... View more
Labels:
- Labels:
-
Apache NiFi
01-15-2018
12:02 PM
I am using extract text with replace text as below Original string: _fwip="abc" new fwip in context as new_fwip="[This is \"new_fwip\""] and other text extract text properties abc: (_fwip.*")\] replace text properties search value: .* replace value: ${abc.1} I am getting the value _fwip="abc" new fwip in context as new_fwip="[This is "new_fwip"" In the replaced text I am missing \. Can you please help me to understand why I am missing \ Thanks for your help
... View more
Labels:
- Labels:
-
Apache NiFi
12-08-2017
02:26 PM
1 Kudo
@Shu Thanks for the detailed explination. I am using nifi 1.1 and in linux env. Also the /day folder is in hdfs which is in linux. Iam also wondered why zip was not working.
... View more
12-07-2017
10:33 AM
@Shu I tried the above. I am getting an error I have the directory and files, still I am getting this error.
... View more
12-06-2017
04:33 PM
1 Kudo
@Shu I tried the above as you said. What I am getting is /day/20171202/YYYYMMddHHmm.bz2 what I am looking for is /day/20171202.zip can you help me please
... View more
12-05-2017
10:53 AM
I am having a YYYYMMdd folder in which I have files with YYYYMMddHHmm format. ex: /day/20171202/201712020000..201712022359 Can we zip the folder 20171202 to compress and put it back in the same location.
... View more
Labels:
- Labels:
-
Apache NiFi
12-04-2017
03:27 PM
@Bryan Bende I am trying to put in puthbasejson {"name":"MARK","color":"green&green","screen":"5.5 inch","resolution":"1000:1", "address":"1,1/1,NewYork","comments":"a1-1:\"newcomment" is registered"}
... View more
12-01-2017
11:16 AM
I am trying to put data in to hbase using puthbasejson. When trying to put a timestamp '2017-12-01 10:00:00' and a name like 'Donald, Mark', I am getting error (basically could not insert ":" and ","). I tried escaping them with "\", could not able to put. Can anyone suggest how to put the above values
... View more
Labels:
- Labels:
-
Apache HBase
-
Apache NiFi