Member since
07-14-2017
99
Posts
5
Kudos Received
4
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
1446 | 09-05-2018 09:58 AM | |
1967 | 07-31-2018 12:59 PM | |
1440 | 01-15-2018 12:07 PM | |
1344 | 11-23-2017 04:19 PM |
08-10-2018
12:15 PM
@Mark sure, here is the link to the pyspark network word count example: https://github.com/apache/spark/blob/master/examples/src/main/python/streaming/network_wordcount.py HTH
... View more
07-31-2018
12:59 PM
@Bryan Bende I checked the nifi-app.log, the JVM heap size is max, whcih is rejecting the connections and failing the processor. It got resolved as the heap size issue is solved. Thank you for you support.
... View more
07-30-2019
02:16 PM
@Shu Wanted to know, to add the "Validation query" is really mandatory to have to run the controller service or not?
... View more
12-28-2018
01:32 PM
For some reason, the unicode \u003B translates to ) for me. Beeline version 1.1.0-cdh5.13.3 by Apache Hive
0: jdbc:hive2://gbrdsr000002995.intranet.barc> select '\u003B' as col; +------+--+ | col | +------+--+ | ) | +------+--+ I have tried "\u0059" instead to replace semicolon (;) which works for me 0: jdbc:hive2://gbrdsr000002995.intranet.barc> select '\u0059' as col; +------+--+ | col | +------+--+ | ; |
+------+--+
... View more
03-14-2018
02:43 PM
@Shu Thanks, that works.
... View more
01-24-2018
04:57 PM
So right now it appears you are trying to do validation and extraction at the same time, since you don't want "case 2" to move down the stream. If your new ReplaceText from this comment is more performant than the one from the original question, you can use RouteOnContent first to exclude the files that do not have the required header and footer. Since there will now be two pattern matching processors, you may find that it is less performant, but it's probably worth a try. Another option is ExecuteScript with a fast scripting language like Groovy or Javascript/Nashorn, but the overhead of the interpreted script might be worse than the improvement of looking only for headers/footers rather than a whole regex.
... View more
01-15-2018
03:33 PM
1 Kudo
@Mark I have tried with same configurations as you mentioned in the question in extract text and in replace text processors, The output flowfile contents from replace text processor resulting with \ in it. Output:- Here is my configurations:- Extract Text:- Output from extract text processor:- abc attribute value having \ in it Replace Text:- As Regex Replace as Replacement Strategy (Or) Replacement Strategy as Always Replace Output:- Both of these Replacement strategies are resulting same output that i mentioned as first screenshot. Once check the attribute abc value after Extract Text processor having \ in it or not. If you still having issue then share your flow and configs of the processors please..
... View more
12-21-2017
02:06 PM
@Shu I also have same requirement to zip a folder in hdfs directly. I am using mergeContent processor with merge format ZIP, But i am not able to get a single zipped file file after the merge content processor.
... View more