@dutras ,   Please open a case with Cloudera support so that they can investigate the problem.   Cheers André   ... View more

Hi @Griggsy ,   You don't need to use regex for this. You can, for example, connect the output of the ParseSyslog5424 directly to the following AttributesToJson processor: The output of this will be a JSON like the one below: { "syslog.structuredData.SDID@0.os" : "linux", "syslog.structuredData.SDID@0.utilization" : "high" } You can then use a JoltTransformJSON process to transform the above into your final product. For example, the following JOLT specification: [ { "operation": "shift", "spec": { "syslog.structuredData.*.*": { "@": "&(1,2)" } } } ]   Will produce the following output: { "os" : "linux", "utilization" : "high" }   This is the flow:   Cheers, André -- Was your question answered? Please take some time to click on "Accept as Solution" below this post. If you find a reply useful, say thanks by clicking on the thumbs up button. ... View more

Hi, @CookieCream    As I updated jdk version to 17.0.2, it works!!! Great to hear it works. However, as I mentioned in my previous post, please note that NiFi is not supported on Java 17, only Java 8 and 11. Please bear this in mind. If you find any strange behaviour, try using Java 11 instead.   It might be silly but have a couple more questions: 1. As I check for the java version on the terminal, it shows the right version     java version "17.0.2" 2022-01-18 LTS Java(TM) SE Runtime Environment (build 17.0.2+8-LTS-86) Java HotSpot(TM) 64-Bit Server VM (build 17.0.2+8-LTS-86, mixed mode, sharing)     But JAVA_HOME environment variable holds the old directory and I have to type 'export JAVA_HOME =  /Library/Java/JavaVirtualMachines/jdk-17.0.2.jdk/Contents/Home' every time I open the terminal to launch nifi. Could you tell me how to set JAVA_HOME permanently?  I'm not sure how JAVA_HOME is being set in your environment. I guess this depends on how Java 8 was installed in the first place.   But one way to overwrite this is to add the export command at the end of you ~/.bashrc file. This way it will be executed automatically every time you open a new terminal.   2. When I access to nifi, it asks me to enter User and Password. I found the answer for the same issue and it says that I could find the user info as search text 'Generated User'/'Generated Password' on nifi-app.log, but I do not see any information   Thank you. If you ran the commands I listed before, you executed this as well:      ./bin/nifi.sh set-single-user-credentials admin supersecret1       This sets your credentials to admin/supersecret1, instead of getting them generated randomly. Try using these credentials to log in.   Cheers, André   ... View more

@Onkar_Gagre ,   The ConsumerKafka processor will consume every single message from Kafka as a separate flowfile, which is very innefficient and makes NiF very slow to process all the data that you have. You should rewrite your flow using record-based processors, which will give you a lot more performance and throughput.   Please watch Mark Payne's "Apache NiFi Anti-Patterns, Part 1" where he explains the concept of record-based processing and talks about what not to do in NiFi.   Cheers, André -- Was your question answered? Please take some time to click on "Accept as Solution" below this post. If you find a reply useful, say thanks by clicking on the thumbs up button. ... View more

@FJATP    Can you share your flow definition?   André   ... View more

@na2_koihey11 ,   Yes, there is! Please take a look at the page below:   https://docs.cloudera.com/runtime/7.2.10/using-hiveql/topics/hive_hive_3_tables.html   Cheers, André   -- Was your question answered? Please take some time to click on "Accept as Solution" below this post. If you find a reply useful, say thanks by clicking on the thumbs up button. ... View more

What's the error you're getting?   André ... View more