Member since
02-07-2019
2690
Posts
235
Kudos Received
30
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
1180 | 04-15-2025 10:34 PM | |
3354 | 10-28-2024 12:37 AM | |
1440 | 09-04-2024 07:38 AM | |
3288 | 06-10-2024 10:24 PM | |
1396 | 02-01-2024 10:51 PM |
03-27-2023
10:04 AM
@NafeesShaikh93 Interesting Use case you have. I am not all that familiar with all the methods the Graylog offers for ingesting logs from other servers. I'd assume Syslog is one of them? If so, NiFi offers. putSyslog processor. Looking at the dataflow you build thus far, I am not sure what you are trying to accomplish. The LogAttribute and logMessage processors allows you to write a log entry in a NiFi log defined by an appender and logger in the logback.xml NiFi configuration file. By default these log lines would end up in the nifi-app.log. You could however add an additional appender and the a custom logger to send log lines produced by these processors classes to the new appender thus isolating them from the other logging in the nifi-app.log. There is no way to setup a specific logger by processor on canvas. So every logAttribute and logMessage processor you use will write to the same destination NiFi appender log. The classes for the logAttribute and logMessage processors are: org.apache.nifi.processors.standard.LogAttribute
org.apache.nifi.processors.standard.LogMessage NiFi also has a tailFile processor that can tail a log file and create FlowFiles with that log entries at content. You could then use PutSyslog processor to send those log lines to yoru Graylog server possibly. The above design involves extra disk I/O that may not be necessary since you could possibly design your flow to create FlowFile attributes with all the file information you want to send to GrayLog an then use a replaceText at end of successful dataflow to replace the content of yoru FlowFile with a crafted syslog formatted content from those attributes and send directly to Graylog via the PutSyslog processor. This removes the need to write to a new logger and consume from that new log before sending o syslog. But again this is a matter of preference. Perhaps in you case maybe you want a local copy of these logs as well. If you found that the provided solution(s) assisted you with your query, please take a moment to login and click Accept as Solution below each response that helped. Thank you, Matt
... View more
03-27-2023
02:09 AM
@TB_19 as this is an older post, you would have a better chance of receiving a resolution by starting a new thread. This will also be an opportunity to provide details specific to your environment that could aid others in assisting you with a more accurate answer to your question. You can link this thread as a reference in your new post.
... View more
03-23-2023
07:15 AM
@deepikaw What is the version of RHEL/CentOS? Try removing the kernel quiet parameter in /etc/grub.conf Memory looks okay for Quicstart though the higher the better This message occurs when kickstarting a RHEL you need to provide another "vmlinuz" and "initrd.img" to kickstart the machine. In case for example of kickstarting RHEL x.3, I simply used the vmlinuz and initrd.img from RHEL x.4. higher version For "mp-BIOS bug :8254 timer not connected to IO-APIC"There is a kernel workaround, I believe booting with the kernel parameter "noapic" could work
... View more
03-22-2023
03:49 AM
Thanks for Help , Issue is resolved After restarting Impala from Ui. Status tab in CDP (impala -> status) it show Impala Connection String Example shows command to connect : i.e Impala Shell Command mpala-shell -i mprl510 -d default . i am successfully login into my impala shell
... View more
03-16-2023
08:16 AM
1 Kudo
Awesome news, +2 solutions here.
... View more
03-14-2023
12:57 AM
well if you want to modify the port, you have to stop nifi, modify nifi.properties and restart nifi. But without knowing how you configured NiFi ( content of nifi.properties) nobody can tell you how to solve your issue. Maybe you can add the content of nifi.properties here and afterwards we can guide you further. Nevertheless, how Matt stated below, you need to check your application logs and see if NiFi started correctly. If NiFi starts correctly, you will see a log line saying that NiFi UI (User Interface) is available at a specific URL. You need to take that URL and paste it in your browser. If such a line is not available, than you need to check the logs to see what the error is.
... View more
03-12-2023
11:09 PM
@GSB Have any of the replies helped resolve your issue? If so, please mark the appropriate reply as the solution, as it will make it easier for others to find the answer in the future.
... View more
03-11-2023
12:25 AM
1 Kudo
Hi and sorry for the late update, A correction has officially been delivered within version 2.6.15 of the Cloudera ODBC Hive Driver; excerpt from the Release Notes : [00416069] [HAR-1323] The REMARKS column of the tables metadata does not populate with comments.
... View more