Support Questions
Find answers, ask questions, and share your expertise

I know this is a basic question, but just started with Nifi, want to save syslog data into HDFS, can anyone help

Expert Contributor

It'll be helpful if details as what processors to be used is suggested

1 ACCEPTED SOLUTION

Master Guru
@Hadoop User

The processor components all have tags associated to them and the associated documentation for each processor component is also embedded in the application under "help" (found in upper right corner menu).

If you drag the add "Processor" icon to your canvas you will be presented with aadd processor UI. In the upper right corner is a filter box. Typing "syslog" or "hdfs" will reduce the list to those processors that share those tags.

19468-screen-shot-2017-07-14-at-91514-am.png

Clicking on a processor will display a brief description of the processor in the same UI near the bottom.

Details documentation can be found in help or by right clicking on a processor already added to the canvas and selecting"usage" form the context menu that appears.

19469-screen-shot-2017-07-14-at-91738-am.png

As far as what processor you want to use depends on your complete use case. First you need to determine ho you are going to ingest this syslog data (ListenSyslog) processor is an option. As far as writing to HDFS, the PutHDFS processor is the likely choice. There are many processors available for manipulating NiFi FlowFile content between ingestion and writing out the data to a destination.

Thanks,

Matt

View solution in original post

1 REPLY 1

Master Guru
@Hadoop User

The processor components all have tags associated to them and the associated documentation for each processor component is also embedded in the application under "help" (found in upper right corner menu).

If you drag the add "Processor" icon to your canvas you will be presented with aadd processor UI. In the upper right corner is a filter box. Typing "syslog" or "hdfs" will reduce the list to those processors that share those tags.

19468-screen-shot-2017-07-14-at-91514-am.png

Clicking on a processor will display a brief description of the processor in the same UI near the bottom.

Details documentation can be found in help or by right clicking on a processor already added to the canvas and selecting"usage" form the context menu that appears.

19469-screen-shot-2017-07-14-at-91738-am.png

As far as what processor you want to use depends on your complete use case. First you need to determine ho you are going to ingest this syslog data (ListenSyslog) processor is an option. As far as writing to HDFS, the PutHDFS processor is the likely choice. There are many processors available for manipulating NiFi FlowFile content between ingestion and writing out the data to a destination.

Thanks,

Matt

Take a Tour of the Community
Don't have an account?
Your experience may be limited. Sign in to explore more.