Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

I know this is a basic question, but just started with Nifi, want to save syslog data into HDFS, can anyone help

avatar
Expert Contributor

It'll be helpful if details as what processors to be used is suggested

1 ACCEPTED SOLUTION

avatar
Super Mentor
@Hadoop User

The processor components all have tags associated to them and the associated documentation for each processor component is also embedded in the application under "help" (found in upper right corner menu).

If you drag the add "Processor" icon to your canvas you will be presented with aadd processor UI. In the upper right corner is a filter box. Typing "syslog" or "hdfs" will reduce the list to those processors that share those tags.

19468-screen-shot-2017-07-14-at-91514-am.png

Clicking on a processor will display a brief description of the processor in the same UI near the bottom.

Details documentation can be found in help or by right clicking on a processor already added to the canvas and selecting"usage" form the context menu that appears.

19469-screen-shot-2017-07-14-at-91738-am.png

As far as what processor you want to use depends on your complete use case. First you need to determine ho you are going to ingest this syslog data (ListenSyslog) processor is an option. As far as writing to HDFS, the PutHDFS processor is the likely choice. There are many processors available for manipulating NiFi FlowFile content between ingestion and writing out the data to a destination.

Thanks,

Matt

View solution in original post

1 REPLY 1

avatar
Super Mentor
@Hadoop User

The processor components all have tags associated to them and the associated documentation for each processor component is also embedded in the application under "help" (found in upper right corner menu).

If you drag the add "Processor" icon to your canvas you will be presented with aadd processor UI. In the upper right corner is a filter box. Typing "syslog" or "hdfs" will reduce the list to those processors that share those tags.

19468-screen-shot-2017-07-14-at-91514-am.png

Clicking on a processor will display a brief description of the processor in the same UI near the bottom.

Details documentation can be found in help or by right clicking on a processor already added to the canvas and selecting"usage" form the context menu that appears.

19469-screen-shot-2017-07-14-at-91738-am.png

As far as what processor you want to use depends on your complete use case. First you need to determine ho you are going to ingest this syslog data (ListenSyslog) processor is an option. As far as writing to HDFS, the PutHDFS processor is the likely choice. There are many processors available for manipulating NiFi FlowFile content between ingestion and writing out the data to a destination.

Thanks,

Matt