I am new to Flume and I want to use Flume to push the web server and application server logs into HDFS (these servers not part of Hadoop cluster). Is it mandatory to install Flume agent (client) on these servers? Can I pull logs from these servers to HDFS without installing Flume agents on them?
Thank you for detail solution.
I am also wondering , how I can trigger Flume agent on cluster from Edge node (edge node not passwordless ssh to hadoop cluster) as I dont have permission to log in hadoop cluster.
I am executing Flumge-ng agnet command on Edge node.
As you already explained in another post, I need to run Flume as service on Edge node to start / stop flume agent.