How to add Flume as a service in CDH 5.7.0

Richi — Fri, 16 Sep 2022 10:34:25 GMT

Hello, I am unable to find the "Flume " parcel in CDH 5.7.0. When I type flume-ng help, I get the required output that I should get if flume is intalled in my PC.

[cloudera@quickstart ~]$ flume-ng help
Usage: /usr/lib/flume-ng/bin/flume-ng <command> [options]...

commands:
help display this help text
agent run a Flume agent
avro-client run an avro Flume client
version show Flume version info

global options:
--conf,-c <conf> use configs in <conf> directory
--classpath,-C <cp> append to the classpath
--dryrun,-d do not actually start Flume, just print the command
--plugins-path <dirs> colon-separated list of plugins.d directories. See the
plugins.d section in the user guide for more details.
Default: $FLUME_HOME/plugins.d
-Dproperty=value sets a Java system property value
-Xproperty=value sets a Java -X option

agent options:
--name,-n <name> the name of this agent (required)
--conf-file,-f <file> specify a config file (required if -z missing)
--zkConnString,-z <str> specify the ZooKeeper connection to use (required if -f missing)
--zkBasePath,-p <path> specify the base path in ZooKeeper for agent configs
--no-reload-conf do not reload config file if changed
--help,-h display help text

avro-client options:
--rpcProps,-P <file> RPC client properties file with server connection params
--host,-H <host> hostname to which events will be sent
--port,-p <port> port of the avro source
--dirname <dir> directory to stream to avro source
--filename,-F <file> text file to stream to avro source (default: std input)
--headerFile,-R <file> File containing event headers as key/value pairs on each new line
--help,-h display help text

Either --rpcProps or both --host and --port must be specified.

Note that if <conf> directory is specified, then it is always included first
in the classpath.

But how to add and start it as a service in Cloudera manager as kafka. I don't understand wherher I need the flume to be started as a service or it will be enough to just install it?

When I check the status of flume from terminal:

[cloudera@quickstart ~]$ sudo service flume-ng-agent status
Flume NG agent is not running [FAILED]

So should I add it as a service in CM or not? If yes then how? Please suggest me.

Re: How to add Flume as a service in CDH 5.7.0

Richi — Fri, 12 Aug 2016 11:01:03 GMT

I got it. I restsrted the Cloudera manager and now when I click "Add a service". It shows flume in list.

Re: How to add Flume as a service in CDH 5.7.0

cjervis — Fri, 12 Aug 2016 12:42:36 GMT

I'm happy to see that you were able to resolve the issue. I'm also impressed with your use of the profile card option. It really makes you stand out in the crowd. 🙂

question Re: How to add Flume as a service in CDH 5.7.0 in Support Questions

How to add Flume as a service in CDH 5.7.0

Re: How to add Flume as a service in CDH 5.7.0

Re: How to add Flume as a service in CDH 5.7.0