Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

How to add Flume as a service in CDH 5.7.0

Solved Go to solution
Highlighted

How to add Flume as a service in CDH 5.7.0

Explorer

Hello, I am unable to find the "Flume " parcel in CDH 5.7.0. When I type flume-ng help, I get the required output that I should get if flume is intalled in my PC.

[cloudera@quickstart ~]$ flume-ng help
Usage: /usr/lib/flume-ng/bin/flume-ng <command> [options]...

commands:
help display this help text
agent run a Flume agent
avro-client run an avro Flume client
version show Flume version info

global options:
--conf,-c <conf> use configs in <conf> directory
--classpath,-C <cp> append to the classpath
--dryrun,-d do not actually start Flume, just print the command
--plugins-path <dirs> colon-separated list of plugins.d directories. See the
plugins.d section in the user guide for more details.
Default: $FLUME_HOME/plugins.d
-Dproperty=value sets a Java system property value
-Xproperty=value sets a Java -X option

agent options:
--name,-n <name> the name of this agent (required)
--conf-file,-f <file> specify a config file (required if -z missing)
--zkConnString,-z <str> specify the ZooKeeper connection to use (required if -f missing)
--zkBasePath,-p <path> specify the base path in ZooKeeper for agent configs
--no-reload-conf do not reload config file if changed
--help,-h display help text

avro-client options:
--rpcProps,-P <file> RPC client properties file with server connection params
--host,-H <host> hostname to which events will be sent
--port,-p <port> port of the avro source
--dirname <dir> directory to stream to avro source
--filename,-F <file> text file to stream to avro source (default: std input)
--headerFile,-R <file> File containing event headers as key/value pairs on each new line
--help,-h display help text

Either --rpcProps or both --host and --port must be specified.

Note that if <conf> directory is specified, then it is always included first
in the classpath.

But how to add and start it as a service in Cloudera manager as kafka. I don't understand wherher I need the flume to be started as a service or it will be enough to just install it?

When I check the status of flume from terminal:

[cloudera@quickstart ~]$ sudo service flume-ng-agent status
Flume NG agent is not running [FAILED]

So should I add it as a service in CM or not? If yes then how? Please suggest me.

1 ACCEPTED SOLUTION

Accepted Solutions

Re: How to add Flume as a service in CDH 5.7.0

Explorer

I got it. I restsrted the Cloudera manager and now when I click "Add a service". It shows flume in list.

2 REPLIES 2

Re: How to add Flume as a service in CDH 5.7.0

Explorer

I got it. I restsrted the Cloudera manager and now when I click "Add a service". It shows flume in list.

Re: How to add Flume as a service in CDH 5.7.0

Community Manager

I'm happy to see that you were able to resolve the issue. I'm also impressed with your use of the profile card option. It really makes you stand out in the crowd. :)



Cy Jervis, Community Manager

Was your question answered? Make sure to mark the answer as the accepted solution.
If you find a reply useful, say thanks by clicking on the thumbs up button.

Learn more about the Cloudera Community:
Community Guidelines
How to use the forum