Reply
Posts: 8
Topics: 5
Kudos: 0
Blog Posts: 0
Solutions: 1
Registered: ‎08-07-2016
Accepted Solution

How to add Flume as a service in CDH 5.7.0

Hello, I am unable to find the "Flume " parcel in CDH 5.7.0. When I type flume-ng help, I get the required output that I should get if flume is intalled in my PC.

[cloudera@quickstart ~]$ flume-ng help
Usage: /usr/lib/flume-ng/bin/flume-ng <command> [options]...

commands:
help display this help text
agent run a Flume agent
avro-client run an avro Flume client
version show Flume version info

global options:
--conf,-c <conf> use configs in <conf> directory
--classpath,-C <cp> append to the classpath
--dryrun,-d do not actually start Flume, just print the command
--plugins-path <dirs> colon-separated list of plugins.d directories. See the
plugins.d section in the user guide for more details.
Default: $FLUME_HOME/plugins.d
-Dproperty=value sets a Java system property value
-Xproperty=value sets a Java -X option

agent options:
--name,-n <name> the name of this agent (required)
--conf-file,-f <file> specify a config file (required if -z missing)
--zkConnString,-z <str> specify the ZooKeeper connection to use (required if -f missing)
--zkBasePath,-p <path> specify the base path in ZooKeeper for agent configs
--no-reload-conf do not reload config file if changed
--help,-h display help text

avro-client options:
--rpcProps,-P <file> RPC client properties file with server connection params
--host,-H <host> hostname to which events will be sent
--port,-p <port> port of the avro source
--dirname <dir> directory to stream to avro source
--filename,-F <file> text file to stream to avro source (default: std input)
--headerFile,-R <file> File containing event headers as key/value pairs on each new line
--help,-h display help text

Either --rpcProps or both --host and --port must be specified.

Note that if <conf> directory is specified, then it is always included first
in the classpath.

But how to add and start it as a service in Cloudera manager as kafka. I don't understand wherher I need the flume to be started as a service or it will be enough to just install it?

When I check the status of flume from terminal:

[cloudera@quickstart ~]$ sudo service flume-ng-agent status
Flume NG agent is not running [FAILED]

So should I add it as a service in CM or not? If yes then how? Please suggest me.

Posts: 8
Topics: 5
Kudos: 0
Blog Posts: 0
Solutions: 1
Registered: ‎08-07-2016

Re: How to add Flume as a service in CDH 5.7.0

I got it. I restsrted the Cloudera manager and now when I click "Add a service". It shows flume in list.

Highlighted
Posts: 1,003
Kudos: 119
Solutions: 62
Registered: ‎04-06-2015

Re: How to add Flume as a service in CDH 5.7.0

I'm happy to see that you were able to resolve the issue. I'm also impressed with your use of the profile card option. It really makes you stand out in the crowd. :)



Cy Jervis, Community Manager


Was your question answered? Make sure to mark the answer as the accepted solution.
If you find a reply useful, say thanks by clicking on the thumbs up button.

Learn more about the Cloudera Community:

Terms of Service

Community Guidelines

How to use the forum

Announcements
New solutions