Created on 08-12-2016 03:28 AM - edited 09-16-2022 03:34 AM
Hello, I am unable to find the "Flume " parcel in CDH 5.7.0. When I type flume-ng help, I get the required output that I should get if flume is intalled in my PC.
[cloudera@quickstart ~]$ flume-ng help
Usage: /usr/lib/flume-ng/bin/flume-ng <command> [options]...
commands:
help display this help text
agent run a Flume agent
avro-client run an avro Flume client
version show Flume version info
global options:
--conf,-c <conf> use configs in <conf> directory
--classpath,-C <cp> append to the classpath
--dryrun,-d do not actually start Flume, just print the command
--plugins-path <dirs> colon-separated list of plugins.d directories. See the
plugins.d section in the user guide for more details.
Default: $FLUME_HOME/plugins.d
-Dproperty=value sets a Java system property value
-Xproperty=value sets a Java -X option
agent options:
--name,-n <name> the name of this agent (required)
--conf-file,-f <file> specify a config file (required if -z missing)
--zkConnString,-z <str> specify the ZooKeeper connection to use (required if -f missing)
--zkBasePath,-p <path> specify the base path in ZooKeeper for agent configs
--no-reload-conf do not reload config file if changed
--help,-h display help text
avro-client options:
--rpcProps,-P <file> RPC client properties file with server connection params
--host,-H <host> hostname to which events will be sent
--port,-p <port> port of the avro source
--dirname <dir> directory to stream to avro source
--filename,-F <file> text file to stream to avro source (default: std input)
--headerFile,-R <file> File containing event headers as key/value pairs on each new line
--help,-h display help text
Either --rpcProps or both --host and --port must be specified.
Note that if <conf> directory is specified, then it is always included first
in the classpath.
But how to add and start it as a service in Cloudera manager as kafka. I don't understand wherher I need the flume to be started as a service or it will be enough to just install it?
When I check the status of flume from terminal:
[cloudera@quickstart ~]$ sudo service flume-ng-agent status
Flume NG agent is not running [FAILED]
So should I add it as a service in CM or not? If yes then how? Please suggest me.
Created 08-12-2016 04:01 AM
I got it. I restsrted the Cloudera manager and now when I click "Add a service". It shows flume in list.
Created 08-12-2016 04:01 AM
I got it. I restsrted the Cloudera manager and now when I click "Add a service". It shows flume in list.
Created 08-12-2016 05:42 AM
I'm happy to see that you were able to resolve the issue. I'm also impressed with your use of the profile card option. It really makes you stand out in the crowd. 🙂