Reply
Explorer
Posts: 28
Registered: ‎04-15-2018

Unable Start Flume

[ Edited ]

I have added flume service to my cluster and I have changed agent configurations as follows

 

tier1.sources = r1
tier1.channels = k1
tier1.sinks = c1
tier1.sources.r1.type = exec
tier1.sources.r1.command = /usr/local/bin/machinedata
tier1.channels.k1.type = file
tier1.channels.k1.transactionCapacity = 1000000
tier1.channels.k1.checkpointInterval = 100000
tier1.channels.k1.capacity = 10000000
tier1.sinks.c1.type = hdfs
tier1.sinks.c1.hdfs.path = hdfs:/data/incoming
tier1.sinks.c1.hdfs.filePrefix = machinedata
tier1.sinks.c1.hdfs.rollCount = 0
tier1.sinks.c1.hdfs.roliInterval 30
tier1.sinks.c1.hdfs.rollSize = 4000000
tier1.sinks.c1.hdfs.batchSize = 10000
tier1.sinks.c1.hdfs.useLocalTimeStamp = true
tier1.sinks.c1.hdfs.minBlockReplicas = 1
tier1.sources.r1.channels = k1
tier1.sinks.c1.channel = k1

When I start flume agent I was uanble to start showing following error in log file

 

3:59:10.514 PM ERROR NetcatSource
Unable to bind to socket. Exception follows.
java.net.BindException: Address already in use
	at sun.nio.ch.Net.bind0(Native Method)
	at sun.nio.ch.Net.bind(Net.java:444)
	at sun.nio.ch.Net.bind(Net.java:436)
	at sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:214)
	at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:74)
	at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:67)
	at org.apache.flume.source.NetcatSource.start(NetcatSource.java:164)
	at org.apache.flume.source.EventDrivenSourceRunner.start(EventDrivenSourceRunner.java:44)
	at org.apache.flume.lifecycle.LifecycleSupervisor$MonitorRunnable.run(LifecycleSupervisor.java:249)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
	at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:304)
	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:178)
	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
3:59:10.515 PM INFO NetcatSource
Source stopping

 

I was saying that the address is already  is in use

Can you give me solution?

Thanks & Regards

@solomonchinni

Announcements