Hello - I am unable to see any other details. It does pull the file in the first 1-2 hours, and later prevents it from dragging logs from rabbitmq into the hdfs path. After running for 1-2 hours, it throws an error in which no file is being created. So every time, we need to stop the agent and start it again. ... View more

This is the only error that I am getting. Flume agent runs for about 15-20 minutes and pulls the log from rabbitmq into the hdfs path. Once it throws down the error, no file is being created. So every time we stop manually and the agent starts to get the log.    Exception in thread "PollableSourceRunner-RabbitMQSource-rabbitmq-source1" java.lang.AbstractMethodError: org.apache.flume.source.rabbitmq.RabbitMQSource.getBackOffSleepIncrement()J at org.apache.flume.source.PollableSourceRunner$PollingRunner.run(PollableSourceRunner.java:142) at java.lang.Thread.run(Thread.java:748)     # Configure the sinsink1 a1.sinks.sink1.hdfs.path =<Path> a1.sinks.sink1.hdfs.fileType = CompressedStream a1.sinks.sink1.hdfs.codeC = gzip a1.sinks.sink1.hdfs.filePrefix = XYZ1 a1.sinks.sink1.hdfs.rollInterval = 920 a1.sinks.sink1.hdfs.batchsize = 5000 a1.sinks.sink1.hdfs.rollSize = 1000000000 a1.sinks.sink1.hdfs.rollCount = 100000 a1.sinks.sink1.hdfs.callTimeout = 150000 a1.sinks.sink1.hdfs.idleTimeout = 1000 # Configure the sinsink2 a1.sinks.sink2.hdfs.path = <Path> a1.sinks.sink2.hdfs.fileType = CompressedStream a1.sinks.sink2.hdfs.codeC = gzip a1.sinks.sink2.hdfs.filePrefix = XYZ2 a1.sinks.sink2.hdfs.rollInterval = 920 a1.sinks.sink2.hdfs.batchsize = 5000 a1.sinks.sink2.hdfs.rollSize = 1000000000 a1.sinks.sink2.hdfs.rollCount = 100000 a1.sinks.sink2.hdfs.callTimeout = 150000 a1.sinks.sink1.hdfs.idleTimeout = 1000 a1.sinkgroups = g1 a1.sinkgroups.g1.sinks = sink1 sink2 a1.sinkgroups.g1.processor.type = load_balance a1.sinkgroups.g1.processor.backoff = true a1.sinkgroups.g1.processor.selector = random   ... View more

Exception in thread "PollableSourceRunner-RabbitMQSource-rabbitmq-source1" java.lang.AbstractMethodError: org.apache.flume.source.rabbitmq.RabbitMQSource.getBackOffSleepIncrement()J at org.apache.flume.source.PollableSourceRunner$PollingRunner.run(PollableSourceRunner.java:142) at java.lang.Thread.run(Thread.java:748)     Please someone help me to resolve this error.   # Configure the channel type = SPILLABLEMEMORY memoryCapacity = 10000 byteCapacity = 10000000 transactionCapacity = 10000 checkpointInterval = 300000 maxFileSize = 614643507 overflowCapacity = 1000000 minimumRequiredSpace = 324288000 write-timeout = 100 ... View more

Hi, I am getting below error when reading logs from rabbitmq server to HDFS path using flume       Exception in thread "PollableSourceRunner-RabbitMQSource-rabbitmq-source1" java.lang.AbstractMethodError: org.apache.flume.source.rabbitmq.RabbitMQSource.getBackOffSleepIncrement()J at org.apache.flume.source.PollableSourceRunner$PollingRunner.run(PollableSourceRunner.java:142) at java.lang.Thread.run(Thread.java:748) ... View more