Member since
05-09-2017
5
Posts
1
Kudos Received
2
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
1605 | 08-29-2018 02:22 AM | |
40980 | 08-28-2018 01:20 AM |
08-29-2018
02:22 AM
@Alex
Ruiz
a jira is filed for this issue https://issues.apache.org/jira/browse/NIFI-1321
... View more
08-28-2018
01:20 AM
1 Kudo
@Navin Agarwala I faced a similar issue while running the flume command from the command line in HDP 2.6. /usr/hdp/current/flume-server/bin/flume-ng agent --name agent --conf /usr/hdp/current/flume-server/conf/agent --conf-file /usr/hdp/current/flume-server/conf/agent/flume.conf I resloved this issue by copying the log4j2.xml file in the location: /usr/hdp/current/flume-server/conf/agent
... View more
06-30-2017
02:25 PM
@Shashank Chandhok Thanks. I was copying the files. Moving them helped.
... View more
06-30-2017
01:34 PM
While testing Flume spooldir source, I am getting this error in flume logs. 28 Jun 2017 15:06:44,560 ERROR [pool-7-thread-1] (org.apache.flume.source.SpoolDirectorySource$SpoolDirectoryRunnable.run:280) - FATAL:
Spool Directory source spooldir-source: { spoolDir: /data/src/input }: Uncaught exception in SpoolDirectorySource thread.
Restart or reconfigure Flume to continue processing.
java.lang.IllegalStateException: File has changed size since being read: /home/userapp/test/newfile_5_1.csv.gz
at org.apache.flume.client.avro.ReliableSpoolingFileEventReader.retireCurrentFile(ReliableSpoolingFileEventReader.java:410)
at org.apache.flume.client.avro.ReliableSpoolingFileEventReader.readEvents(ReliableSpoolingFileEventReader.java:326)
at org.apache.flume.source.SpoolDirectorySource$SpoolDirectoryRunnable.run(SpoolDirectorySource.java:250)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:304)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:178)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Any pointers?
... View more
Labels:
- Labels:
-
Apache Flume