Reply
Highlighted
Champion
Posts: 543
Registered: ‎05-16-2016

Re: error while ingestion of data using flume from nasa

[ Edited ]

 

 You had configured memory channel . it is always recommend to you file channel when you have enough disk space because , file channel can crash and come back pickup the job from where  it has left more of like checkpoint process.

 

" The memory channel which simply stores the events in an in-memory queue, which is faster but any events still left in the memory channel when an agent process dies can’t be recovered "

 

 

#channels
julyLog.channels.chnl1.type=memory
julyLog.channels.chnl1.capacity=10000
julyLog.channels.chnl1.transactionCapacity=1000


You may want change capacity and transcationCapacity parameter 
accordingly to your ingest.
julyLog.channels.chnl1.capacity= 
julyLog.channels.chnl1.transactionCapacity= 

 

 

Announcements