Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

pcap_query gets OOME

Highlighted

pcap_query gets OOME

Contributor

Hi,

I'm trying to run pcap_query for only 1.5 hours I constantly getting OOME when it's about to write to a pcap file as the result. I tried to modify the memory setting for mapreduce but nothing does the trick so far.

mapred.child.java.opts="-Xmx4096"

I also tried to reduce a smaller window of exporting but I get no results.

screen-shot-2018-02-15-at-24025-pm.png

I attached the stack trace below. Any suggestion is appreciated.

1 REPLY 1
Highlighted

Re: pcap_query gets OOME

Contributor

I found a work around for this issue by breaking it down to 30min per run, into 3 runs and it works fine. I was also trying to increase the number of reducer. It looks like the default number of mapper to be 15 and reducer to be 10. I tried to overwrite the mapreduce.job.reduces to a higher number but it doesn't take it. I hope it's not hardcoded.

Don't have an account?
Coming from Hortonworks? Activate your account here