Support Questions
Find answers, ask questions, and share your expertise
Announcements
Check out our newest addition to the community, the Cloudera Innovation Accelerator group hub.

when I load data from mysql to hbase using sqoop with cron scheduler region server going down and my resource manager utilization very high showing critical warning

Explorer

Give some solution

2 REPLIES 2

Super Mentor

@Arul kumar

Can you please share the logs from your Region Server when it got killed/stopped suddenly so that we can track the events to understand what happened?

Also please check the "/var/log/messages" file, matching the timestamp when your Region Server got killed/stopped.

When you start running your sqoop job that time did you notice the following outputs?
# free -m
# top

.

To verify if your OS was having enough resources when you started the sqoop job?

This is important because sometimes due to resource unavailability the OS kills some resources.

.

Example: (just example)

The "/proc/sys/vm/overcommit_memory" settings on the OS can allow OS to kill the applications that are consuming much memory. See: http://engineering.pivotal.io/post/Virtual_memory_settings_in_Linux_-_The_problem_with_Overcommit/

.

Explorer