Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here. Want to know more about what has changed? Check out the Community News blog.

why block size is different when I use sqoop

Highlighted

why block size is different when I use sqoop

New Contributor

When I import data using sqoop, the block size is 256MB. But, when I import data not using sqoop, the block size is 128MB. The setting "dfs.blocksize" is of course 128MB. I wonder why it is only 256MB when I use sqoop. I wonder if this is a configuration problem in sqoop or hdfs configuration problem.

sqoop import
  --connect jdbc:oracle:thin:@$127.0.0.1:1521:SRDB \
  --username abc \
  --password  \
  --targetdir \
  --query \
  --fields-terminated-by \
  --num-mappers \
  --split-by
1 REPLY 1

Re: why block size is different when I use sqoop

New Contributor

Here are the issues I am facing.

First image is when i used sqoop. Second one is when i did not use sqoop.

103490-2.png

103491-1.png