question Re: Sqoop SQL to Hbase - slow after upgrade in Support Questions

question Re: Sqoop SQL to Hbase - slow after upgrade in Support Questions https://community.cloudera.com/t5/Support-Questions/Sqoop-SQL-to-Hbase-slow-after-upgrade/m-p/309855#M223943 I should have responded with a bit more detail... but I couldn't figure out how to edit my initial response.  So here's a bit more info. Interesting about turning off hbase audits.  Never tried that. 1. Sqoop for MSQL -> Hadoop is still really fast.  So I'm not suspecting hdfs configuration issues.2. I did some testing with hbase pe but unfortunately I didn't get performance numbers before the upgrade.  So impossible to compare.3. hdfs logs look clean4. hbase logs look generally clean.  Sometimes get RPC reponseTooSlow WARNings but doesn't happen often5. Have run major compaction on the hbase table in question.  The table has a number of regions spread across about 10 hbase region servers (no hot spotting)6. I see minor compactions happening on the table while the sqoop is running. Since this only happened after the upgrade I was looking for changes in default values for the Cloudera Hbase configuration.  And changes in defaults from hbase 1.2.0 to hbase 2.1.2.  Tried adjusting a few values but nothing worked.  So I set them back.  I have read moving from hbase 1.2.x to hbase 2.1.x writes may be a bit slower.  But I'm talking like 100x slower for my sqoop.  So I'm pretty much sure that's not it. Another thing I noticed when I started examining the cluster more closely (I'm a developer but have been thrown into the sysadmin role for the upgrade) is that the network wasn't configured correctly.  The nodes in the clusters are supposed to know about each other (ie. the /etc/hosts file on each node should have entries for all other nodes in the cluster) and not rely on DNS to resolve other cluster hosts.  This isn't the case and the /etc/hosts only has the localhost entries.  But once again, it was this way before the upgrade.  So something to fix but probably not the cause of the hbase performance issue after the upgrade. Richard Sun, 17 Jan 2021 12:02:35 GMT Rjkoop 2021-01-17T12:02:35Z