Member since
07-10-2019
3
Posts
0
Kudos Received
0
Solutions
08-24-2020
01:06 AM
Hi, Can I use Cloudera Data Science workbench with a MatLab model? I find this topic https://www.mathworks.com/matlabcentral/answers/305729-how-do-i-create-a-deployed-matlab-applications-to-run-against-cloudera-spark that explain to connect MatLab directly to to Spark but nothing with Cloudera Data Science workbench. Anyone has experiences with this integration?
... View more
Labels:
04-29-2020
07:16 AM
EDIT. After adding parameters as Cloudera guidelines suggest: hbase.regionserver.maxlogs=32 hbase.regionserver.logroll.multiplier= 0.95 hbase.regionserver.hlog.blocksize=134217728 Now the new WALs files are in the WALs directory. It's OK than the WALs dirs growing? When the files will delete? |LogRotationDir|WARN |org.apache.hadoop.hbase.regionserver.LogRoller|regionserver/slave01-int:16020.logRoller|Failed to schedule flush of 648987d093a56650ccf6763c479505bf, region=null, requester=null Any advice to aim this issue? THANKS
... View more
04-29-2020
03:37 AM
Good morning, I have a problem with the maximum number of WALs. In the log file it is written: org.apache.hadoop.hbase.regionserver.wal.AbstractFSWAL | regionserver / slave01-int: 16020.logRoller | Too many WALs; count = 534, max = 102; forcing flush of 26 regions (s) Looking for this parameter in HBASE settings, it is not declared. Following this guide -> https://community.cloudera.com/t5/Community-Articles/Tuning-Hbase-for-optimized-performance-Part-3/ta-p/248159 specifically: Flush Queue / Compaction queue - specifies to set as follows: hbase.regionserver.maxlogs (default value is 32, double or triple up this number if you know you have a heavy write load). After setting the value hbase.regionserver.maxlogs = 500. and having restarted HBASE, the WALs files moved under the OLDWALs directory, and then within a few minutes they disappeared. We want to understand if those WALs moved to OLDWALs were processed correctly and what is the correct parameter to set (is it calculated in some way?) In hbase.regionserver.maxlogs. What does the number after hbase.regionserver.maxlogs mean? Thanks
... View more
Labels:
- Labels:
-
Apache HBase