Member since
03-23-2017
41
Posts
5
Kudos Received
3
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
1213 | 01-19-2018 08:05 AM | |
5963 | 12-01-2017 06:46 PM | |
5619 | 04-19-2017 06:32 AM |
04-25-2018
12:12 PM
if you set TTL to 20(seconds) then that may be the reason.
... View more
03-12-2018
05:51 AM
hey @Juan Castrilli let the community know how did you proceed 🙂
... View more
01-22-2018
10:40 AM
you can check queue size from regionserver UI (host-address:16030/rs-status) under Queues tab. Queue size increases when there are too many requests and your RS cannot handle it. This can happen in case of too many requests (CPU crunch) ongoing compation ongoing GC You should investigate and identify the cause. and accordingly you can have more cpu, schedule compactions during off-peak hours, optimize GC. Hope it helps!
... View more
01-22-2018
10:36 AM
check hbase gc logs. if there is a GC pause that correlates with these log lines then you got your problem. While master/RS is in GC, it fails to send heatbeat to zookeeper and the zookeeper node expires. In that case you can increase zookeeper timeout and increase ticktime in zookeeper config. this is not directly related but do checkout: https://superuser.blog/hbase-dead-regionserver/
... View more
01-19-2018
08:05 AM
1 Kudo
no it will not. during compaction, temporary files are created which will be compacted. later when it's done the smaller files are removed and huge compacted files will come it it's place. So at no time client requests are blocked. response time might increase because of cpu overhead of compaction process.
... View more
12-07-2017
06:43 PM
good that the data is there. here's the next things you can do: 1. check table size on src cluster and snapshot size on dest cluster [hadoop dfs -du-h /apps/hbase/data/<table> or something like that] 2. compare files in snapshots that are getting listed and one which is not. What happens during copying snapshot is first data gets copied into some temp dir on dest cluster and then it gets moved to actual folder. If you see some files missing [metadata file. with .snapshot extension probably], try to search for them in other places .tmp folder as far as I remember, if you happen to find them, move it to table snapshot folder. I don't exactly remember all the dir names and locations so you will have to explore around a bit
... View more
12-07-2017
01:41 PM
can you confirm the owner of copied directory in destination cluster? if it is different, you may want to change it. Also check the copied data on destination cluster. the data size, the metadata file (snapshot files) and if data is present or not. sometime it is there but in different folder, probably some tmp or hidden folder, move it if that is the case
... View more
12-07-2017
05:30 AM
in that case you would want to further increase cache timeout or break your query into multiple queries and use temporary tables.
... View more
12-05-2017
05:46 AM
good to know you solved the original problem. not sure what the warning means though. Maybe someone from community can help
... View more