question Hbase Copy table fails for 250 Million Records from a HDP 2.2 ==> HDP 2.4 cluster. Please assist. in Archives of Support Questions (Read Only)

Hbase Copy table fails for 250 Million Records from a HDP 2.2 ==> HDP 2.4 cluster. Please assist.

Srikaran — Tue, 07 Jun 2016 07:12:50 GMT

Error: org.apache.hadoop.hbase.client.ScannerTimeoutException: 70218ms passed since the last invocation, timeout is currently set to 60000 at org.apache.hadoop.hbase.client.ClientScanner.loadCache(ClientScanner.java:434) at org.apache.hadoop.hbase.client.ClientScanner.next(ClientScanner.java:364) at org.apache.hadoop.hbase.mapreduce.TableRecordReaderImpl.nextKeyValue(TableRecordReaderImpl.java:205) at org.apache.hadoop.hbase.mapreduce.TableRecordReader.nextKeyValue(TableRecordReader.java:147) at org.apache.hadoop.hbase.mapreduce.TableInputFormatBase$1.nextKeyValue(TableInputFormatBase.java:216) at org.apache.hadoop.mapred.MapTask$NewTrackingRecordReader.nextKeyValue(MapTask.java:556) at org.apache.hadoop.mapreduce.task.MapContextImpl.nextKeyValue(MapContextImpl.java:80) at org.apache.hadoop.mapreduce.lib.map.WrappedMapper$Context.nextKeyValue(WrappedMapper.java:91) at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:145) at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:787) at

Re: Hbase Copy table fails for 250 Million Records from a HDP 2.2 ==> HDP 2.4 cluster. Please assist.

tyu — Tue, 07 Jun 2016 07:15:40 GMT

Please increase the value for the following parameter:

<name>hbase.client.scanner.timeout.period</name> <value>60000</value>

Re: Hbase Copy table fails for 250 Million Records from a HDP 2.2 ==> HDP 2.4 cluster. Please assist.

tyu — Tue, 07 Jun 2016 07:16:13 GMT

Please also check region servers to see if there was critical error during the copy.

Re: Hbase Copy table fails for 250 Million Records from a HDP 2.2 ==> HDP 2.4 cluster. Please assist.

Srikaran — Tue, 07 Jun 2016 07:20:01 GMT

@Ted Yu Region servers are good.

Re: Hbase Copy table fails for 250 Million Records from a HDP 2.2 ==> HDP 2.4 cluster. Please assist.

Srikaran — Tue, 07 Jun 2016 07:21:01 GMT

@Ted Yu Error message shows 60 seconds as default. Do we need to bump it to 90 seconds? thats what you mean? I dont see this property currently set so I guess its taking from default. Please confirm.

Re: Hbase Copy table fails for 250 Million Records from a HDP 2.2 ==> HDP 2.4 cluster. Please assist.

tyu — Tue, 07 Jun 2016 07:30:23 GMT

Default was used.

Please bump it to 90 seconds or higher.

Re: Hbase Copy table fails for 250 Million Records from a HDP 2.2 ==> HDP 2.4 cluster. Please assist.

Srikaran — Tue, 07 Jun 2016 20:43:56 GMT

@Ted Yu Thanks it worked.