Cloudera Community
contactvivekjai
user rank
Contributor

Re: Intermittent Timeout Error When Querying HBase

by Contributor in Support Questions
‎10-29-2018 08:35 AM
‎10-29-2018 08:35 AM
Hello, @John O'Hara is this problem resolved ? Even I'm having the issue I have rpc timeout set as 90000 but I get the error as 60000. ... View more

Re: getting timeout exception while reading from H...

by Contributor in Support Questions
‎10-28-2018 04:11 PM
‎10-28-2018 04:11 PM
Hi @Shu, I wanted to do that as the last option as it will impact everyone else's work which is not nice. Isn't there a way to override those properties at all ? ... View more

getting timeout exception while reading from HBase...

by Contributor in Support Questions
‎10-26-2018 01:47 PM
‎10-26-2018 01:47 PM
While reading from hbase I'm getting error as below Caused by: java.io.IOException: Call to .local/:60020 failed on local exception: org.apache.hadoop.hbase.ipc.CallTimeoutException: Call id=15, waitTime=59998, operationTimeout=59997 expired. at org.apache.hadoop.hbase.ipc.RpcClientImpl.wrapException(RpcClientImpl.java:1263) at org.apache.hadoop.hbase.ipc.RpcClientImpl.call(RpcClientImpl.java:1231) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.callBlockingMethod(AbstractRpcClient.java:218) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$BlockingRpcChannelImplementation.callBlockingMethod(AbstractRpcClient.java:292) at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$BlockingStub.scan(ClientProtos.java:32831) at org.apache.hadoop.hbase.client.ScannerCallable.call(ScannerCallable.java:219) at org.apache.hadoop.hbase.client.ScannerCallable.call(ScannerCallable.java:63) at org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithoutRetries(RpcRetryingCaller.java:211) at org.apache.hadoop.hbase.client.ScannerCallableWithReplicas$RetryingRPC.call(ScannerCallableWithReplicas.java:396) at org.apache.hadoop.hbase.client.ScannerCallableWithReplicas$RetryingRPC.call(ScannerCallableWithReplicas.java:370) at org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithRetries(RpcRetryingCaller.java:136) ... 4 more Caused by: org.apache.hadoop.hbase.ipc.CallTimeoutException: Call id=15, waitTime=59998, operationTimeout=59997 expired. at org.apache.hadoop.hbase.ipc.Call.checkAndSetTimeout(Call.java:70) at org.apache.hadoop.hbase.ipc.RpcClientImpl.call(RpcClientImpl.java:1205) However I'm using below configuration in code to avoid timestamp, somehow these properties are not being overridden : <code>hbaseConf.set("hbase.rpc.timeout", "1800000") hbaseConf.set("hbase.client.scanner.timeout.period", "1800000") Wondering if I'm missing something. Can anyone please help ? ... View more
Labels:

Re: Spark HBase Connector + Composite Rowkey & SQL...

by Contributor in Community Articles
‎10-18-2018 04:21 PM
‎10-18-2018 04:21 PM
Hi @wsalazar , Thanks for the nice explanation. I was wondering how you do it with composite keys ? We have spent sometime exploring phoenix encoder. Using this, data insertion is good but while reading and doing the range scan it somehow is very slow. Seems only the first part of the composite key is used for filter and rest of the key is not taken into account. ... View more

Re: I am getting a Launcher Error while executing ...

by Contributor in Support Questions
‎07-18-2018 11:02 PM
‎07-18-2018 11:02 PM
well I too have exactly same error. I have checked permissions on my script and it has execute permissions. @Vijay Kumar J is it possible for you to elaborate how it was resolved ? ... View more

Re: Spark job reeturns empty rows from HBase

by Contributor in Support Questions
‎07-03-2018 10:13 PM
‎07-03-2018 10:13 PM
@Felix Albani just found that if I mention table as "table":{"name":"namespace:tablename"} in catalog then it works. Thanks for your time. ... View more

Re: Spark job reeturns empty rows from HBase

by Contributor in Support Questions
‎07-03-2018 09:51 PM
‎07-03-2018 09:51 PM
@Felix Albani know what, I tried for a table with default namespace. I'm able to view data. Seems its working for tables without namespace. ... View more

Re: Spark job reeturns empty rows from HBase

by Contributor in Support Questions
‎07-03-2018 09:22 PM
‎07-03-2018 09:22 PM
@Felix Albani I too really wanted to try this but these libraries are not deployed in cluster instead I create a dependencies jar and then I use it spark-submit. ... View more

Re: Spark job reeturns empty rows from HBase

by Contributor in Support Questions
‎07-03-2018 09:03 PM
‎07-03-2018 09:03 PM
Hi @Felix Albani I have checked these things already. ... View more

Re: Spark job reeturns empty rows from HBase

by Contributor in Support Questions
‎07-03-2018 07:15 PM
‎07-03-2018 07:15 PM
Hi @Felix Albani thanks for your response. Please accept my sincere apologies I somehow missed to include that part of the code. I have updated now. This is the output I see(Please note that I have changed the number of columns in above code, hence the difference). +----+----+----+----+----+----+----+----+----+ |col4|col7|col1|col3|col6|col0|col8|col2|col5| +----+----+----+----+----+----+----+----+----+ +----+----+----+----+----+----+----+----+----+ 18/07/03 16:16:27 INFO CodeGenerator: Code generated in 10.60842 ms 18/07/03 16:16:27 INFO CodeGenerator: Code generated in 8.990531 ms +----+ |col0| +----+ +----+ ... View more
Contact Me
Online
Offline
Last Visited
‎03-12-2019 01:33 PM
Community Statistics
Member Since ‎03-31-2018 10:12 PM
Last Visited ‎03-12-2019 01:33 PM
Posts 27
Kudos received 2