Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

End of stream Exception with HBASE and YSCB

Highlighted

Re: End of stream Exception with HBASE and YSCB

Contributor

I don't see hadoop-hdfs-2.2.0-cdh5.0.0-beta-2.jar. Can you get this jar as well?

Highlighted

Re: End of stream Exception with HBASE and YSCB

Explorer
I just added it.
Same problem.

Do you think it could be a problem with the environment variables?
Highlighted

Re: End of stream Exception with HBASE and YSCB

Explorer

Ok. I think we are almos done.

 

I added these JAR's:

jackson-core-asl-1.9.4.jar
jackson-mapper-asl-1.9.4.jar

 

And is working.... but apparently the usertable I created is not correct.

 

bin/ycsb load hbase -P workloads/workloada -p columnfamily=f1 -p recordcount=1000000 -p threadcount=4 -s | tee -a workloada.dat
YCSB Client 0.1
Command line: -db com.yahoo.ycsb.db.HBaseClient -P workloads/workloada -p columnfamily=f1 -p recordcount=1000000 -p threadcount=4 -s -loadLoading workload...

Starting test.
0 sec: 0 operations;
14/02/12 21:05:32 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
14/02/12 21:05:32 INFO zookeeper.ZooKeeper: Client environment:zookeeper.version=3.4.5-cdh5.0.0-beta-2--1, built on 02/07/2014 18:28 GMT
14/02/12 21:05:32 INFO zookeeper.ZooKeeper: Client environment:host.name=ip-10-138-9-43.ec2.internal
14/02/12 21:05:32 INFO zookeeper.ZooKeeper: Client environment:java.version=1.7.0_25
14/02/12 21:05:32 INFO zookeeper.ZooKeeper: Client environment:java.vendor=Oracle Corporation
14/02/12 21:05:32 INFO zookeeper.ZooKeeper: Client environment:java.home=/usr/lib/jvm/java-7-oracle-cloudera/jre
14/02/12 21:05:32 INFO zookeeper.ZooKeeper: Client environment:java.class.path=/var/lib/hadoop-hdfs/ycsb-0.1.4/core/lib/core-0.1.4.jar:/var/lib/hadoop-hdfs/ycsb-0.1.4/hbase-binding/conf:/var/lib/hadoop-hdfs/ycsb-0.1.4/hbase-binding/lib/zookeeper-3.4.5-cdh5.0.0-beta-2.jar:/var/lib/hadoop-hdfs/ycsb-0.1.4/hbase-binding/lib/jackson-core-asl-1.9.4.jar:/var/lib/hadoop-hdfs/ycsb-0.1.4/hbase-binding/lib/hadoop-core-2.2.0-mr1-cdh5.0.0-beta-2.jar:/var/lib/hadoop-hdfs/ycsb-0.1.4/hbase-binding/lib/hbase-protocol-0.96.1.1-cdh5.0.0-beta-2.jar:/var/lib/hadoop-hdfs/ycsb-0.1.4/hbase-binding/lib/hadoop-annotations-2.2.0-cdh5.0.0-beta-2.jar:/var/lib/hadoop-hdfs/ycsb-0.1.4/hbase-binding/lib/hbase-client-0.96.1.1-cdh5.0.0-beta-2.jar:/var/lib/hadoop-hdfs/ycsb-0.1.4/hbase-binding/lib/hadoop-common-2.2.0-cdh5.0.0-beta-2.jar:/var/lib/hadoop-hdfs/ycsb-0.1.4/hbase-binding/lib/jackson-mapper-asl-1.9.4.jar:/var/lib/hadoop-hdfs/ycsb-0.1.4/hbase-binding/lib/hbase-common-0.96.1.1-cdh5.0.0-beta-2.jar:/var/lib/hadoop-hdfs/ycsb-0.1.4/hbase-binding/lib/hadoop-hdfs-2.2.0-cdh5.0.0-beta-2.jar:/var/lib/hadoop-hdfs/ycsb-0.1.4/hbase-binding/lib/hbase-binding-0.1.4.jar:/var/lib/hadoop-hdfs/ycsb-0.1.4/hbase-binding/lib/hadoop-auth-2.2.0-cdh5.0.0-beta-2.jar:/var/lib/hadoop-hdfs/ycsb-0.1.4/infinispan-binding/conf:/var/lib/hadoop-hdfs/ycsb-0.1.4/voldemort-binding/conf:/var/lib/hadoop-hdfs/ycsb-0.1.4/jdbc-binding/conf
14/02/12 21:05:32 INFO zookeeper.ZooKeeper: Client environment:java.library.path=/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib
14/02/12 21:05:32 INFO zookeeper.ZooKeeper: Client environment:java.io.tmpdir=/tmp
14/02/12 21:05:32 INFO zookeeper.ZooKeeper: Client environment:java.compiler=<NA>
14/02/12 21:05:32 INFO zookeeper.ZooKeeper: Client environment:os.name=Linux
14/02/12 21:05:32 INFO zookeeper.ZooKeeper: Client environment:os.arch=amd64
14/02/12 21:05:32 INFO zookeeper.ZooKeeper: Client environment:os.version=3.2.0-54-virtual
14/02/12 21:05:32 INFO zookeeper.ZooKeeper: Client environment:user.name=hdfs
14/02/12 21:05:32 INFO zookeeper.ZooKeeper: Client environment:user.home=/var/lib/hadoop-hdfs
14/02/12 21:05:32 INFO zookeeper.ZooKeeper: Client environment:user.dir=/var/lib/hadoop-hdfs/ycsb-0.1.4
14/02/12 21:05:32 INFO zookeeper.ZooKeeper: Initiating client connection, connectString=ip-10-138-9-43.ec2.internal:2181 sessionTimeout=60000 watcher=hconnection-0x7bfc07a7, quorum=ip-10-138-9-43.ec2.internal:2181, baseZNode=/hbase
14/02/12 21:05:32 INFO zookeeper.RecoverableZooKeeper: Process identifier=hconnection-0x7bfc07a7 connecting to ZooKeeper ensemble=ip-10-138-9-43.ec2.internal:2181
14/02/12 21:05:32 INFO zookeeper.ClientCnxn: Opening socket connection to server ip-10-138-9-43.ec2.internal/10.138.9.43:2181. Will not attempt to authenticate using SASL (unknown error)
14/02/12 21:05:32 INFO zookeeper.ClientCnxn: Socket connection established to ip-10-138-9-43.ec2.internal/10.138.9.43:2181, initiating session
14/02/12 21:05:32 INFO zookeeper.ClientCnxn: Session establishment complete on server ip-10-138-9-43.ec2.internal/10.138.9.43:2181, sessionid = 0x144241f0b1c66ab, negotiated timeout = 60000
14/02/12 21:05:39 WARN client.AsyncProcess: #3, table=usertable, attempt=1/35 failed 4840 ops, last exception: org.apache.hadoop.hbase.regionserver.NoSuchColumnFamilyException: org.apache.hadoop.hbase.regionserver.NoSuchColumnFamilyException: Column family f1 does not exist in region usertable,,1392239027776.9d39b2f6b64bf8ef9c16bd52c196eba3. in table 'usertable', {NAME => 'family', DATA_BLOCK_ENCODING => 'NONE', BLOOMFILTER => 'ROW', REPLICATION_SCOPE => '0', COMPRESSION => 'NONE', VERSIONS => '1', TTL => '2147483647', MIN_VERSIONS => '0', KEEP_DELETED_CELLS => 'false', BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'}
at org.apache.hadoop.hbase.regionserver.HRegionServer.doBatchOp(HRegionServer.java:4054)
at org.apache.hadoop.hbase.regionserver.HRegionServer.doNonAtomicRegionMutation(HRegionServer.java:3359)
at org.apache.hadoop.hbase.regionserver.HRegionServer.multi(HRegionServer.java:3263)
at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:26935)
at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2175)
at org.apache.hadoop.hbase.ipc.RpcServer$Handler.run(RpcServer.java:1879)
on ip-10-151-91-61.ec2.internal,60020,1392175489222, tracking started Wed Feb 12 21:05:34 UTC 2014 - FAILED, NOT RETRYING ANYMORE
14/02/12 21:05:39 WARN client.AsyncProcess: #5, table=usertable, attempt=1/35 failed 4840 ops, last exception: org.apache.hadoop.hbase.regionserver.NoSuchColumnFamilyException: org.apache.hadoop.hbase.regionserver.NoSuchColumnFamilyException: Column family f1 does not exist in region usertable,,1392239027776.9d39b2f6b64bf8ef9c16bd52c196eba3. in table 'usertable', {NAME => 'family', DATA_BLOCK_ENCODING => 'NONE', BLOOMFILTER => 'ROW', REPLICATION_SCOPE => '0', COMPRESSION => 'NONE', VERSIONS => '1', TTL => '2147483647', MIN_VERSIONS => '0', KEEP_DELETED_CELLS => 'false', BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'}
at org.apache.hadoop.hbase.regionserver.HRegionServer.doBatchOp(HRegionServer.java:4054)
at org.apache.hadoop.hbase.regionserver.HRegionServer.doNonAtomicRegionMutation(HRegionServer.java:3359)
at org.apache.hadoop.hbase.regionserver.HRegionServer.multi(HRegionServer.java:3263)
at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:26935)
at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2175)
at org.apache.hadoop.hbase.ipc.RpcServer$Handler.run(RpcServer.java:1879)
on ip-10-151-91-61.ec2.internal,60020,1392175489222, tracking started Wed Feb 12 21:05:34 UTC 2014 - FAILED, NOT RETRYING ANYMORE
14/02/12 21:05:41 WARN client.AsyncProcess: #2, table=usertable, attempt=1/35 failed 4840 ops, last exception: org.apache.hadoop.hbase.regionserver.NoSuchColumnFamilyException: org.apache.hadoop.hbase.regionserver.NoSuchColumnFamilyException: Column family f1 does not exist in region usertable,,1392239027776.9d39b2f6b64bf8ef9c16bd52c196eba3. in table 'usertable', {NAME => 'family', DATA_BLOCK_ENCODING => 'NONE', BLOOMFILTER => 'ROW', REPLICATION_SCOPE => '0', COMPRESSION => 'NONE', VERSIONS => '1', TTL => '2147483647', MIN_VERSIONS => '0', KEEP_DELETED_CELLS => 'false', BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'}
at org.apache.hadoop.hbase.regionserver.HRegionServer.doBatchOp(HRegionServer.java:4054)
at org.apache.hadoop.hbase.regionserver.HRegionServer.doNonAtomicRegionMutation(HRegionServer.java:3359)
at org.apache.hadoop.hbase.regionserver.HRegionServer.multi(HRegionServer.java:3263)
at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:26935)
at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2175)
at org.apache.hadoop.hbase.ipc.RpcServer$Handler.run(RpcServer.java:1879)
on ip-10-151-91-61.ec2.internal,60020,1392175489222, tracking started Wed Feb 12 21:05:34 UTC 2014 - FAILED, NOT RETRYING ANYMORE
10 sec: 38716 operations; 3871.21 current ops/sec; [INSERT AverageLatency(us)=315.06]
14/02/12 21:05:41 WARN client.AsyncProcess: #4, table=usertable, attempt=1/35 failed 4840 ops, last exception: org.apache.hadoop.hbase.regionserver.NoSuchColumnFamilyException: org.apache.hadoop.hbase.regionserver.NoSuchColumnFamilyException: Column family f1 does not exist in region usertable,,1392239027776.9d39b2f6b64bf8ef9c16bd52c196eba3. in table 'usertable', {NAME => 'family', DATA_BLOCK_ENCODING => 'NONE', BLOOMFILTER => 'ROW', REPLICATION_SCOPE => '0', COMPRESSION => 'NONE', VERSIONS => '1', TTL => '2147483647', MIN_VERSIONS => '0', KEEP_DELETED_CELLS => 'false', BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'}

Highlighted

Re: End of stream Exception with HBASE and YSCB

Explorer
I figured it out.

Now it's working.
Thanks.

Re: End of stream Exception with HBASE and YSCB

Contributor

Cool, it's great to know it works for you now.

Don't have an account?
Coming from Hortonworks? Activate your account here