Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

End of stream Exception with HBASE and YSCB

Re: End of stream Exception with HBASE and YSCB

Contributor

I don't see hadoop-hdfs-2.2.0-cdh5.0.0-beta-2.jar. Can you get this jar as well?

Re: End of stream Exception with HBASE and YSCB

New Contributor
I just added it.
Same problem.

Do you think it could be a problem with the environment variables?

Re: End of stream Exception with HBASE and YSCB

New Contributor

Ok. I think we are almos done.

 

I added these JAR's:

jackson-core-asl-1.9.4.jar
jackson-mapper-asl-1.9.4.jar

 

And is working.... but apparently the usertable I created is not correct.

 

bin/ycsb load hbase -P workloads/workloada -p columnfamily=f1 -p recordcount=1000000 -p threadcount=4 -s | tee -a workloada.dat
YCSB Client 0.1
Command line: -db com.yahoo.ycsb.db.HBaseClient -P workloads/workloada -p columnfamily=f1 -p recordcount=1000000 -p threadcount=4 -s -loadLoading workload...

Starting test.
0 sec: 0 operations;
14/02/12 21:05:32 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
14/02/12 21:05:32 INFO zookeeper.ZooKeeper: Client environment:zookeeper.version=3.4.5-cdh5.0.0-beta-2--1, built on 02/07/2014 18:28 GMT
14/02/12 21:05:32 INFO zookeeper.ZooKeeper: Client environment:host.name=ip-10-138-9-43.ec2.internal
14/02/12 21:05:32 INFO zookeeper.ZooKeeper: Client environment:java.version=1.7.0_25
14/02/12 21:05:32 INFO zookeeper.ZooKeeper: Client environment:java.vendor=Oracle Corporation
14/02/12 21:05:32 INFO zookeeper.ZooKeeper: Client environment:java.home=/usr/lib/jvm/java-7-oracle-cloudera/jre
14/02/12 21:05:32 INFO zookeeper.ZooKeeper: Client environment:java.class.path=/var/lib/hadoop-hdfs/ycsb-0.1.4/core/lib/core-0.1.4.jar:/var/lib/hadoop-hdfs/ycsb-0.1.4/hbase-binding/conf:/var/lib/hadoop-hdfs/ycsb-0.1.4/hbase-binding/lib/zookeeper-3.4.5-cdh5.0.0-beta-2.jar:/var/lib/hadoop-hdfs/ycsb-0.1.4/hbase-binding/lib/jackson-core-asl-1.9.4.jar:/var/lib/hadoop-hdfs/ycsb-0.1.4/hbase-binding/lib/hadoop-core-2.2.0-mr1-cdh5.0.0-beta-2.jar:/var/lib/hadoop-hdfs/ycsb-0.1.4/hbase-binding/lib/hbase-protocol-0.96.1.1-cdh5.0.0-beta-2.jar:/var/lib/hadoop-hdfs/ycsb-0.1.4/hbase-binding/lib/hadoop-annotations-2.2.0-cdh5.0.0-beta-2.jar:/var/lib/hadoop-hdfs/ycsb-0.1.4/hbase-binding/lib/hbase-client-0.96.1.1-cdh5.0.0-beta-2.jar:/var/lib/hadoop-hdfs/ycsb-0.1.4/hbase-binding/lib/hadoop-common-2.2.0-cdh5.0.0-beta-2.jar:/var/lib/hadoop-hdfs/ycsb-0.1.4/hbase-binding/lib/jackson-mapper-asl-1.9.4.jar:/var/lib/hadoop-hdfs/ycsb-0.1.4/hbase-binding/lib/hbase-common-0.96.1.1-cdh5.0.0-beta-2.jar:/var/lib/hadoop-hdfs/ycsb-0.1.4/hbase-binding/lib/hadoop-hdfs-2.2.0-cdh5.0.0-beta-2.jar:/var/lib/hadoop-hdfs/ycsb-0.1.4/hbase-binding/lib/hbase-binding-0.1.4.jar:/var/lib/hadoop-hdfs/ycsb-0.1.4/hbase-binding/lib/hadoop-auth-2.2.0-cdh5.0.0-beta-2.jar:/var/lib/hadoop-hdfs/ycsb-0.1.4/infinispan-binding/conf:/var/lib/hadoop-hdfs/ycsb-0.1.4/voldemort-binding/conf:/var/lib/hadoop-hdfs/ycsb-0.1.4/jdbc-binding/conf
14/02/12 21:05:32 INFO zookeeper.ZooKeeper: Client environment:java.library.path=/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib
14/02/12 21:05:32 INFO zookeeper.ZooKeeper: Client environment:java.io.tmpdir=/tmp
14/02/12 21:05:32 INFO zookeeper.ZooKeeper: Client environment:java.compiler=<NA>
14/02/12 21:05:32 INFO zookeeper.ZooKeeper: Client environment:os.name=Linux
14/02/12 21:05:32 INFO zookeeper.ZooKeeper: Client environment:os.arch=amd64
14/02/12 21:05:32 INFO zookeeper.ZooKeeper: Client environment:os.version=3.2.0-54-virtual
14/02/12 21:05:32 INFO zookeeper.ZooKeeper: Client environment:user.name=hdfs
14/02/12 21:05:32 INFO zookeeper.ZooKeeper: Client environment:user.home=/var/lib/hadoop-hdfs
14/02/12 21:05:32 INFO zookeeper.ZooKeeper: Client environment:user.dir=/var/lib/hadoop-hdfs/ycsb-0.1.4
14/02/12 21:05:32 INFO zookeeper.ZooKeeper: Initiating client connection, connectString=ip-10-138-9-43.ec2.internal:2181 sessionTimeout=60000 watcher=hconnection-0x7bfc07a7, quorum=ip-10-138-9-43.ec2.internal:2181, baseZNode=/hbase
14/02/12 21:05:32 INFO zookeeper.RecoverableZooKeeper: Process identifier=hconnection-0x7bfc07a7 connecting to ZooKeeper ensemble=ip-10-138-9-43.ec2.internal:2181
14/02/12 21:05:32 INFO zookeeper.ClientCnxn: Opening socket connection to server ip-10-138-9-43.ec2.internal/10.138.9.43:2181. Will not attempt to authenticate using SASL (unknown error)
14/02/12 21:05:32 INFO zookeeper.ClientCnxn: Socket connection established to ip-10-138-9-43.ec2.internal/10.138.9.43:2181, initiating session
14/02/12 21:05:32 INFO zookeeper.ClientCnxn: Session establishment complete on server ip-10-138-9-43.ec2.internal/10.138.9.43:2181, sessionid = 0x144241f0b1c66ab, negotiated timeout = 60000
14/02/12 21:05:39 WARN client.AsyncProcess: #3, table=usertable, attempt=1/35 failed 4840 ops, last exception: org.apache.hadoop.hbase.regionserver.NoSuchColumnFamilyException: org.apache.hadoop.hbase.regionserver.NoSuchColumnFamilyException: Column family f1 does not exist in region usertable,,1392239027776.9d39b2f6b64bf8ef9c16bd52c196eba3. in table 'usertable', {NAME => 'family', DATA_BLOCK_ENCODING => 'NONE', BLOOMFILTER => 'ROW', REPLICATION_SCOPE => '0', COMPRESSION => 'NONE', VERSIONS => '1', TTL => '2147483647', MIN_VERSIONS => '0', KEEP_DELETED_CELLS => 'false', BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'}
at org.apache.hadoop.hbase.regionserver.HRegionServer.doBatchOp(HRegionServer.java:4054)
at org.apache.hadoop.hbase.regionserver.HRegionServer.doNonAtomicRegionMutation(HRegionServer.java:3359)
at org.apache.hadoop.hbase.regionserver.HRegionServer.multi(HRegionServer.java:3263)
at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:26935)
at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2175)
at org.apache.hadoop.hbase.ipc.RpcServer$Handler.run(RpcServer.java:1879)
on ip-10-151-91-61.ec2.internal,60020,1392175489222, tracking started Wed Feb 12 21:05:34 UTC 2014 - FAILED, NOT RETRYING ANYMORE
14/02/12 21:05:39 WARN client.AsyncProcess: #5, table=usertable, attempt=1/35 failed 4840 ops, last exception: org.apache.hadoop.hbase.regionserver.NoSuchColumnFamilyException: org.apache.hadoop.hbase.regionserver.NoSuchColumnFamilyException: Column family f1 does not exist in region usertable,,1392239027776.9d39b2f6b64bf8ef9c16bd52c196eba3. in table 'usertable', {NAME => 'family', DATA_BLOCK_ENCODING => 'NONE', BLOOMFILTER => 'ROW', REPLICATION_SCOPE => '0', COMPRESSION => 'NONE', VERSIONS => '1', TTL => '2147483647', MIN_VERSIONS => '0', KEEP_DELETED_CELLS => 'false', BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'}
at org.apache.hadoop.hbase.regionserver.HRegionServer.doBatchOp(HRegionServer.java:4054)
at org.apache.hadoop.hbase.regionserver.HRegionServer.doNonAtomicRegionMutation(HRegionServer.java:3359)
at org.apache.hadoop.hbase.regionserver.HRegionServer.multi(HRegionServer.java:3263)
at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:26935)
at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2175)
at org.apache.hadoop.hbase.ipc.RpcServer$Handler.run(RpcServer.java:1879)
on ip-10-151-91-61.ec2.internal,60020,1392175489222, tracking started Wed Feb 12 21:05:34 UTC 2014 - FAILED, NOT RETRYING ANYMORE
14/02/12 21:05:41 WARN client.AsyncProcess: #2, table=usertable, attempt=1/35 failed 4840 ops, last exception: org.apache.hadoop.hbase.regionserver.NoSuchColumnFamilyException: org.apache.hadoop.hbase.regionserver.NoSuchColumnFamilyException: Column family f1 does not exist in region usertable,,1392239027776.9d39b2f6b64bf8ef9c16bd52c196eba3. in table 'usertable', {NAME => 'family', DATA_BLOCK_ENCODING => 'NONE', BLOOMFILTER => 'ROW', REPLICATION_SCOPE => '0', COMPRESSION => 'NONE', VERSIONS => '1', TTL => '2147483647', MIN_VERSIONS => '0', KEEP_DELETED_CELLS => 'false', BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'}
at org.apache.hadoop.hbase.regionserver.HRegionServer.doBatchOp(HRegionServer.java:4054)
at org.apache.hadoop.hbase.regionserver.HRegionServer.doNonAtomicRegionMutation(HRegionServer.java:3359)
at org.apache.hadoop.hbase.regionserver.HRegionServer.multi(HRegionServer.java:3263)
at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:26935)
at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2175)
at org.apache.hadoop.hbase.ipc.RpcServer$Handler.run(RpcServer.java:1879)
on ip-10-151-91-61.ec2.internal,60020,1392175489222, tracking started Wed Feb 12 21:05:34 UTC 2014 - FAILED, NOT RETRYING ANYMORE
10 sec: 38716 operations; 3871.21 current ops/sec; [INSERT AverageLatency(us)=315.06]
14/02/12 21:05:41 WARN client.AsyncProcess: #4, table=usertable, attempt=1/35 failed 4840 ops, last exception: org.apache.hadoop.hbase.regionserver.NoSuchColumnFamilyException: org.apache.hadoop.hbase.regionserver.NoSuchColumnFamilyException: Column family f1 does not exist in region usertable,,1392239027776.9d39b2f6b64bf8ef9c16bd52c196eba3. in table 'usertable', {NAME => 'family', DATA_BLOCK_ENCODING => 'NONE', BLOOMFILTER => 'ROW', REPLICATION_SCOPE => '0', COMPRESSION => 'NONE', VERSIONS => '1', TTL => '2147483647', MIN_VERSIONS => '0', KEEP_DELETED_CELLS => 'false', BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'}

Re: End of stream Exception with HBASE and YSCB

New Contributor
I figured it out.

Now it's working.
Thanks.
Highlighted

Re: End of stream Exception with HBASE and YSCB

Contributor

Cool, it's great to know it works for you now.