Support Questions

Find answers, ask questions, and share your expertise

Spark streaming is not writing auto HBase

avatar
Contributor

Dear Colleages,

 

i want to stream kafka messages into HBase using spark streaming. i set up an java job and run it with "spak-submit ...  yarb client". It seems to be thatkafka messages were consumed but no output is written. No error messages but the following:

 

INFO storage.BlockManagerInfo: Added input-0-1467044417600 in memory on quickstart.cloudera:46453 (size: 99.0 B, free: 530.3 MB)
16/06/27 09:20:18 INFO scheduler.JobScheduler: Added jobs for time 1467044418000 ms

 

Do you have any suggestions on this topic?

 

Many thanks in advance,

 Butkiz

 

1 ACCEPTED SOLUTION

avatar
Contributor
I've solved this by adding more cpu cores local[*] and or run the job on cluster (with enough cpu core)

View solution in original post

1 REPLY 1

avatar
Contributor
I've solved this by adding more cpu cores local[*] and or run the job on cluster (with enough cpu core)