Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

Spark streaming is not writing auto HBase

avatar
Contributor

Dear Colleages,

 

i want to stream kafka messages into HBase using spark streaming. i set up an java job and run it with "spak-submit ...  yarb client". It seems to be thatkafka messages were consumed but no output is written. No error messages but the following:

 

INFO storage.BlockManagerInfo: Added input-0-1467044417600 in memory on quickstart.cloudera:46453 (size: 99.0 B, free: 530.3 MB)
16/06/27 09:20:18 INFO scheduler.JobScheduler: Added jobs for time 1467044418000 ms

 

Do you have any suggestions on this topic?

 

Many thanks in advance,

 Butkiz

 

1 ACCEPTED SOLUTION

avatar
Contributor
I've solved this by adding more cpu cores local[*] and or run the job on cluster (with enough cpu core)

View solution in original post

1 REPLY 1

avatar
Contributor
I've solved this by adding more cpu cores local[*] and or run the job on cluster (with enough cpu core)