Archives of Support Questions (Read Only)

This is an archived board for historical reference. Information and links may no longer be available or relevant
Announcements
This board is archived and read-only for historical reference. To ask a new question, please post a new topic on the appropriate active board.

Spark streaming is not writing auto HBase

avatar
Contributor

Dear Colleages,

 

i want to stream kafka messages into HBase using spark streaming. i set up an java job and run it with "spak-submit ...  yarb client". It seems to be thatkafka messages were consumed but no output is written. No error messages but the following:

 

INFO storage.BlockManagerInfo: Added input-0-1467044417600 in memory on quickstart.cloudera:46453 (size: 99.0 B, free: 530.3 MB)
16/06/27 09:20:18 INFO scheduler.JobScheduler: Added jobs for time 1467044418000 ms

 

Do you have any suggestions on this topic?

 

Many thanks in advance,

 Butkiz

 

1 ACCEPTED SOLUTION

avatar
Contributor
I've solved this by adding more cpu cores local[*] and or run the job on cluster (with enough cpu core)

View solution in original post

1 REPLY 1

avatar
Contributor
I've solved this by adding more cpu cores local[*] and or run the job on cluster (with enough cpu core)