Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Spark streaming is not writing auto HBase

Solved Go to solution
Highlighted

Spark streaming is not writing auto HBase

Contributor

Dear Colleages,

 

i want to stream kafka messages into HBase using spark streaming. i set up an java job and run it with "spak-submit ...  yarb client". It seems to be thatkafka messages were consumed but no output is written. No error messages but the following:

 

INFO storage.BlockManagerInfo: Added input-0-1467044417600 in memory on quickstart.cloudera:46453 (size: 99.0 B, free: 530.3 MB)
16/06/27 09:20:18 INFO scheduler.JobScheduler: Added jobs for time 1467044418000 ms

 

Do you have any suggestions on this topic?

 

Many thanks in advance,

 Butkiz

 

1 ACCEPTED SOLUTION

Accepted Solutions

Re: Spark streaming is not writing auto HBase

Contributor
I've solved this by adding more cpu cores local[*] and or run the job on cluster (with enough cpu core)
1 REPLY 1

Re: Spark streaming is not writing auto HBase

Contributor
I've solved this by adding more cpu cores local[*] and or run the job on cluster (with enough cpu core)
Don't have an account?
Coming from Hortonworks? Activate your account here