Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

WordCount failed by using Job Designer (using Quickstart VM)

Solved Go to solution

WordCount failed by using Job Designer (using Quickstart VM)

New Contributor

Hi,

 

I use Quickstart VM.   The Wordcount runs fine.   However, I got error when I use Job Desinger to run the same java and textfile.   Oozie is up and running with Ext JS installed properly.   My job doucment - https://dl.dropboxusercontent.com/u/1814045/Job.docx   The error log - https://dl.dropboxusercontent.com/u/1814045/hue-1383608375.87.log  Any help is appreciated.   Thanks.

 

Regards,

 

Marco

1 ACCEPTED SOLUTION

Accepted Solutions

Re: WordCount failed by using Job Designer (using Quickstart VM)

I see a space after the file name, could you trim it in the design?

 

/home/cloudera/lab/wc.jar '

 

[04/Nov/2013 15:38:14 +0000] middleware   INFO     Processing exception: [Errno 2] Copy src '/home/cloudera/lab/wc.jar ' does not exist: Traceback (most recent call last):
  File "/usr/share/hue/build/env/lib/python2.6/site-packages/Django-1.2.3-py2.6.egg/django/core/handlers/base.py", line 100, in get_response
    response = callback(request, *callback_args, **callback_kwargs)
  File "/usr/share/hue/apps/oozie/src/oozie/decorators.py", line 52, in decorate
    return view_func(request, *args, **kwargs)
  File "/usr/share/hue/apps/oozie/src/oozie/views/editor.py", line 310, in submit_workflow
    job_id = _submit_workflow(request.user, request.fs, workflow, mapping)
  File "/usr/share/hue/apps/oozie/src/oozie/views/editor.py", line 331, in _submit_workflow
    job_id = submission.run()
  File "/usr/share/hue/desktop/libs/liboozie/src/liboozie/submittion.py", line 72, in run
    deployment_dir = self.deploy()
  File "/usr/share/hue/desktop/libs/liboozie/src/liboozie/submittion.py", line 152, in deploy
    self._do_as(self.user.username , self._copy_files, deployment_dir, oozie_xml)
  File "/usr/share/hue/desktop/libs/liboozie/src/liboozie/submittion.py", line 252, in _do_as
    return fn(*args, **kwargs)
  File "/usr/share/hue/desktop/libs/liboozie/src/liboozie/submittion.py", line 246, in _copy_files
    self.fs.copyfile(file, self.fs.join(lib_path, self.fs.basename(file)))
  File "/usr/share/hue/desktop/libs/hadoop/src/hadoop/fs/webhdfs.py", line 486, in copyfile
    raise IOError(errno.ENOENT, _("Copy src '%s' does not exist") % src)
IOError: [Errno 2] Copy src '/home/cloudera/lab/wc.jar ' does not exist
3 REPLIES 3

Re: WordCount failed by using Job Designer (using Quickstart VM)

Expert Contributor

Hey there!

 

Are you sure '/home/cloudera/lab/wc.jar' exists? Also, are you sure your user has permission to access '/home/cloudera/lab/wc.jar'? Hue is having trouble copying that file.

 

-Abe

Re: WordCount failed by using Job Designer (using Quickstart VM)

I see a space after the file name, could you trim it in the design?

 

/home/cloudera/lab/wc.jar '

 

[04/Nov/2013 15:38:14 +0000] middleware   INFO     Processing exception: [Errno 2] Copy src '/home/cloudera/lab/wc.jar ' does not exist: Traceback (most recent call last):
  File "/usr/share/hue/build/env/lib/python2.6/site-packages/Django-1.2.3-py2.6.egg/django/core/handlers/base.py", line 100, in get_response
    response = callback(request, *callback_args, **callback_kwargs)
  File "/usr/share/hue/apps/oozie/src/oozie/decorators.py", line 52, in decorate
    return view_func(request, *args, **kwargs)
  File "/usr/share/hue/apps/oozie/src/oozie/views/editor.py", line 310, in submit_workflow
    job_id = _submit_workflow(request.user, request.fs, workflow, mapping)
  File "/usr/share/hue/apps/oozie/src/oozie/views/editor.py", line 331, in _submit_workflow
    job_id = submission.run()
  File "/usr/share/hue/desktop/libs/liboozie/src/liboozie/submittion.py", line 72, in run
    deployment_dir = self.deploy()
  File "/usr/share/hue/desktop/libs/liboozie/src/liboozie/submittion.py", line 152, in deploy
    self._do_as(self.user.username , self._copy_files, deployment_dir, oozie_xml)
  File "/usr/share/hue/desktop/libs/liboozie/src/liboozie/submittion.py", line 252, in _do_as
    return fn(*args, **kwargs)
  File "/usr/share/hue/desktop/libs/liboozie/src/liboozie/submittion.py", line 246, in _copy_files
    self.fs.copyfile(file, self.fs.join(lib_path, self.fs.basename(file)))
  File "/usr/share/hue/desktop/libs/hadoop/src/hadoop/fs/webhdfs.py", line 486, in copyfile
    raise IOError(errno.ENOENT, _("Copy src '%s' does not exist") % src)
IOError: [Errno 2] Copy src '/home/cloudera/lab/wc.jar ' does not exist
Highlighted

Re: WordCount failed by using Job Designer (using Quickstart VM)

New Contributor

Good catch!   Thanks

 

Regards,

 

Marco