Member since
12-08-2016
7
Posts
0
Kudos Received
0
Solutions
01-06-2017
10:02 PM
Ok , Thank you @Laurent Edel
how to configure my workflow.xml workflow.xml file or the procedure to successfully
execute an Oozie job with with mapreduce script written in Python
... View more
01-06-2017
07:32 PM
I think i am facing a configuration issue . here is the workflow.xml file I am using in attempt to run/submit the the Oozie job with mapreduce scripts.
I am using command : $ oozie mapreduce -oozie http://localhost:11000/oozie -config job.properties according to : http://oozie.apache.org/docs/4.1.0/DG_CommandLineTool.html#Oozie_Command_Line_Usage
"the parameters must be in the Java Properties file (.properties). This file must be specified for a map-reduce job.
The properties file must specify the mapred.mapper.class
, mapred.reducer.class
, mapred.input.dir
, mapred.output.dir
,
=oozie.libpath=, mapred.job.tracker
, and fs.default.name
properties." The map-reduce job will be created and submitted. All jar files and
all other files needed by the mapreduce job need to be uploaded onto
HDFS under libpath beforehand. The workflow.xml will be created in Oozie
server internally. Users can get the workflow.xml from console or
command line(-definition). However i am getting this error mapreduce-oozie-error.png I am not sure how to configure my workflow.xml file or the procedure to successfully execute an Oozie job with with mapreduce script written in Python.
@Artem Ervits
... View more
Labels:
- Labels:
-
Apache Hadoop
-
Apache Oozie
01-05-2017
06:53 PM
@Artem Ervits ohh thank you so much .. How do you determine where the output of the job should be store/ how can you see the output to be sure it was what you're looking for
... View more
01-04-2017
04:39 PM
Thank you for your prompt reply. But I have a very basic question. Python should be install in the Sandbox? apps-directory.png Currently my python scripts are placed in /root/examples/apps/map-reduce/
But I am guessing there should be a python folder in root/examples/apps/Python?
which contains the job.properties and workflow.xml files in addition to the lib folder
would be great if you could guide in which directory should I place the python script files
... View more
01-03-2017
05:56 PM
workflow.xml
Attached is my current xml file in the sandbox.
I am new to Hadoop/Oozie so any detail explanation/instruction would be very helpful
... View more
Labels:
- Labels:
-
Apache Hadoop
-
Apache Oozie
12-08-2016
09:46 PM
Labels:
- Labels:
-
Apache Hadoop
-
Apache Oozie
12-08-2016
09:34 PM
Labels:
- Labels:
-
Apache Hadoop
-
Apache Oozie