Member since
09-19-2016
18
Posts
4
Kudos Received
1
Solution
My Accepted Solutions
Title | Views | Posted |
---|---|---|
1374 | 11-15-2016 01:59 PM |
11-15-2016
01:59 PM
This was already answered in stackoverflow.
For some reason I there were two different type of dash character in the command I wrote.
... View more
11-15-2016
01:12 PM
I need to run 24/7 a (java) spark application in my cluster, for this task Oozie seems to be a good option.
I wrote a workflow and a properties file, however when I try to run it I get the message configuration is not specified although I specify it and the path provided is a local path in the machine where this is being executed. So:
The file and path exists:
[oozie@hdpgw01 tst]$ ls /home/oozie/tst/job.properties
/home/oozie/tst/job.properties
Trying to submit without and with oozie server in the command:
[oozie@hdpgw01 tst]$ oozie job –config /home/oozie/tst/job.properties -submit
java.io.IOException: configuration is not specified
at org.apache.oozie.cli.OozieCLI.getConfiguration(OozieCLI.java:816)
at org.apache.oozie.cli.OozieCLI.jobCommand(OozieCLI.java:981)
at org.apache.oozie.cli.OozieCLI.processCommand(OozieCLI.java:686)
at org.apache.oozie.cli.OozieCLI.run(OozieCLI.java:639)
at org.apache.oozie.cli.OozieCLI.main(OozieCLI.java:225)
configuration is not specified
[oozie@hdpgw01 tst]$ oozie job -oozie hdpgw01:11000/oozie –config /home/oozie/tst/job.properties -submit
java.io.IOException: configuration is not specified
at org.apache.oozie.cli.OozieCLI.getConfiguration(OozieCLI.java:816)
at org.apache.oozie.cli.OozieCLI.jobCommand(OozieCLI.java:981)
at org.apache.oozie.cli.OozieCLI.processCommand(OozieCLI.java:686)
at org.apache.oozie.cli.OozieCLI.run(OozieCLI.java:639)
at org.apache.oozie.cli.OozieCLI.main(OozieCLI.java:225)
configuration is not specified
Trying to run without and with oozie server in the command:
[oozie@hdpgw01 tst]$ oozie job –config /home/oozie/tst/job.properties -run
java.io.IOException: configuration is not specified
at org.apache.oozie.cli.OozieCLI.getConfiguration(OozieCLI.java:816)
at org.apache.oozie.cli.OozieCLI.jobCommand(OozieCLI.java:1055)
at org.apache.oozie.cli.OozieCLI.processCommand(OozieCLI.java:686)
at org.apache.oozie.cli.OozieCLI.run(OozieCLI.java:639)
at org.apache.oozie.cli.OozieCLI.main(OozieCLI.java:225)
configuration is not specified
[oozie@hdpgw01 tst]$ oozie job -oozie hdpgw01:11000/oozie –config /home/oozie/tst/job.properties -run
java.io.IOException: configuration is not specified
at org.apache.oozie.cli.OozieCLI.getConfiguration(OozieCLI.java:816)
at org.apache.oozie.cli.OozieCLI.jobCommand(OozieCLI.java:1055)
at org.apache.oozie.cli.OozieCLI.processCommand(OozieCLI.java:686)
at org.apache.oozie.cli.OozieCLI.run(OozieCLI.java:639)
at org.apache.oozie.cli.OozieCLI.main(OozieCLI.java:225)
configuration is not specified
Even if I use some crazy path here I get the same result:
[oozie@hdpgw01 tst]$ oozie job -oozie hdpgw01:11000/oozie –config /home205723984u34oith3ot3/oozie/tst/job.properties -run
java.io.IOException: configuration is not specified
at org.apache.oozie.cli.OozieCLI.getConfiguration(OozieCLI.java:816)
at org.apache.oozie.cli.OozieCLI.jobCommand(OozieCLI.java:1055)
at org.apache.oozie.cli.OozieCLI.processCommand(OozieCLI.java:686)
at org.apache.oozie.cli.OozieCLI.run(OozieCLI.java:639)
at org.apache.oozie.cli.OozieCLI.main(OozieCLI.java:225)
configuration is not specified
Is Oozie the best tool for this task? I am missing up something?
... View more
Labels:
- Labels:
-
Apache Oozie
-
Apache Spark
09-21-2016
12:50 PM
Check if the FQDN of all your nodes can be resolved from the machines trying to connect.
Are you running this cluster in local virtual machines (VirtualBox, for example)? What network options have you set for them?
... View more
09-20-2016
12:26 PM
This solution worked for me. For some reason systemctl makes ROOT to be set as /etc, breaking the process. I am running Centos7 too, could someone else verify this? Have you reported this bug?
... View more