- Subscribe to RSS Feed
- Mark Question as New
- Mark Question as Read
- Float this Question for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page
I have been working on scheduling HBase compaction using oozie. I ran into this error message
- Labels:
-
Apache Oozie
Created 05-30-2016 09:00 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
I have been working on scheduling HBase compaction using oozie. I ran into this error message and i have changed permissions, used a different users and also specified in the <exec> and <file> parameters the script but it keeps failing with error message "Cannot run program "minorcompaction.sh" (in directory "/hadoop/yarn/local/usercache/yarn/appcache/application_1464245207716_0007/container_e28_1464245207716_0007_01_000002"): error=2, No such file or directory" but i have not been able to get past this issue. Any help?
Created 08-01-2016 07:14 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Changing from Oracle 12c to MySQL resolved this issue.
Created 05-30-2016 09:30 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
It would sound to me that you didnt use the file tag correctly. Did you upload the file to hdfs? However I am dubious if this will work in any case since the script will have a lot of dependencies. You might have to install the hbase client on all nodes or upload a lot of extra libraries.
Alternatively you could use an ssh action to connect to a full working edge node and run your commands there. I would almost propose this for something non mission critical like scheduling compactions.
Created 06-01-2016 01:50 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
@BenjaminLeonhardi Please find attached my workflow and script below it. I've also checked for special characters but that doesn't seem to be the issue.
Created 06-01-2016 03:40 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Weird I do the same thing and it should work. Works for me. You sure its not just a stupid mistake like missing / or that the access rights are not correct? Can you try with hardcoded path?
<exec>myscript.sh</exec>
...
<file>${nameNode}/myfolder/myscript.sh#myscript.sh</file>
Created 06-02-2016 05:33 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hi @BenjaminLeonhardi, I am getting another error message. What can be wrong with the permissions? Cannot run program "minorcompaction.sh" (in directory "/hadoop/yarn/local/usercache/hdfs/appcache/application_1462434761155_14999/container_e12_1462434761155_14999_01_000002"): error=13, Permission denied.
Created 06-02-2016 06:08 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
I've also tried the hardcoded path, not working still. I am trying on two platforms and getting different errors.
Created 08-01-2016 07:14 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Changing from Oracle 12c to MySQL resolved this issue.