question Re: I have been working on scheduling HBase compaction using oozie. I ran into this error message in Archives of Support Questions (Read Only)

I have been working on scheduling HBase compaction using oozie. I ran into this error message

joshua_adeleke — Mon, 30 May 2016 16:00:15 GMT

I have been working on scheduling HBase compaction using oozie. I ran into this error message and i have changed permissions, used a different users and also specified in the <exec> and <file> parameters the script but it keeps failing with error message "Cannot run program "minorcompaction.sh" (in directory "/hadoop/yarn/local/usercache/yarn/appcache/application_1464245207716_0007/container_e28_1464245207716_0007_01_000002"): error=2, No such file or directory" but i have not been able to get past this issue. Any help?

Re: I have been working on scheduling HBase compaction using oozie. I ran into this error message

bleonhardi — Mon, 30 May 2016 16:30:41 GMT

It would sound to me that you didnt use the file tag correctly. Did you upload the file to hdfs? However I am dubious if this will work in any case since the script will have a lot of dependencies. You might have to install the hbase client on all nodes or upload a lot of extra libraries.

Alternatively you could use an ssh action to connect to a full working edge node and run your commands there. I would almost propose this for something non mission critical like scheduling compactions.

Re: I have been working on scheduling HBase compaction using oozie. I ran into this error message

joshua_adeleke — Wed, 01 Jun 2016 20:50:35 GMT

@BenjaminLeonhardi Please find attached my workflow and script below it. I've also checked for special characters but that doesn't seem to be the issue.

Re: I have been working on scheduling HBase compaction using oozie. I ran into this error message

bleonhardi — Wed, 01 Jun 2016 22:40:23 GMT

Weird I do the same thing and it should work. Works for me. You sure its not just a stupid mistake like missing / or that the access rights are not correct? Can you try with hardcoded path?

<exec>myscript.sh</exec>

...

<file>${nameNode}/myfolder/myscript.sh#myscript.sh</file>

Re: I have been working on scheduling HBase compaction using oozie. I ran into this error message

joshua_adeleke — Thu, 02 Jun 2016 12:33:26 GMT

Hi @BenjaminLeonhardi, I am getting another error message. What can be wrong with the permissions? Cannot run program "minorcompaction.sh" (in directory "/hadoop/yarn/local/usercache/hdfs/appcache/application_1462434761155_14999/container_e12_1462434761155_14999_01_000002"): error=13, Permission denied.

Re: I have been working on scheduling HBase compaction using oozie. I ran into this error message

joshua_adeleke — Thu, 02 Jun 2016 13:08:39 GMT

I've also tried the hardcoded path, not working still. I am trying on two platforms and getting different errors.

Re: I have been working on scheduling HBase compaction using oozie. I ran into this error message

joshua_adeleke — Mon, 01 Aug 2016 14:14:52 GMT

Changing from Oracle 12c to MySQL resolved this issue.