question Re: Falcon clusters with multiple users in Archives of Support Questions (Read Only)

Falcon clusters with multiple users

bleonhardi — Fri, 29 Jan 2016 01:13:37 GMT

I want to schedule falcon jobs with different service accounts. user1 with process1 and user2 with process2. But they should use the same cluster.

However this does not work because falcon creates a folder "process" under the staging directory with user1 and a subfolder process1. When I try to submit a process with user2 it fails because it cannot create the folder process2 under the same folder.

Is this actually the supposed behavior? Do I have to create one cluster each for every user who wants to submit falcon jobs pointing to different staging folders? That sounds pretty inconvenient

Re: Falcon clusters with multiple users

bleonhardi — Fri, 29 Jan 2016 01:47:16 GMT

I changed the staging/falcon folder to belong to a group of both users. And changed its access rights to 775, this seems to work until now.

Re: Falcon clusters with multiple users

sramesh — Fri, 29 Jan 2016 02:32:31 GMT

Benjamin Leonhardi: You need to provide correct permissions to staging and working directories. Please use falcon tutorial for reference.

Re: Falcon clusters with multiple users

bleonhardi — Fri, 29 Jan 2016 04:31:17 GMT

I did. The subfolder falcon creates however is created with the user I created the first process with. So a second user does not work anymore.

Re: Falcon clusters with multiple users

sramesh — Fri, 29 Jan 2016 05:30:01 GMT

Benjamin Leonhardi: Can you please provide the error you are getting? Also, can you attach all your entity definitions?

Also, please paste the output of below command. Thanks!

hadoop fs -ls -R /apps/falcon

Re: Falcon clusters with multiple users

sramesh — Fri, 29 Jan 2016 06:20:48 GMT

Benjamin Leonhardi: You may be hitting this issue FALCON-1647. What HDP version are you using? Thanks!

Re: Falcon clusters with multiple users

aervits — Tue, 02 Feb 2016 22:27:31 GMT

@Benjamin Leonhardi has this been resolved? I see three replies below and you didn't accept any.

Re: Falcon clusters with multiple users

bleonhardi — Tue, 02 Feb 2016 22:35:18 GMT

Most likely was this. Sorry for not accepting for so long but when I changed the <falconfolder>/staging/falcon folder manually it all worked and I forgot about it Thanks a lot.

https://issues.apache.org/jira/browse/FALCON-1647