Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Storm word count Topology fails

Solved Go to solution

Storm word count Topology fails

Contributor

I am trying to run a word count topology to test storm. But getting following error in supervisor.log

2017-06-27 08:29:55 b.s.config [INFO] SET worker-user 6f0c4ad9-a6c2-4c4c-9e48-4f9da485bd2a xbblwv5 
2017-06-27 08:29:55 b.s.d.supervisor [INFO] Running as user:storm command:("/usr/hdp/2.2.6.0-2800/storm/bin/worker-launcher" “storm” "worker" "/disk/hadoop/storm/workers/6f0c4ad9-a6c2-4c4c-9e48-4f9da485bd2a" "/disk/hadoop/storm/workers/6f0c4ad9-a6c2-4c4c-9e48-4f9da485bd2a/storm-worker-script.sh") 
2017-06-27 08:29:55 b.s.util [WARN] Worker Process 6f0c4ad9-a6c2-4c4c-9e48-4f9da485bd2a:Invalid permissions on worker-launcher binary. 
2017-06-27 08:29:55 b.s.util [WARN] Worker Process 6f0c4ad9-a6c2-4c4c-9e48-4f9da485bd2a:The configured nodemanager group 501 is different from the group of the executable 0 
2017-06-27 08:29:55 b.s.d.supervisor [INFO] 6f0c4ad9-a6c2-4c4c-9e48-4f9da485bd2a still hasn't started 
2017-06-27 08:29:55 b.s.d.supervisor [INFO] Worker Process 6f0c4ad9-a6c2-4c4c-9e48-4f9da485bd2a exited with code: 22 
2017-06-27 08:29:55 b.s.d.supervisor [INFO] 6f0c4ad9-a6c2-4c4c-9e48-4f9da485bd2a still hasn't started 
2017-06-27 08:29:56 b.s.d.supervisor [INFO] 6f0c4ad9-a6c2-4c4c-9e48-4f9da485bd2a still hasn't started 
2017-06-27 08:29:56 b.s.d.supervisor [INFO] 6f0c4ad9-a6c2-4c4c-9e48-4f9da485bd2a still hasn't started 
2017-06-27 08:29:57 b.s.d.supervisor [INFO] 6f0c4ad9-a6c2-4c4c-9e48-4f9da485bd2a still hasn't started 
2017-06-27 08:29:57 b.s.d.supervisor [INFO] 6f0c4ad9-a6c2-4c4c-9e48-4f9da485bd2a still hasn't started 
2017-06-27 08:29:58 b.s.d.supervisor [INFO] 6f0c4ad9-a6c2-4c4c-9e48-4f9da485bd2a still hasn't started 
2017-06-27 08:29:58 b.s.d.supervisor [INFO] 6f0c4ad9-a6c2-4c4c-9e48-4f9da485bd2a still hasn't started 
1 ACCEPTED SOLUTION

Accepted Solutions

Re: Storm word count Topology fails

Contributor

The error message points that the permissions on worker-launcher binary are not correct. Please check that the permissions on worker-launcher binary. It should be owned by root:hadoop or the group parameter configured in worker-launcher.cfg.

From the log message it appears that the group ownership is root.

Also note that the permissions on the binary should be 6550 else it would fail again after you change the group ownership. Here is the output of the ownership from my test system.

# stat /usr/hdp/2.5.0.0-1133/storm/bin/worker-launcher
  File: `/usr/hdp/2.5.0.0-1133/storm/bin/worker-launcher'
  Size: 56848     	Blocks: 112        IO Block: 4096   regular file
Device: fc01h/64513d	Inode: 1444319     Links: 1
Access: (6550/-r-sr-s---)  Uid: (    0/    root)   Gid: (  501/  hadoop)
Access: 2016-08-03 13:25:37.000000000 +0000
Modify: 2016-08-03 13:25:37.000000000 +0000
Change: 2016-11-19 13:23:02.764000118 +0000
2 REPLIES 2

Re: Storm word count Topology fails

Contributor

The error message points that the permissions on worker-launcher binary are not correct. Please check that the permissions on worker-launcher binary. It should be owned by root:hadoop or the group parameter configured in worker-launcher.cfg.

From the log message it appears that the group ownership is root.

Also note that the permissions on the binary should be 6550 else it would fail again after you change the group ownership. Here is the output of the ownership from my test system.

# stat /usr/hdp/2.5.0.0-1133/storm/bin/worker-launcher
  File: `/usr/hdp/2.5.0.0-1133/storm/bin/worker-launcher'
  Size: 56848     	Blocks: 112        IO Block: 4096   regular file
Device: fc01h/64513d	Inode: 1444319     Links: 1
Access: (6550/-r-sr-s---)  Uid: (    0/    root)   Gid: (  501/  hadoop)
Access: 2016-08-03 13:25:37.000000000 +0000
Modify: 2016-08-03 13:25:37.000000000 +0000
Change: 2016-11-19 13:23:02.764000118 +0000
Highlighted

Re: Storm word count Topology fails

Contributor
Don't have an account?
Coming from Hortonworks? Activate your account here