Member since
12-24-2015
22
Posts
3
Kudos Received
1
Solution
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 154 | 02-12-2016 05:36 AM |
06-09-2016
07:46 AM
I think there is something missing which has been not covered properly in the example....My job is finishing successfully & not showing error on Oozie Web UI...but no changes are occuring in HDFS ..I checked my Oozie logs which are showing error messages as follows : 2016-06-09 07:29:58,168 INFO BundleSubmitXCommand:520 - SERVER[ip-172-31-3-226.ec2.internal] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[-] ACTION[-] configDefault Doesn't exist hdfs://52.91.246.198:80
2016-06-09 07:29:58,218 WARN BundleStartXCommand:523 - SERVER[ip-172-31-3-226.ec2.internal] USER[ambari-qa] GROUP[-] TOKEN[] APP[FALCON_FEED_rawEmailFeed] JOB[0000026-160609052025426-oozie-oozi-B] ACTION[-] E1100: Command precondition does not hold before execution, [Bundle 0000026-160609052025426-oozie-oozi-B is not in PREP status. It is in : RUNNING], Error Code: E1100
2016-06-09 07:29:58,230 INFO CoordSubmitXCommand:520 - SERVER[ip-172-31-3-226.ec2.internal] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[0000026-160609052025426-oozie-oozi-B] ACTION[] configDefault Doesn't exist hdfs://52.91.246.198:8020/apps/falcon/primaryCluster/staging/falcon/workflows/feed/rawEmailFeed/b31810f3199e7b861dce158ca674de17_1465457397722/RETENTION/coord-config-default.xml
2016-06-09 07:30:02,690 WARN JobResourceUploader:64 - SERVER[ip-172-31-3-226.ec2.internal] Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this.
2016-06-09 07:30:03,226 WARN MRApps:610 - SERVER[ip-172-31-3-226.ec2.internal] cache file (mapreduce.job.cache.files) hdfs://ip-172-31-3-226.ec2.internal:8020/user/oozie/share/lib/lib_20160609051953/hcatalog/aws-java-sdk-1.7.4.jar conflicts with cache file (mapreduce.job.cache.files) hdfs://ip-172-31-3-226.ec2.internal:8020/user/oozie/share/lib/lib_20160609051953/oozie/aws-java-sdk-1.7.4.jar This will be an error in Hadoop 2.0
2016-06-09 07:30:03,226 WARN MRApps:610 - SERVER[ip-172-31-3-226.ec2.internal] cache file (mapreduce.job.cache.files) hdfs://ip-172-31-3-226.ec2.internal:8020/user/oozie/share/lib/lib_20160609051953/hcatalog/azure-storage-2.2.0.jar conflicts with cache file (mapreduce.job.cache.files) hdfs://ip-172-31-3-226.ec2.internal:8020/user/oozie/share/lib/lib_20160609051953/oozie/azure-storage-2.2.0.jar This will be an error in Hadoop 2.0
2016-06-09 07:30:03,227 WARN MRApps:610 - SERVER[ip-172-31-3-226.ec2.internal] cache file (mapreduce.job.cache.files) hdfs://ip-172-31-3-226.ec2.internal:8020/user/oozie/share/lib/lib_20160609051953/hcatalog/commons-lang3-3.3.2.jar conflicts with cache file (mapreduce.job.cache.files) hdfs://ip-172-31-3-226.ec2.internal:8020/user/oozie/share/lib/lib_20160609051953/oozie/commons-lang3-3.3.2.jar This will be an error in Hadoop 2.0
2016-06-09 07:30:03,227 WARN MRApps:610 - SERVER[ip-172-31-3-226.ec2.internal] cache file (mapreduce.job.cache.files) hdfs://ip-172-31-3-226.ec2.internal:8020/user/oozie/share/lib/lib_20160609051953/hcatalog/guava-11.0.2.jar conflicts with cache file (mapreduce.job.cache.files) hdfs://ip-172-31-3-226.ec2.internal:8020/user/oozie/share/lib/lib_20160609051953/oozie/guava-11.0.2.jar This will be an error in Hadoop 2.0
2016-06-09 07:30:03,227 WARN MRApps:610 - SERVER[ip-172-31-3-226.ec2.internal] cache file (mapreduce.job.cache.files) hdfs://ip-172-31-3-226.ec2.internal:8020/user/oozie/share/lib/lib_20160609051953/hcatalog/hadoop-aws-2.7.1.2.3.4.7-4.jar conflicts with cache file (mapreduce.job.cache.files) hdfs://ip-172-31-3-226.ec2.internal:8020/user/oozie/share/lib/lib_20160609051953/oozie/hadoop-aws-2.7.1.2.3.4.7-4.jar This will be an error in Hadoop 2.0
2016-06-09 07:30:03,228 WARN MRApps:610 - SERVER[ip-172-31-3-226.ec2.internal] cache file (mapreduce.job.cache.files) hdfs://ip-172-31-3-226.ec2.internal:8020/user/oozie/share/lib/lib_20160609051953/hcatalog/hadoop-azure-2.7.1.2.3.4.7-4.jar conflicts with cache file (mapreduce.job.cache.files) hdfs://ip-172-31-3-226.ec2.internal:8020/user/oozie/share/lib/lib_20160609051953/oozie/hadoop-azure-2.7.1.2.3.4.7-4.jar This will be an error in Hadoop 2.0
2016-06-09 07:30:03,228 WARN MRApps:610 - SERVER[ip-172-31-3-226.ec2.internal] cache file (mapreduce.job.cache.files) hdfs://ip-172-31-3-226.ec2.internal:8020/user/oozie/share/lib/lib_20160609051953/hcatalog/jackson-annotations-2.2.3.jar conflicts with cache file (mapreduce.job.cache.files) hdfs://ip-172-31-3-226.ec2.internal:8020/user/oozie/share/lib/lib_20160609051953/oozie/jackson-annotations-2.2.3.jar This will be an error in Hadoop 2.0
2016-06-09 07:30:03,229 WARN MRApps:610 - SERVER[ip-172-31-3-226.ec2.internal] cache file (mapreduce.job.cache.files) hdfs://ip-172-31-3-226.ec2.internal:8020/user/oozie/share/lib/lib_20160609051953/hcatalog/jackson-core-2.2.3.jar conflicts with cache file (mapreduce.job.cache.files) hdfs://ip-172-31-3-226.ec2.internal:8020/user/oozie/share/lib/lib_20160609051953/oozie/jackson-core-2.2.3.jar This will be an error in Hadoop 2.0
2016-06-09 07:30:03,229 WARN MRApps:610 - SERVER[ip-172-31-3-226.ec2.internal] cache file (mapreduce.job.cache.files) hdfs://ip-172-31-3-226.ec2.internal:8020/user/oozie/share/lib/lib_20160609051953/hcatalog/jackson-databind-2.2.3.jar conflicts with cache file (mapreduce.job.cache.files) hdfs://ip-172-31-3-226.ec2.internal:8020/user/oozie/share/lib/lib_20160609051953/oozie/jackson-databind-2.2.3.jar This will be an error in Hadoop 2.0
2016-06-09 07:30:03,230 WARN MRApps:610 - SERVER[ip-172-31-3-226.ec2.internal] cache file (mapreduce.job.cache.files) hdfs://ip-172-31-3-226.ec2.internal:8020/user/oozie/share/lib/lib_20160609051953/hcatalog/joda-time-2.1.jar conflicts with cache file (mapreduce.job.cache.files) hdfs://ip-172-31-3-226.ec2.internal:8020/user/oozie/share/lib/lib_20160609051953/oozie/joda-time-2.1.jar This will be an error in Hadoop 2.0
Can you please help me out how can I run this example??
... View more
06-09-2016
07:34 AM
@Balu : I changed the "stats" & "meta" location in Feed as you mentioned....that error got resolved & eviction got succeeded..thanks for the answer
... View more
06-08-2016
02:42 PM
Whats the solution to this problem ??
... View more
06-08-2016
12:07 PM
Hello, Please help me in solving the following error....I am trying to hands on for this example : Define and process Data Pipeline in Falcon ...when I schedule the process & when I check into logs of oozie,it shows following exception : Caused by: org.apache.falcon.FalconException: Couldn't evict feed from fileSystem
at org.apache.falcon.entity.FileSystemStorage.evict(FileSystemStorage.java:306)
at org.apache.falcon.retention.FeedEvictor.run(FeedEvictor.java:76)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76)
at org.apache.falcon.retention.FeedEvictor.main(FeedEvictor.java:52)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at org.apache.oozie.action.hadoop.JavaMain.run(JavaMain.java:56)
... 15 more
Caused by: java.io.IOException: Unable to resolve pattern for feedPath: /
at org.apache.falcon.entity.FeedHelper.getFeedBasePath(FeedHelper.java:442)
at org.apache.falcon.entity.FileSystemStorage.fileSystemEvictor(FileSystemStorage.java:331)
at org.apache.falcon.entity.FileSystemStorage.evict(FileSystemStorage.java:300)
... 23 more
... View more
Labels:
06-08-2016
12:02 PM
What is the answer to this problem ??
... View more
02-22-2016
07:57 AM
2 Kudos
Hello I am trying to do this example Hadoop Data Pipeline ...here I am running a Flume agent where Flume copies files from local to HDFS & Falcon does the job of processing data files & after data is processed,Hive processing lineage will be available in Apache Atlas...but the Oozie job is failing as I see on Oozie Web UI...I went through the logs of Oozie & Falcon & in the logs of Oozie,I don`t see the main reason for the Error but I am seeing this 2 errors : Oozie Error Code: E1100 & ERROR, reason: Main class [org.apache.oozie.action.hadoop.ShellMain], exit code [1] ..I can't get any solution to solve this problem....what can be the root cause of this error ?? Thank You
... View more
02-12-2016
05:36 AM
1 Kudo
you did right by setting the permission to 777 for /apps/data-mirroring/workflows/* but apart from that when you create the MirrorTest, a directory in the name of MirrorTest gets created at this location where the workflow of MirrorTest i.e.workflow.xml gets generated at location /apps/falcon/backupCluster/staging/falcon/workflows/process/MirrorTest .Same applies for primaryCluster also.. Now make sure that the path from staging/falcon/workflows/process/MirrorTest should be set as 777/755 so that the workflow.xml has permissions 777 & ownership=ambari-qa
... View more
02-12-2016
05:35 AM
you did right by setting the permission to 777 for /apps/data-mirroring/workflows/* but apart from that when you create the MirrorTest, a directory in the name of MirrorTest gets created at this location where the workflow of MirrorTest i.e.workflow.xml gets generated at location /apps/falcon/backupCluster/staging/falcon/workflows/process/MirrorTest .Same applies for primaryCluster also.. Now make sure that the path from staging/falcon/workflows/process/MirrorTest should be set as 777/755 so that the workflow.xml has permissions 777 & ownership=ambari-qa
... View more
02-04-2016
04:50 AM
Yes, this has been resolved...thanks for the help....The solution which you said that the permissions to run workflow should be 777 or 755 that does work....also apart from that the permissions & ownership to the path /apps/data-mirroring/ should be 777/755 or & its ownership should be granted to falcon....there is another location where workflow.xml gets defined i.e. at location /apps/falcon/backupCluster/staging/falcon/workflows/process/MirrorTest ,so its permissions should be either 777 or 755
... View more
02-02-2016
11:42 AM
@bsaini @Artem Ervits : After making changes in core-site.xml Whenever I follow the steps,I see this exception occurs:Unauthorized connection for super-user: oozie from IP X.X.X.X & when I change its ownership to any other user then org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.security.AccessControlException): Permission denied. user=ambari-qa is not the owner of inode=MirrorTest occurs..After that if I change its ownership to "ambari-qa",then I again get Unauthorized connection for super-user: oozie from IP X.X.X.X.. Is there anything or a location I am missing some where wrong ?
... View more
02-01-2016
02:43 PM
@bsaini : I am trying out this tutorial mirroring-datasets-between-hadoop-clusters-with-apache-falcon You said that the path workflow.xml should have at least 755.I made these changes at 2 locations 1) /apps/data-mirroring/*.xml 2) /apps/falcon/backupCluster/staging/falcon/workflows/process/MirrorTest/cf29a6898f4d78c4515a7d0b22f51b6e_1454333601227/DEFAULT/ Now when I am running the Mirror Test, I am getting the following exception : Caused by: org.apache.hadoop.security.AccessControlException: Permission denied. user=ambari-qa is not the owner of inode=MirrorTest .What is going wrong ??
... View more
01-18-2016
07:16 AM
@Artem Ervits:As you said I went through the logs in /var/log/storm...In application-name -worker log file I found these following logs : Is these what I really get when I run WordCount Program ?? 2016-01-15 14:58:33.691 b.s.d.task [INFO] Emitting: word-counter default [storm, {storm=1}]
2016-01-15 14:58:33.692 b.s.d.executor [INFO] BOLT ack TASK: 3 TIME: TUPLE: source: word-reader:4, stream: default, id: {-8348710384844471183=3588653195059424065}, [storm]
2016-01-15 14:58:33.692 b.s.d.task [INFO] Emitting: word-counter __ack_ack [-8348710384844471183 6135008062829212202]
2016-01-15 14:58:33.692 b.s.d.executor [INFO] Execute done TUPLE source: word-reader:4, stream: default, id: {-8348710384844471183=3588653195059424065}, [storm] TASK: 3 DELTA:
2016-01-15 14:58:33.692 b.s.d.executor [INFO] Processing received message FOR 3 TUPLE: source: word-reader:4, stream: default, id: {3873495111721387323=-1361110683980171437}, [test]
2016-01-15 14:58:33.693 b.s.d.task [INFO] Emitting: word-normalizer default [test]
2016-01-15 14:58:33.693 b.s.d.executor [INFO] TRANSFERING tuple TASK: 2 TUPLE: source: word-normalizer:3, stream: default, id: {3873495111721387323=-8327152215513187828}, [test]
2016-01-15 14:58:33.693 b.s.d.task [INFO] Emitting: word-normalizer __ack_ack [3873495111721387323 7020089438728736095]
2016-01-15 14:58:33.693 b.s.d.executor [INFO] TRANSFERING tuple TASK: 1 TUPLE: source: word-normalizer:3, stream: __ack_ack, id: {}, [3873495111721387323 7020089438728736095]
2016-01-15 14:58:33.694 b.s.d.executor [INFO] BOLT ack TASK: 3 TIME: 2 TUPLE: source: word-reader:4, stream: default, id: {3873495111721387323=-1361110683980171437}, [test]
2016-01-15 14:58:33.695 b.s.d.executor [INFO] TRANSFERING tuple TASK: 3 TUPLE: source: word-reader:4, stream: default, id: {3019472566015270743=-3346388363094288106}, [an]
2016-01-15 14:58:33.695 b.s.d.executor [INFO] TRANSFERING tuple TASK: 1 TUPLE: source: word-counter:2, stream: __ack_ack, id: {}, [-8348710384844471183 6135008062829212202]
2016-01-15 14:58:33.695 b.s.d.task [INFO] Emitting: word-reader __ack_init [3019472566015270743 -3346388363094288106 4]
2016-01-15 14:58:33.695 b.s.d.executor [INFO] BOLT ack TASK: 2 TIME: TUPLE: source: word-normalizer:3, stream: default, id: {-8348710384844471183=6135008062829212202}, [storm]
2016-01-15 14:58:33.695 b.s.d.executor [INFO] Execute done TUPLE source: word-reader:4, stream: default, id: {3873495111721387323=-1361110683980171437}, [test] TASK: 3 DELTA:
2016-01-15 14:58:33.695 b.s.d.executor [INFO] TRANSFERING tuple TASK: 1 TUPLE: source: word-reader:4, stream: __ack_init, id: {}, [3019472566015270743 -3346388363094288106 4]
2016-01-15 14:58:33.695 b.s.d.executor [INFO] Processing received message FOR 3 TUPLE: source: word-reader:4, stream: default, id: {5606815396768900929=8856560436727666341}, [are]
2016-01-15 14:58:33.695 b.s.d.executor [INFO] Execute done TUPLE source: word-normalizer:3, stream: default, id: {-8348710384844471183=6135008062829212202}, [storm] TASK: 2 DELTA:
2016-01-15 14:58:33.695 b.s.d.task [INFO] Emitting: word-reader default [storm]
2016-01-15 14:58:33.695 b.s.d.task [INFO] Emitting: word-normalizer default [are]
2016-01-15 14:58:33.695 b.s.d.executor [INFO] Processing received message FOR 2 TUPLE: source: word-normalizer:3, stream: default, id: {3873495111721387323=-8327152215513187828}, [test]
2016-01-15 14:58:33.695 b.s.d.executor [INFO] TRANSFERING tuple TASK: 3 TUPLE: source: word-reader:4, stream: default, id: {3476732415982803994=-4357403442784978407}, [storm]
2016-01-15 14:58:33.696 b.s.d.executor [INFO] TRANSFERING tuple TASK: 2 TUPLE: source: word-normalizer:3, stream: default, id: {5606815396768900929=-3403324947437350728}, [are]
2016-01-15 14:58:33.696 b.s.d.task [INFO] Emitting: word-reader __ack_init [3476732415982803994 -4357403442784978407 4]
2016-01-15 14:58:33.696 b.s.d.task [INFO] Emitting: word-counter default [test, {storm=1, test=1}]
2016-01-15 14:58:33.696 b.s.d.task [INFO] Emitting: word-normalizer __ack_ack [5606815396768900929 -6184525071543187939]
2016-01-15 14:58:33.696 b.s.d.executor [INFO] TRANSFERING tuple TASK: 1 TUPLE: source: word-reader:4, stream: __ack_init, id: {}, [3476732415982803994 -4357403442784978407 4]
2016-01-15 14:58:33.696 b.s.d.task [INFO] Emitting: word-reader default [simple]
2016-01-15 14:58:33.696 b.s.d.executor [INFO] TRANSFERING tuple TASK: 1 TUPLE: source: word-normalizer:3, stream: __ack_ack, id: {}, [5606815396768900929 -6184525071543187939]
2016-01-15 14:58:33.696 b.s.d.task [INFO] Emitting: word-counter __ack_ack [3873495111721387323 -8327152215513187828]
2016-01-15 14:58:33.696 b.s.d.executor [INFO] BOLT ack TASK: 3 TIME: TUPLE: source: word-reader:4, stream: default, id: {5606815396768900929=8856560436727666341}, [are]
2016-01-15 14:58:33.696 b.s.d.executor [INFO] TRANSFERING tuple TASK: 3 TUPLE: source: word-reader:4, stream: default, id: {3166738897773801792=-3002351572582086873}, [simple]
2016-01-15 14:58:33.696 b.s.d.executor [INFO] Execute done TUPLE source: word-reader:4, stream: default, id: {5606815396768900929=8856560436727666341}, [are] TASK: 3 DELTA:
2016-01-15 14:58:33.697 b.s.d.executor [INFO] TRANSFERING tuple TASK: 1 TUPLE: source: word-counter:2, stream: __ack_ack, id: {}, [3873495111721387323 -8327152215513187828]
2016-01-15 14:58:33.697 b.s.d.executor [INFO] Processing received message FOR 3 TUPLE: source: word-reader:4, stream: default, id: {-6904995293562913739=-6165647448705023493}, [great]
2016-01-15 14:58:33.697 b.s.d.task [INFO] Emitting: word-reader __ack_init [3166738897773801792 -3002351572582086873 4]
2016-01-15 14:58:33.697 b.s.d.task [INFO] Emitting: word-normalizer default [great]
2016-01-15 14:58:33.697 b.s.d.executor [INFO] BOLT ack TASK: 2 TIME: TUPLE: source: word-normalizer:3, stream: default, id: {3873495111721387323=-8327152215513187828}, [test]
2016-01-15 14:58:33.697 b.s.d.executor [INFO] TRANSFERING tuple TASK: 1 TUPLE: source: word-reader:4, stream: __ack_init, id: {}, [3166738897773801792 -3002351572582086873 4]
2016-01-15 14:58:33.697 b.s.d.executor [INFO] TRANSFERING tuple TASK: 2 TUPLE: source: word-normalizer:3, stream: default, id: {-6904995293562913739=7594063588566046947}, [great]
2016-01-15 14:58:33.697 b.s.d.task [INFO] Emitting: word-reader default [application]
2016-01-15 14:58:33.697 b.s.d.executor [INFO] Execute done TUPLE source: word-normalizer:3, stream: default, id: {3873495111721387323=-8327152215513187828}, [test] TASK: 2 DELTA:
2016-01-15 14:58:33.697 b.s.d.task [INFO] Emitting: word-normalizer __ack_ack [-6904995293562913739 -4391941100209579752]
2016-01-15 14:58:33.697 b.s.d.executor [INFO] TRANSFERING tuple TASK: 3 TUPLE: source: word-reader:4, stream: default, id: {-2644721620688610173=4258087949161768273}, [application]
2016-01-15 14:58:33.697 b.s.d.executor [INFO] TRANSFERING tuple TASK: 1 TUPLE: source: word-normalizer:3, stream: __ack_ack, id: {}, [-6904995293562913739 -4391941100209579752]
2016-01-15 14:58:33.697 b.s.d.executor [INFO] Processing received message FOR 2 TUPLE: source: word-normalizer:3, stream: default, id: {5606815396768900929=-3403324947437350728}, [are]
2016-01-15 14:58:33.698 b.s.d.executor [INFO] BOLT ack TASK: 3 TIME: TUPLE: source: word-reader:4, stream: default, id: {-6904995293562913739=-6165647448705023493}, [great]
2016-01-15 14:58:33.698 b.s.d.task [INFO] Emitting: word-reader __ack_init [-2644721620688610173 4258087949161768273 4]
2016-01-15 14:58:33.698 b.s.d.task [INFO] Emitting: word-counter default [are, {storm=1, test=1, are=1}]
2016-01-15 14:58:33.698 b.s.d.executor [INFO] Execute done TUPLE source: word-reader:4, stream: default, id: {-6904995293562913739=-6165647448705023493}, [great] TASK: 3 DELTA:
2016-01-15 14:58:33.698 b.s.d.executor [INFO] TRANSFERING tuple TASK: 1 TUPLE: source: word-reader:4, stream: __ack_init, id: {}, [-2644721620688610173 4258087949161768273 4]
2016-01-15 14:58:33.698 b.s.d.task [INFO] Emitting: word-counter __ack_ack [5606815396768900929 -3403324947437350728]
2016-01-15 14:58:33.698 b.s.d.executor [INFO] Processing received message FOR 3 TUPLE: source: word-reader:4, stream: default, id: {836664335768127530=-122270000364872169}, [is]
2016-01-15 14:58:33.698 b.s.d.task [INFO] Emitting: word-reader default [but]
2016-01-15 14:58:33.698 b.s.d.task [INFO] Emitting: word-normalizer default [is]
2016-01-15 14:58:33.698 b.s.d.executor [INFO] TRANSFERING tuple TASK: 1 TUPLE: source: word-counter:2, stream: __ack_ack, id: {}, [5606815396768900929 -3403324947437350728]
2016-01-15 14:58:33.699 b.s.d.executor [INFO] Preparing bolt __acker:(1)
2016-01-15 14:58:33.699 b.s.d.executor [INFO] TRANSFERING tuple TASK: 2 TUPLE: source: word-normalizer:3, stream: default, id: {836664335768127530=-4084171163148490794}, [is]
2016-01-15 14:58:33.699 b.s.d.executor [INFO] BOLT ack TASK: 2 TIME: TUPLE: source: word-normalizer:3, stream: default, id: {5606815396768900929=-3403324947437350728}, [are]
2016-01-15 14:58:33.699 b.s.d.task [INFO] Emitting: word-normalizer __ack_ack [836664335768127530 4116157990635272641]
2016-01-15 14:58:33.700 b.s.d.executor [INFO] Execute done TUPLE source: word-normalizer:3, stream: default, id: {5606815396768900929=-3403324947437350728}, [are] TASK: 2 DELTA:
2016-01-15 14:58:33.700 b.s.d.executor [INFO] TRANSFERING tuple TASK: 1 TUPLE: source: word-normalizer:3, stream: __ack_ack, id: {}, [836664335768127530 4116157990635272641]
2016-01-15 14:58:33.700 b.s.d.executor [INFO] Processing received message FOR 2 TUPLE: source: word-normalizer:3, stream: default, id: {-6904995293562913739=7594063588566046947}, [great]
2016-01-15 14:58:33.700 b.s.d.executor [INFO] BOLT ack TASK: 3 TIME: TUPLE: source: word-reader:4, stream: default, id: {836664335768127530=-122270000364872169}, [is]
2016-01-15 14:58:33.700 b.s.d.task [INFO] Emitting: word-counter default [great, {storm=1, test=1, are=1, great=1}]
2016-01-15 14:58:33.700 b.s.d.executor [INFO] Execute done TUPLE source: word-reader:4, stream: default, id: {836664335768127530=-122270000364872169}, [is] TASK: 3 DELTA:
2016-01-15 14:58:33.700 b.s.d.executor [INFO] Prepared bolt __acker:(1)
2016-01-15 14:58:33.700 b.s.d.task [INFO] Emitting: word-counter __ack_ack [-6904995293562913739 7594063588566046947]
2016-01-15 14:58:33.700 b.s.d.executor [INFO] Processing received message FOR 3 TUPLE: source: word-reader:4, stream: default, id: {3019472566015270743=-3346388363094288106}, [an]
2016-01-15 14:58:33.701 b.s.d.task [INFO] Emitting: word-normalizer default [an]
2016-01-15 14:58:33.701 b.s.d.executor [INFO] TRANSFERING tuple TASK: 1 TUPLE: source: word-counter:2, stream: __ack_ack, id: {}, [-6904995293562913739 7594063588566046947]
2016-01-15 14:58:33.701 b.s.d.executor [INFO] Processing received message FOR 1 TUPLE: source: word-reader:4, stream: __ack_init, id: {}, [-8348710384844471183 3588653195059424065 4]
2016-01-15 14:58:33.701 b.s.d.executor [INFO] TRANSFERING tuple TASK: 2 TUPLE: source: word-normalizer:3, stream: default, id: {3019472566015270743=3194708398529701619}, [an]
2016-01-15 14:58:33.701 b.s.d.executor [INFO] BOLT ack TASK: 2 TIME: TUPLE: source: word-normalizer:3, stream: default, id: {-6904995293562913739=7594063588566046947}, [great]
2016-01-15 14:58:33.701 b.s.d.task [INFO] Emitting: word-normalizer __ack_ack [3019472566015270743 -154565087412977691]
2016-01-15 14:58:33.701 b.s.d.executor [INFO] BOLT ack TASK: 1 TIME: TUPLE: source: word-reader:4, stream: __ack_init, id: {}, [-8348710384844471183 3588653195059424065 4]
2016-01-15 14:58:33.701 b.s.d.executor [INFO] Execute done TUPLE source: word-normalizer:3, stream: default, id: {-6904995293562913739=7594063588566046947}, [great] TASK: 2 DELTA:
2016-01-15 14:58:33.702 b.s.d.executor [INFO] Execute done TUPLE source: word-reader:4, stream: __ack_init, id: {}, [-8348710384844471183 3588653195059424065 4] TASK: 1 DELTA:
2016-01-15 14:58:33.702 b.s.d.executor [INFO] Processing received message FOR 2 TUPLE: source: word-normalizer:3, stream: default, id: {836664335768127530=-4084171163148490794}, [is]
2016-01-15 14:58:33.702 b.s.d.executor [INFO] TRANSFERING tuple TASK: 1 TUPLE: source: word-normalizer:3, stream: __ack_ack, id: {}, [3019472566015270743 -154565087412977691]
2016-01-15 14:58:33.702 b.s.d.executor [INFO] BOLT ack TASK: 3 TIME: TUPLE: source: word-reader:4, stream: default, id: {3019472566015270743=-3346388363094288106}, [an]
2016-01-15 14:58:33.702 b.s.d.executor [INFO] Processing received message FOR 1 TUPLE: source: word-reader:4, stream: __ack_init, id: {}, [3873495111721387323 -1361110683980171437 4]
2016-01-15 14:58:33.702 b.s.d.task [INFO] Emitting: word-counter default [is, {storm=1, test=1, are=1, is=1, great=1}]
2016-01-15 14:58:33.702 b.s.d.executor [INFO] Execute done TUPLE source: word-reader:4, stream: default, id: {3019472566015270743=-3346388363094288106}, [an] TASK: 3 DELTA:
2016-01-15 14:58:33.702 b.s.d.executor [INFO] BOLT ack TASK: 1 TIME: TUPLE: source: word-reader:4, stream: __ack_init, id: {}, [3873495111721387323 -1361110683980171437 4]
2016-01-15 14:58:33.702 b.s.d.executor [INFO] Processing received message FOR 3 TUPLE: source: word-reader:4, stream: default, id: {3476732415982803994=-4357403442784978407}, [storm]
2016-01-15 14:58:33.702 b.s.d.task [INFO] Emitting: word-counter __ack_ack [836664335768127530 -4084171163148490794]
2016-01-15 14:58:33.702 b.s.d.executor [INFO] Execute done TUPLE source: word-reader:4, stream: __ack_init, id: {}, [3873495111721387323 -1361110683980171437 4] TASK: 1 DELTA: 0
2016-01-15 14:58:33.702 b.s.d.task [INFO] Emitting: word-normalizer default [storm]
2016-01-15 14:58:33.703 b.s.d.executor [INFO] TRANSFERING tuple TASK: 1 TUPLE: source: word-counter:2, stream: __ack_ack, id: {}, [836664335768127530 -4084171163148490794]
2016-01-15 14:58:33.703 b.s.d.executor [INFO] TRANSFERING tuple TASK: 2 TUPLE: source: word-normalizer:3, stream: default, id: {3476732415982803994=3140219300272482684}, [storm]
2016-01-15 14:58:33.703 b.s.d.executor [INFO] BOLT ack TASK: 2 TIME: TUPLE: source: word-normalizer:3, stream: default, id: {836664335768127530=-4084171163148490794}, [is]
2016-01-15 14:58:33.703 b.s.d.task [INFO] Emitting: word-normalizer __ack_ack [3476732415982803994 -1723989740179582107]
2016-01-15 14:58:33.703 b.s.d.executor [INFO] Execute done TUPLE source: word-normalizer:3, stream: default, id: {836664335768127530=-4084171163148490794}, [is] TASK: 2 DELTA:
2016-01-15 14:58:33.703 b.s.d.executor [INFO] TRANSFERING tuple TASK: 1 TUPLE: source: word-normalizer:3, stream: __ack_ack, id: {}, [3476732415982803994 -1723989740179582107]
2016-01-15 14:58:33.703 b.s.d.executor [INFO] Processing received message FOR 2 TUPLE: source: word-normalizer:3, stream: default, id: {3019472566015270743=3194708398529701619}, [an]
2016-01-15 14:58:33.703 b.s.d.executor [INFO] BOLT ack TASK: 3 TIME: TUPLE: source: word-reader:4, stream: default, id: {3476732415982803994=-4357403442784978407}, [storm]
2016-01-15 14:58:33.704 b.s.d.task [INFO] Emitting: word-counter default [an, {storm=1, test=1, are=1, is=1, great=1, an=1}]
2016-01-15 14:58:33.704 b.s.d.executor [INFO] Execute done TUPLE source: word-reader:4, stream: default, id: {3476732415982803994=-4357403442784978407}, [storm] TASK: 3 DELTA:
2016-01-15 14:58:33.704 b.s.d.executor [INFO] Processing received message FOR 1 TUPLE: source: word-reader:4, stream: __ack_init, id: {}, [5606815396768900929 8856560436727666341 4]
2016-01-15 14:58:33.704 b.s.d.task [INFO] Emitting: word-counter __ack_ack [3019472566015270743 3194708398529701619]
2016-01-15 14:58:33.704 b.s.d.executor [INFO] Processing received message FOR 3 TUPLE: source: word-reader:4, stream: default, id: {3166738897773801792=-3002351572582086873}, [simple]
2016-01-15 14:58:33.704 b.s.d.executor [INFO] BOLT ack TASK: 1 TIME: TUPLE: source: word-reader:4, stream: __ack_init, id: {}, [5606815396768900929 8856560436727666341 4]
2016-01-15 14:58:33.704 b.s.d.task [INFO] Emitting: word-normalizer default [simple]
2016-01-15 14:58:33.704 b.s.d.executor [INFO] TRANSFERING tuple TASK: 1 TUPLE: source: word-counter:2, stream: __ack_ack, id: {}, [3019472566015270743 3194708398529701619]
2016-01-15 14:58:33.704 b.s.d.executor [INFO] Execute done TUPLE source: word-reader:4, stream: __ack_init, id: {}, [5606815396768900929 8856560436727666341 4] TASK: 1 DELTA:
2016-01-15 14:58:33.704 b.s.d.executor [INFO] TRANSFERING tuple TASK: 2 TUPLE: source: word-normalizer:3, stream: default, id: {3166738897773801792=-6459367511201737622}, [simple]
2016-01-15 14:58:33.704 b.s.d.executor [INFO] BOLT ack TASK: 2 TIME: TUPLE: source: word-normalizer:3, stream: default, id: {3019472566015270743=3194708398529701619}, [an]
2016-01-15 14:58:33.705 b.s.d.executor [INFO] Processing received message FOR 1 TUPLE: source: word-reader:4, stream: __ack_init, id: {}, [-6904995293562913739 -6165647448705023493 4]
2016-01-15 14:58:33.705 b.s.d.task [INFO] Emitting: word-normalizer __ack_ack [3166738897773801792 8074450959888536397]
2016-01-15 14:58:33.705 b.s.d.executor [INFO] Execute done TUPLE source: word-normalizer:3, stream: default, id: {3019472566015270743=3194708398529701619}, [an] TASK: 2 DELTA:
2016-01-15 14:58:33.705 b.s.d.executor [INFO] BOLT ack TASK: 1 TIME: TUPLE: source: word-reader:4, stream: __ack_init, id: {}, [-6904995293562913739 -6165647448705023493 4]
2016-01-15 14:58:33.705 b.s.d.executor [INFO] TRANSFERING tuple TASK: 3 TUPLE: source: word-reader:4, stream: default, id: {-3755836399149826733=6156608899632535318}, [but]
2016-01-15 14:58:33.705 b.s.d.executor [INFO] TRANSFERING tuple TASK: 1 TUPLE: source: word-normalizer:3, stream: __ack_ack, id: {}, [3166738897773801792 8074450959888536397]
2016-01-15 14:58:33.705 b.s.d.executor [INFO] Processing received message FOR 2 TUPLE: source: word-normalizer:3, stream: default, id: {3476732415982803994=3140219300272482684}, [storm]
2016-01-15 14:58:33.705 b.s.d.executor [INFO] Execute done TUPLE source: word-reader:4, stream: __ack_init, id: {}, [-6904995293562913739 -6165647448705023493 4] TASK: 1 DELTA:
2016-01-15 14:58:33.705 b.s.d.executor [INFO] BOLT ack TASK: 3 TIME: TUPLE: source: word-reader:4, stream: default, id: {3166738897773801792=-3002351572582086873}, [simple]
2016-01-15 14:58:33.705 b.s.d.task [INFO] Emitting: word-reader __ack_init [-3755836399149826733 6156608899632535318 4]
2016-01-15 14:58:33.705 b.s.d.task [INFO] Emitting: word-counter default [storm, {storm=2, test=1, are=1, is=1, great=1, an=1}]
2016-01-15 14:58:33.705 b.s.d.executor [INFO] Processing received message FOR 1 TUPLE: source: word-reader:4, stream: __ack_init, id: {}, [836664335768127530 -122270000364872169 4]
2016-01-15 14:58:33.705 b.s.d.executor [INFO] Execute done TUPLE source: word-reader:4, stream: default, id: {3166738897773801792=-3002351572582086873}, [simple] TASK: 3 DELTA:
2016-01-15 14:58:33.706 b.s.d.executor [INFO] TRANSFERING tuple TASK: 1 TUPLE: source: word-reader:4, stream: __ack_init, id: {}, [-3755836399149826733 6156608899632535318 4]
2016-01-15 14:58:33.706 b.s.d.task [INFO] Emitting: word-counter __ack_ack [3476732415982803994 3140219300272482684]
2016-01-15 14:58:33.706 b.s.d.executor [INFO] Processing received message FOR 3 TUPLE: source: word-reader:4, stream: default, id: {-2644721620688610173=4258087949161768273}, [application]
2016-01-15 14:58:33.706 b.s.d.executor [INFO] BOLT ack TASK: 1 TIME: TUPLE: source: word-reader:4, stream: __ack_init, id: {}, [836664335768127530 -122270000364872169 4]
2016-01-15 14:58:33.706 b.s.d.task [INFO] Emitting: word-reader default [very]
2016-01-15 14:58:33.706 b.s.d.executor [INFO] TRANSFERING tuple TASK: 1 TUPLE: source: word-counter:2, stream: __ack_ack, id: {}, [3476732415982803994 3140219300272482684]
2016-01-15 14:58:33.706 b.s.d.task [INFO] Emitting: word-normalizer default [application]
2016-01-15 14:58:33.706 b.s.d.executor [INFO] Execute done TUPLE source: word-reader:4, stream: __ack_init, id: {}, [836664335768127530 -122270000364872169 4] TASK: 1 DELTA:
2016-01-15 14:58:33.706 b.s.d.executor [INFO] TRANSFERING tuple TASK: 3 TUPLE: source: word-reader:4, stream: default, id: {2247170131491427289=1249513627528559881}, [very]
2016-01-15 14:58:33.706 b.s.d.executor [INFO] BOLT ack TASK: 2 TIME: TUPLE: source: word-normalizer:3, stream: default, id: {3476732415982803994=3140219300272482684}, [storm]
2016-01-15 14:58:33.706 b.s.d.executor [INFO] TRANSFERING tuple TASK: 2 TUPLE: source: word-normalizer:3, stream: default, id: {-2644721620688610173=3772187515776150658}, [application]
2016-01-15 14:58:33.706 b.s.d.executor [INFO] Processing received message FOR 1 TUPLE: source: word-normalizer:3, stream: __ack_ack, id: {}, [-8348710384844471183 7272917871821445483]
2016-01-15 14:58:33.706 b.s.d.task [INFO] Emitting: word-reader __ack_init [2247170131491427289 1249513627528559881 4]
2016-01-15 14:58:33.706 b.s.d.executor [INFO] Execute done TUPLE source: word-normalizer:3, stream: default, id: {3476732415982803994=3140219300272482684}, [storm] TASK: 2 DELTA:
2016-01-15 14:58:33.707 b.s.d.task [INFO] Emitting: word-normalizer __ack_ack [-2644721620688610173 1102894699295312339]
2016-01-15 14:58:33.707 b.s.d.executor [INFO] Processing received message FOR 2 TUPLE: source: word-normalizer:3, stream: default, id: {3166738897773801792=-6459367511201737622}, [simple]
2016-01-15 14:58:33.707 b.s.d.executor [INFO] TRANSFERING tuple TASK: 1 TUPLE: source: word-reader:4, stream: __ack_init, id: {}, [2247170131491427289 1249513627528559881 4]
2016-01-15 14:58:33.707 b.s.d.executor [INFO] BOLT ack TASK: 1 TIME: TUPLE: source: word-normalizer:3, stream: __ack_ack, id: {}, [-8348710384844471183 7272917871821445483]
2016-01-15 14:58:33.707 b.s.d.executor [INFO] TRANSFERING tuple TASK: 1 TUPLE: source: word-normalizer:3, stream: __ack_ack, id: {}, [-2644721620688610173 1102894699295312339]
2016-01-15 14:58:33.707 b.s.d.task [INFO] Emitting: word-counter default [simple, {storm=2, test=1, are=1, is=1, simple=1, great=1, an=1}]
2016-01-15 14:58:33.707 b.s.d.task [INFO] Emitting: word-reader default [powerfull]
2016-01-15 14:58:33.707 b.s.d.executor [INFO] Execute done TUPLE source: word-normalizer:3, stream: __ack_ack, id: {}, [-8348710384844471183 7272917871821445483] TASK: 1 DELTA:
2016-01-15 14:58:33.707 b.s.d.executor [INFO] BOLT ack TASK: 3 TIME: TUPLE: source: word-reader:4, stream: default, id: {-2644721620688610173=4258087949161768273}, [application]
2016-01-15 14:58:33.707 b.s.d.executor [INFO] TRANSFERING tuple TASK: 3 TUPLE: source: word-reader:4, stream: default, id: {3622331100494670904=3562472101861227696}, [powerfull]
2016-01-15 14:58:33.707 b.s.d.task [INFO] Emitting: word-counter __ack_ack [3166738897773801792 -6459367511201737622]
2016-01-15 14:58:33.708 b.s.d.executor [INFO] Execute done TUPLE source: word-reader:4, stream: default, id: {-2644721620688610173=4258087949161768273}, [application] TASK: 3 DELTA:
2016-01-15 14:58:33.708 b.s.d.executor [INFO] Processing received message FOR 1 TUPLE: source: word-normalizer:3, stream: __ack_ack, id: {}, [3873495111721387323 7020089438728736095]
2016-01-15 14:58:33.708 b.s.d.executor [INFO] Preparing bolt __system:(-1)
2016-01-15 14:58:33.708 b.s.d.task [INFO] Emitting: word-reader __ack_init [3622331100494670904 3562472101861227696 4]
2016-01-15 14:58:33.708 b.s.d.executor [INFO] TRANSFERING tuple TASK: 1 TUPLE: source: word-counter:2, stream: __ack_ack, id: {}, [3166738897773801792 -6459367511201737622]
2016-01-15 14:58:33.708 b.s.d.executor [INFO] Processing received message FOR 3 TUPLE: source: word-reader:4, stream: default, id: {-3755836399149826733=6156608899632535318}, [but]
2016-01-15 14:58:33.708 b.s.d.executor [INFO] TRANSFERING tuple TASK: 1 TUPLE: source: word-reader:4, stream: __ack_init, id: {}, [3622331100494670904 3562472101861227696 4]
2016-01-15 14:58:33.708 b.s.d.executor [INFO] BOLT ack TASK: 2 TIME: TUPLE: source: word-normalizer:3, stream: default, id: {3166738897773801792=-6459367511201737622}, [simple]
2016-01-15 14:58:33.708 b.s.d.task [INFO] Emitting: word-normalizer default [but]
2016-01-15 14:58:33.708 b.s.d.task [INFO] Emitting: word-reader default [really]
2016-01-15 14:58:33.708 b.s.d.executor [INFO] Execute done TUPLE source: word-normalizer:3, stream: default, id: {3166738897773801792=-6459367511201737622}, [simple] TASK: 2 DELTA: 1
2016-01-15 14:58:33.708 b.s.d.executor [INFO] TRANSFERING tuple TASK: 2 TUPLE: source: word-normalizer:3, stream: default, id: {-3755836399149826733=-2036947486990360801}, [but]
2016-01-15 14:58:33.708 b.s.d.executor [INFO] TRANSFERING tuple TASK: 3 TUPLE: source: word-reader:4, stream: default, id: {5598820146121914901=-1392318991271218769}, [really]
2016-01-15 14:58:33.708 b.s.d.task [INFO] Emitting: word-normalizer __ack_ack [-3755836399149826733 -5274871706802223095]
2016-01-15 14:58:33.709 b.s.d.task [INFO] Emitting: word-reader __ack_init [5598820146121914901 -1392318991271218769 4]
2016-01-15 14:58:33.709 b.s.d.executor [INFO] TRANSFERING tuple TASK: 1 TUPLE: source: word-normalizer:3, stream: __ack_ack, id: {}, [-3755836399149826733 -5274871706802223095]
2016-01-15 14:58:33.709 b.s.d.executor [INFO] TRANSFERING tuple TASK: 1 TUPLE: source: word-reader:4, stream: __ack_init, id: {}, [5598820146121914901 -1392318991271218769 4]
2016-01-15 14:58:33.711 b.s.d.executor [INFO] Prepared bolt __system:(-1)
2016-01-15 14:58:33.711 b.s.d.executor [INFO] BOLT ack TASK: 1 TIME: 0 TUPLE: source: word-normalizer:3, stream: __ack_ack, id: {}, [3873495111721387323 7020089438728736095]
2016-01-15 14:58:33.711 b.s.d.executor [INFO] BOLT ack TASK: 3 TIME: TUPLE: source: word-reader:4, stream: default, id: {-3755836399149826733=6156608899632535318}, [but]
2016-01-15 14:58:33.711 b.s.d.task [INFO] Emitting: word-reader default [StOrm]
2016-01-15 14:58:33.712 b.s.d.executor [INFO] Execute done TUPLE source: word-reader:4, stream: default, id: {-3755836399149826733=6156608899632535318}, [but] TASK: 3 DELTA:
2016-01-15 14:58:33.712 b.s.d.executor [INFO] Processing received message FOR 2 TUPLE: source: word-normalizer:3, stream: default, id: {-2644721620688610173=3772187515776150658}, [application]
2016-01-15 14:58:33.712 b.s.d.executor [INFO] TRANSFERING tuple TASK: 3 TUPLE: source: word-reader:4, stream: default, id: {-5311889501273724839=-6424980270203679450}, [StOrm]
2016-01-15 14:58:33.712 b.s.d.executor [INFO] Execute done TUPLE source: word-normalizer:3, stream: __ack_ack, id: {}, [3873495111721387323 7020089438728736095] TASK: 1 DELTA:
2016-01-15 14:58:33.712 b.s.d.executor [INFO] Processing received message FOR 3 TUPLE: source: word-reader:4, stream: default, id: {2247170131491427289=1249513627528559881}, [very]
2016-01-15 14:58:33.712 b.s.d.task [INFO] Emitting: word-counter default [application, {storm=2, test=1, application=1, are=1, is=1, simple=1, great=1, an=1}]
2016-01-15 14:58:33.712 b.s.d.task [INFO] Emitting: word-normalizer default [very]
2016-01-15 14:58:33.712 b.s.d.executor [INFO] Processing received message FOR 1 TUPLE: source: word-counter:2, stream: __ack_ack, id: {}, [-8348710384844471183 6135008062829212202]
2016-01-15 14:58:33.712 b.s.d.task [INFO] Emitting: word-reader __ack_init [-5311889501273724839 -6424980270203679450 4]
2016-01-15 14:58:33.712 b.s.d.task [INFO] Emitting: word-counter __ack_ack [-2644721620688610173 3772187515776150658]
2016-01-15 14:58:33.712 b.s.d.executor [INFO] TRANSFERING tuple TASK: 2 TUPLE: source: word-normalizer:3, stream: default, id: {2247170131491427289=-4790799406211271617}, [very]
2016-01-15 14:58:33.712 b.s.d.task [INFO] Emitting: word-normalizer __ack_ack [2247170131491427289 -5993020805103580874]
2016-01-15 14:58:33.712 b.s.d.executor [INFO] TRANSFERING tuple TASK: 1 TUPLE: source: word-reader:4, stream: __ack_init, id: {}, [-5311889501273724839 -6424980270203679450 4]
2016-01-15 14:58:33.712 b.s.d.task [INFO] Emitting direct: 4; __acker __ack_ack [-8348710384844471183]
2016-01-15 14:58:33.712 b.s.d.executor [INFO] TRANSFERING tuple TASK: 1 TUPLE: source: word-counter:2, stream: __ack_ack, id: {}, [-2644721620688610173 3772187515776150658]
2016-01-15 14:58:33.712 b.s.d.executor [INFO] TRANSFERING tuple TASK: 1 TUPLE: source: word-normalizer:3, stream: __ack_ack, id: {}, [2247170131491427289 -5993020805103580874]
2016-01-15 14:58:33.713 b.s.d.executor [INFO] BOLT ack TASK: 2 TIME: TUPLE: source: word-normalizer:3, stream: default, id: {-2644721620688610173=3772187515776150658}, [application]
2016-01-15 14:58:33.713 b.s.d.executor [INFO] BOLT ack TASK: 3 TIME: TUPLE: source: word-reader:4, stream: default, id: {2247170131491427289=1249513627528559881}, [very]
2016-01-15 14:58:33.713 b.s.d.task [INFO] Emitting: word-reader default [is]
2016-01-15 14:58:33.713 b.s.d.executor [INFO] TRANSFERING tuple TASK: 4 TUPLE: source: __acker:1, stream: __ack_ack, id: {}, [-8348710384844471183]
2016-01-15 14:58:33.713 b.s.d.executor [INFO] Execute done TUPLE source: word-reader:4, stream: default, id: {2247170131491427289=1249513627528559881}, [very] TASK: 3 DELTA:
2016-01-15 14:58:33.713 b.s.d.executor [INFO] Execute done TUPLE source: word-normalizer:3, stream: default, id: {-2644721620688610173=3772187515776150658}, [application] TASK: 2 DELTA:
2016-01-15 14:58:33.713 b.s.d.executor [INFO] BOLT ack TASK: 1 TIME: TUPLE: source: word-counter:2, stream: __ack_ack, id: {}, [-8348710384844471183 6135008062829212202]
2016-01-15 14:58:33.713 b.s.d.executor [INFO] Processing received message FOR 3 TUPLE: source: word-reader:4, stream: default, id: {3622331100494670904=3562472101861227696}, [powerfull]
2016-01-15 14:58:33.713 b.s.d.executor [INFO] TRANSFERING tuple TASK: 3 TUPLE: source: word-reader:4, stream: default, id: {-4210604260192247499=2039164882510202710}, [is]
2016-01-15 14:58:33.713 b.s.d.executor [INFO] Processing received message FOR 2 TUPLE: source: word-normalizer:3, stream: default, id: {-3755836399149826733=-2036947486990360801}, [but]
2016-01-15 14:58:33.713 b.s.d.task [INFO] Emitting: word-normalizer default [powerfull]
2016-01-15 14:58:33.713 b.s.d.executor [INFO] Execute done TUPLE source: word-counter:2, stream: __ack_ack, id: {}, [-8348710384844471183 6135008062829212202] TASK: 1 DELTA:
2016-01-15 14:58:33.713 b.s.d.task [INFO] Emitting: word-counter default [but, {but=1, storm=2, test=1, application=1, are=1, is=1, simple=1, great=1, an=1}]
2016-01-15 14:58:33.713 b.s.d.executor [INFO] TRANSFERING tuple TASK: 2 TUPLE: source: word-normalizer:3, stream: default, id: {3622331100494670904=282012851938122965}, [powerfull]
2016-01-15 14:58:33.714 b.s.d.task [INFO] Emitting: word-reader __ack_init [-4210604260192247499 2039164882510202710 4]
2016-01-15 14:58:33.714 b.s.d.executor [INFO] Processing received message FOR 1 TUPLE: source: word-reader:4, stream: __ack_init, id: {}, [3019472566015270743 -3346388363094288106 4]
2016-01-15 14:58:33.714 b.s.d.task [INFO] Emitting: word-normalizer __ack_ack [3622331100494670904 3646113262202822757]
2016-01-15 14:58:33.714 b.s.d.task [INFO] Emitting: word-counter __ack_ack [-3755836399149826733 -2036947486990360801]
2016-01-15 14:58:33.714 b.s.d.executor [INFO] BOLT ack TASK: 1 TIME: TUPLE: source: word-reader:4, stream: __ack_init, id: {}, [3019472566015270743 -3346388363094288106 4]
2016-01-15 14:58:33.714 b.s.d.executor [INFO] TRANSFERING tuple TASK: 1 TUPLE: source: word-normalizer:3, stream: __ack_ack, id: {}, [3622331100494670904 3646113262202822757]
2016-01-15 14:58:33.714 b.s.d.executor [INFO] TRANSFERING tuple TASK: 1 TUPLE: source: word-counter:2, stream: __ack_ack, id: {}, [-3755836399149826733 -2036947486990360801]
2016-01-15 14:58:33.714 b.s.d.executor [INFO] BOLT ack TASK: 3 TIME: TUPLE: source: word-reader:4, stream: default, id: {3622331100494670904=3562472101861227696}, [powerfull]
2016-01-15 14:58:33.714 b.s.d.executor [INFO] Execute done TUPLE source: word-reader:4, stream: __ack_init, id: {}, [3019472566015270743 -3346388363094288106 4] TASK: 1 DELTA:
2016-01-15 14:58:33.714 b.s.d.executor [INFO] TRANSFERING tuple TASK: 1 TUPLE: source: word-reader:4, stream: __ack_init, id: {}, [-4210604260192247499 2039164882510202710 4]
2016-01-15 14:58:33.714 b.s.d.executor [INFO] Execute done TUPLE source: word-reader:4, stream: default, id: {3622331100494670904=3562472101861227696}, [powerfull] TASK: 3 DELTA:
2016-01-15 14:58:33.714 b.s.d.executor [INFO] Processing received message FOR 1 TUPLE: source: word-reader:4, stream: __ack_init, id: {}, [3476732415982803994 -4357403442784978407 4]
2016-01-15 14:58:33.714 b.s.d.executor [INFO] BOLT ack TASK: 2 TIME: TUPLE: source: word-normalizer:3, stream: default, id: {-3755836399149826733=-2036947486990360801}, [but]
2016-01-15 14:58:33.714 b.s.d.task [INFO] Emitting: word-reader default [great]
2016-01-15 14:58:33.715 b.s.d.executor [INFO] Processing received message FOR 3 TUPLE: source: word-reader:4, stream: default, id: {5598820146121914901=-1392318991271218769}, [really]
2016-01-15 14:58:33.715 b.s.d.executor [INFO] BOLT ack TASK: 1 TIME: TUPLE: source: word-reader:4, stream: __ack_init, id: {}, [3476732415982803994 -4357403442784978407 4]
2016-01-15 14:58:33.715 b.s.d.executor [INFO] TRANSFERING tuple TASK: 3 TUPLE: source: word-reader:4, stream: default, id: {-4568501325903703450=4968173464740562826}, [great]
2016-01-15 14:58:33.715 b.s.d.task [INFO] Emitting: word-normalizer default [really]
2016-01-15 14:58:33.715 b.s.d.executor [INFO] Execute done TUPLE source: word-reader:4, stream: __ack_init, id: {}, [3476732415982803994 -4357403442784978407 4] TASK: 1 DELTA:
2016-01-15 14:58:33.715 b.s.d.executor [INFO] Processing received message FOR 1 TUPLE: source: word-normalizer:3, stream: __ack_ack, id: {}, [5606815396768900929 -6184525071543187939]
2016-01-15 14:58:33.715 b.s.d.task [INFO] Emitting: word-reader __ack_init [-4568501325903703450 4968173464740562826 4]
2016-01-15 14:58:33.715 b.s.d.executor [INFO] BOLT ack TASK: 1 TIME: TUPLE: source: word-normalizer:3, stream: __ack_ack, id: {}, [5606815396768900929 -6184525071543187939]
2016-01-15 14:58:33.715 b.s.d.executor [INFO] TRANSFERING tuple TASK: 1 TUPLE: source: word-reader:4, stream: __ack_init, id: {}, [-4568501325903703450 4968173464740562826 4]
2016-01-15 14:58:33.715 b.s.d.executor [INFO] Execute done TUPLE source: word-normalizer:3, stream: __ack_ack, id: {}, [5606815396768900929 -6184525071543187939] TASK: 1 DELTA:
2016-01-15 14:58:33.715 b.s.d.executor [INFO] Processing received message FOR 1 TUPLE: source: word-counter:2, stream: __ack_ack, id: {}, [3873495111721387323 -8327152215513187828]
2016-01-15 14:58:33.716 b.s.d.task [INFO] Emitting direct: 4; __acker __ack_ack [3873495111721387323]
2016-01-15 14:58:33.716 b.s.d.executor [INFO] Processing received message FOR 4 TUPLE: source: __acker:1, stream: __ack_ack, id: {}, [-8348710384844471183]
2016-01-15 14:58:33.716 b.s.d.executor [INFO] TRANSFERING tuple TASK: 4 TUPLE: source: __acker:1, stream: __ack_ack, id: {}, [3873495111721387323]
2016-01-15 14:58:33.716 b.s.d.executor [INFO] BOLT ack TASK: 1 TIME: TUPLE: source: word-counter:2, stream: __ack_ack, id: {}, [3873495111721387323 -8327152215513187828]
2016-01-15 14:58:33.716 b.s.d.executor [INFO] SPOUT Acking message -8348710384844471183 storm
2016-01-15 14:58:33.716 b.s.d.executor [INFO] Execute done TUPLE source: word-counter:2, stream: __ack_ack, id: {}, [3873495111721387323 -8327152215513187828] TASK: 1 DELTA:
2016-01-15 14:58:33.716 b.s.d.executor [INFO] Processing received message FOR 1 TUPLE: source: word-reader:4, stream: __ack_init, id: {}, [3166738897773801792 -3002351572582086873 4]
2016-01-15 14:58:33.717 b.s.d.executor [INFO] BOLT ack TASK: 1 TIME: TUPLE: source: word-reader:4, stream: __ack_init, id: {}, [3166738897773801792 -3002351572582086873 4]
2016-01-15 14:58:33.717 b.s.d.executor [INFO] Execute done TUPLE source: word-reader:4, stream: __ack_init, id: {}, [3166738897773801792 -3002351572582086873 4] TASK: 1 DELTA:
2016-01-15 14:58:33.715 b.s.d.executor [INFO] Execute done TUPLE source: word-normalizer:3, stream: default, id: {-3755836399149826733=-2036947486990360801}, [but] TASK: 2 DELTA:
2016-01-15 14:58:33.715 b.s.d.executor [INFO] TRANSFERING tuple TASK: 2 TUPLE: source: word-normalizer:3, stream: default, id: {5598820146121914901=2587997876945014387}, [really]
2016-01-15 14:58:33.717 b.s.d.executor [INFO] Processing received message FOR 1 TUPLE: source: word-normalizer:3, stream: __ack_ack, id: {}, [-6904995293562913739 -4391941100209579752]
2016-01-15 14:58:33.717 b.s.d.executor [INFO] Processing received message FOR 2 TUPLE: source: word-normalizer:3, stream: default, id: {2247170131491427289=-4790799406211271617}, [very]
2016-01-15 14:58:33.717 b.s.d.task [INFO] Emitting: word-normalizer __ack_ack [5598820146121914901 -3510811982431617060]
2016-01-15 14:58:33.717 b.s.d.executor [INFO] BOLT ack TASK: 1 TIME: TUPLE: source: word-normalizer:3, stream: __ack_ack, id: {}, [-6904995293562913739 -4391941100209579752]
2016-01-15 14:58:33.717 STDIO [INFO] OK:storm
2016-01-15 14:58:33.717 b.s.d.task [INFO] Emitting: word-counter default [very, {but=1, very=1, storm=2, test=1, application=1, are=1, is=1, simple=1, great=1, an=1}]
2016-01-15 14:58:33.717 b.s.d.executor [INFO] Execute done TUPLE source: word-normalizer:3, stream: __ack_ack, id: {}, [-6904995293562913739 -4391941100209579752] TASK: 1 DELTA:
2016-01-15 14:58:33.717 b.s.d.executor [INFO] TRANSFERING tuple TASK: 1 TUPLE: source: word-normalizer:3, stream: __ack_ack, id: {}, [5598820146121914901 -3510811982431617060]
2016-01-15 14:58:33.717 b.s.d.executor [INFO] Processing received message FOR 1 TUPLE: source: word-reader:4, stream: __ack_init, id: {}, [-2644721620688610173 4258087949161768273 4]
2016-01-15 14:58:33.717 b.s.d.task [INFO] Emitting: word-counter __ack_ack [2247170131491427289 -4790799406211271617]
2016-01-15 14:58:33.718 b.s.d.executor [INFO] BOLT ack TASK: 3 TIME: TUPLE: source: word-reader:4, stream: default, id: {5598820146121914901=-1392318991271218769}, [really]
2016-01-15 14:58:33.718 b.s.d.executor [INFO] BOLT ack TASK: 1 TIME: TUPLE: source: word-reader:4, stream: __ack_init, id: {}, [-2644721620688610173 4258087949161768273 4]
2016-01-15 14:58:33.718 b.s.d.executor [INFO] TRANSFERING tuple TASK: 1 TUPLE: source: word-counter:2, stream: __ack_ack, id: {}, [2247170131491427289 -4790799406211271617]
2016-01-15 14:58:33.718 b.s.d.executor [INFO] Execute done TUPLE source: word-reader:4, stream: default, id: {5598820146121914901=-1392318991271218769}, [really] TASK: 3 DELTA:
2016-01-15 14:58:33.718 b.s.d.executor [INFO] Execute done TUPLE source: word-reader:4, stream: __ack_init, id: {}, [-2644721620688610173 4258087949161768273 4] TASK: 1 DELTA:
2016-01-15 14:58:33.718 b.s.d.executor [INFO] BOLT ack TASK: 2 TIME: TUPLE: source: word-normalizer:3, stream: default, id: {2247170131491427289=-4790799406211271617}, [very]
2016-01-15 14:58:33.718 b.s.d.executor [INFO] Processing received message FOR 3 TUPLE: source: word-reader:4, stream: default, id: {-5311889501273724839=-6424980270203679450}, [StOrm]
2016-01-15 14:58:33.718 b.s.d.executor [INFO] Processing received message FOR 1 TUPLE: source: word-counter:2, stream: __ack_ack, id: {}, [5606815396768900929 -3403324947437350728]
2016-01-15 14:58:33.718 b.s.d.executor [INFO] Execute done TUPLE source: word-normalizer:3, stream: default, id: {2247170131491427289=-4790799406211271617}, [very] TASK: 2 DELTA:
2016-01-15 14:58:33.718 b.s.d.task [INFO] Emitting: word-normalizer default [storm]
2016-01-15 14:58:33.718 b.s.d.task [INFO] Emitting direct: 4; __acker __ack_ack [5606815396768900929]
2016-01-15 14:58:33.718 b.s.d.executor [INFO] Processing received message FOR 2 TUPLE: source: word-normalizer:3, stream: default, id: {3622331100494670904=282012851938122965}, [powerfull]
2016-01-15 14:58:33.718 b.s.d.executor [INFO] TRANSFERING tuple TASK: 4 TUPLE: source: __acker:1, stream: __ack_ack, id: {}, [5606815396768900929]
2016-01-15 14:58:33.718 b.s.d.executor [INFO] TRANSFERING tuple TASK: 2 TUPLE: source: word-normalizer:3, stream: default, id: {-5311889501273724839=7333356645800650177}, [storm]
2016-01-15 14:58:33.718 b.s.d.task [INFO] Emitting: word-counter default [powerfull, {but=1, very=1, storm=2, test=1, application=1, are=1, is=1, simple=1, powerfull=1, great=1, an=1}]
2016-01-15 14:58:33.719 b.s.d.executor [INFO] BOLT ack TASK: 1 TIME: TUPLE: source: word-counter:2, stream: __ack_ack, id: {}, [5606815396768900929 -3403324947437350728]
2016-01-15 14:58:33.719 b.s.d.task [INFO] Emitting: word-counter __ack_ack [3622331100494670904 282012851938122965]
2016-01-15 14:58:33.719 b.s.d.task [INFO] Emitting: word-normalizer __ack_ack [-5311889501273724839 -4390812275327407897]
2016-01-15 14:58:33.719 b.s.d.executor [INFO] Execute done TUPLE source: word-counter:2, stream: __ack_ack, id: {}, [5606815396768900929 -3403324947437350728] TASK: 1 DELTA:
2016-01-15 14:58:33.719 b.s.d.executor [INFO] TRANSFERING tuple TASK: 1 TUPLE: source: word-counter:2, stream: __ack_ack, id: {}, [3622331100494670904 282012851938122965]
2016-01-15 14:58:33.719 b.s.d.executor [INFO] TRANSFERING tuple TASK: 1 TUPLE: source: word-normalizer:3, stream: __ack_ack, id: {}, [-5311889501273724839 -4390812275327407897]
2016-01-15 14:58:33.719 b.s.d.executor [INFO] Processing received message FOR 1 TUPLE: source: word-normalizer:3, stream: __ack_ack, id: {}, [836664335768127530 4116157990635272641]
2016-01-15 14:58:33.719 b.s.d.executor [INFO] BOLT ack TASK: 3 TIME: TUPLE: source: word-reader:4, stream: default, id: {-5311889501273724839=-6424980270203679450}, [StOrm]
2016-01-15 14:58:33.719 b.s.d.executor [INFO] BOLT ack TASK: 2 TIME: TUPLE: source: word-normalizer:3, stream: default, id: {3622331100494670904=282012851938122965}, [powerfull]
2016-01-15 14:58:33.719 b.s.d.executor [INFO] BOLT ack TASK: 1 TIME: TUPLE: source: word-normalizer:3, stream: __ack_ack, id: {}, [836664335768127530 4116157990635272641]
2016-01-15 14:58:33.719 b.s.d.executor [INFO] Execute done TUPLE source: word-reader:4, stream: default, id: {-5311889501273724839=-6424980270203679450}, [StOrm] TASK: 3 DELTA:
2016-01-15 14:58:33.719 b.s.d.executor [INFO] Execute done TUPLE source: word-normalizer:3, stream: default, id: {3622331100494670904=282012851938122965}, [powerfull] TASK: 2 DELTA:
2016-01-15 14:58:33.719 b.s.d.executor [INFO] Execute done TUPLE source: word-normalizer:3, stream: __ack_ack, id: {}, [836664335768127530 4116157990635272641] TASK: 1 DELTA:
2016-01-15 14:58:33.720 b.s.d.executor [INFO] Processing received message FOR 3 TUPLE: source: word-reader:4, stream: default, id: {-4210604260192247499=2039164882510202710}, [is]
2016-01-15 14:58:33.720 b.s.d.executor [INFO] Processing received message FOR 2 TUPLE: source: word-normalizer:3, stream: default, id: {5598820146121914901=2587997876945014387}, [really]
2016-01-15 14:58:33.720 b.s.d.executor [INFO] Processing received message FOR 1 TUPLE: source: word-counter:2, stream: __ack_ack, id: {}, [-6904995293562913739 7594063588566046947]
2016-01-15 14:58:33.720 b.s.d.task [INFO] Emitting: word-normalizer default [is]
2016-01-15 14:58:33.720 b.s.d.task [INFO] Emitting: word-counter default [really, {but=1, very=1, storm=2, test=1, application=1, are=1, is=1, simple=1, powerfull=1, great=1, an=1, really=1}]
2016-01-15 14:58:33.720 b.s.d.task [INFO] Emitting direct: 4; __acker __ack_ack [-6904995293562913739]
2016-01-15 14:58:33.720 b.s.d.executor [INFO] TRANSFERING tuple TASK: 2 TUPLE: source: word-normalizer:3, stream: default, id: {-4210604260192247499=-9210764837221504154}, [is]
2016-01-15 14:58:33.720 b.s.d.executor [INFO] TRANSFERING tuple TASK: 4 TUPLE: source: __acker:1, stream: __ack_ack, id: {}, [-6904995293562913739]
2016-01-15 14:58:33.720 b.s.d.task [INFO] Emitting: word-counter __ack_ack [5598820146121914901 2587997876945014387]
2016-01-15 14:58:33.720 b.s.d.task [INFO] Emitting: word-normalizer __ack_ack [-4210604260192247499 -7178637172869157840]
2016-01-15 14:58:33.720 b.s.d.executor [INFO] BOLT ack TASK: 1 TIME: TUPLE: source: word-counter:2, stream: __ack_ack, id: {}, [-6904995293562913739 7594063588566046947]
2016-01-15 14:58:33.721 b.s.d.executor [INFO] TRANSFERING tuple TASK: 1 TUPLE: source: word-counter:2, stream: __ack_ack, id: {}, [5598820146121914901 2587997876945014387]
2016-01-15 14:58:33.721 b.s.d.executor [INFO] TRANSFERING tuple TASK: 1 TUPLE: source: word-normalizer:3, stream: __ack_ack, id: {}, [-4210604260192247499 -7178637172869157840]
2016-01-15 14:58:33.721 b.s.d.executor [INFO] Execute done TUPLE source: word-counter:2, stream: __ack_ack, id: {}, [-6904995293562913739 7594063588566046947] TASK: 1 DELTA:
2016-01-15 14:58:33.721 b.s.d.executor [INFO] BOLT ack TASK: 2 TIME: TUPLE: source: word-normalizer:3, stream: default, id: {5598820146121914901=2587997876945014387}, [really]
2016-01-15 14:58:33.721 b.s.d.executor [INFO] Processing received message FOR 1 TUPLE: source: word-normalizer:3, stream: __ack_ack, id: {}, [3019472566015270743 -154565087412977691]
2016-01-15 14:58:33.721 b.s.d.executor [INFO] BOLT ack TASK: 3 TIME: TUPLE: source: word-reader:4, stream: default, id: {-4210604260192247499=2039164882510202710}, [is]
2016-01-15 14:58:33.721 b.s.d.executor [INFO] Execute done TUPLE source: word-normalizer:3, stream: default, id: {5598820146121914901=2587997876945014387}, [really] TASK: 2 DELTA:
2016-01-15 14:58:33.721 b.s.d.executor [INFO] Execute done TUPLE source: word-reader:4, stream: default, id: {-4210604260192247499=2039164882510202710}, [is] TASK: 3 DELTA:
2016-01-15 14:58:33.721 b.s.d.executor [INFO] BOLT ack TASK: 1 TIME: TUPLE: source: word-normalizer:3, stream: __ack_ack, id: {}, [3019472566015270743 -154565087412977691]
2016-01-15 14:58:33.721 b.s.d.executor [INFO] Processing received message FOR 2 TUPLE: source: word-normalizer:3, stream: default, id: {-5311889501273724839=7333356645800650177}, [storm]
2016-01-15 14:58:33.721 b.s.d.executor [INFO] Processing received message FOR 3 TUPLE: source: word-reader:4, stream: default, id: {-4568501325903703450=4968173464740562826}, [great]
2016-01-15 14:58:33.721 b.s.d.executor [INFO] Execute done TUPLE source: word-normalizer:3, stream: __ack_ack, id: {}, [3019472566015270743 -154565087412977691] TASK: 1 DELTA:
2016-01-15 14:58:33.721 b.s.d.task [INFO] Emitting: word-counter default [storm, {but=1, very=1, storm=3, test=1, application=1, are=1, is=1, simple=1, powerfull=1, great=1, an=1, really=1}]
2016-01-15 14:58:33.722 b.s.d.task [INFO] Emitting: word-normalizer default [great]
2016-01-15 14:58:33.722 b.s.d.executor [INFO] Processing received message FOR 1 TUPLE: source: word-counter:2, stream: __ack_ack, id: {}, [836664335768127530 -4084171163148490794]
2016-01-15 14:58:33.722 b.s.d.task [INFO] Emitting: word-counter __ack_ack [-5311889501273724839 7333356645800650177]
2016-01-15 14:58:33.722 b.s.d.executor [INFO] TRANSFERING tuple TASK: 2 TUPLE: source: word-normalizer:3, stream: default, id: {-4568501325903703450=6632671953480721225}, [great]
2016-01-15 14:58:33.722 b.s.d.task [INFO] Emitting direct: 4; __acker __ack_ack [836664335768127530]
2016-01-15 14:58:33.722 b.s.d.executor [INFO] TRANSFERING tuple TASK: 1 TUPLE: source: word-counter:2, stream: __ack_ack, id: {}, [-5311889501273724839 7333356645800650177]
2016-01-15 14:58:33.722 b.s.d.task [INFO] Emitting: word-normalizer __ack_ack [-4568501325903703450 1799614049722836163]
2016-01-15 14:58:33.722 b.s.d.executor [INFO] TRANSFERING tuple TASK: 4 TUPLE: source: __acker:1, stream: __ack_ack, id: {}, [836664335768127530]
2016-01-15 14:58:33.722 b.s.d.executor [INFO] BOLT ack TASK: 2 TIME: TUPLE: source: word-normalizer:3, stream: default, id: {-5311889501273724839=7333356645800650177}, [storm]
2016-01-15 14:58:33.722 b.s.d.executor [INFO] Execute done TUPLE source: word-normalizer:3, stream: default, id: {-5311889501273724839=7333356645800650177}, [storm] TASK: 2 DELTA:
2016-01-15 14:58:33.722 b.s.d.executor [INFO] TRANSFERING tuple TASK: 1 TUPLE: source: word-normalizer:3, stream: __ack_ack, id: {}, [-4568501325903703450 1799614049722836163]
2016-01-15 14:58:33.722 b.s.d.executor [INFO] BOLT ack TASK: 1 TIME: TUPLE: source: word-counter:2, stream: __ack_ack, id: {}, [836664335768127530 -4084171163148490794]
2016-01-15 14:58:33.722 b.s.d.executor [INFO] Processing received message FOR 2 TUPLE: source: word-normalizer:3, stream: default, id: {-4210604260192247499=-9210764837221504154}, [is]
2016-01-15 14:58:33.722 b.s.d.executor [INFO] BOLT ack TASK: 3 TIME: TUPLE: source: word-reader:4, stream: default, id: {-4568501325903703450=4968173464740562826}, [great]
2016-01-15 14:58:33.723 b.s.d.executor [INFO] Execute done TUPLE source: word-counter:2, stream: __ack_ack, id: {}, [836664335768127530 -4084171163148490794] TASK: 1 DELTA:
2016-01-15 14:58:33.723 b.s.d.task [INFO] Emitting: word-counter default [is, {but=1, very=1, storm=3, test=1, application=1, are=1, is=2, simple=1, powerfull=1, great=1, an=1, really=1}]
2016-01-15 14:58:33.723 b.s.d.executor [INFO] Execute done TUPLE source: word-reader:4, stream: default, id: {-4568501325903703450=4968173464740562826}, [great] TASK: 3 DELTA:
2016-01-15 14:58:33.723 b.s.d.executor [INFO] Processing received message FOR 1 TUPLE: source: word-normalizer:3, stream: __ack_ack, id: {}, [3476732415982803994 -1723989740179582107]
2016-01-15 14:58:33.723 b.s.d.task [INFO] Emitting: word-counter __ack_ack [-4210604260192247499 -9210764837221504154]
2016-01-15 14:58:33.723 b.s.d.executor [INFO] TRANSFERING tuple TASK: 1 TUPLE: source: word-counter:2, stream: __ack_ack, id: {}, [-4210604260192247499 -9210764837221504154]
2016-01-15 14:58:33.723 b.s.d.executor [INFO] BOLT ack TASK: 1 TIME: TUPLE: source: word-normalizer:3, stream: __ack_ack, id: {}, [3476732415982803994 -1723989740179582107]
2016-01-15 14:58:33.723 b.s.d.executor [INFO] BOLT ack TASK: 2 TIME: TUPLE: source: word-normalizer:3, stream: default, id: {-4210604260192247499=-9210764837221504154}, [is]
2016-01-15 14:58:33.723 b.s.d.executor [INFO] Execute done TUPLE source: word-normalizer:3, stream: __ack_ack, id: {}, [3476732415982803994 -1723989740179582107] TASK: 1 DELTA:
2016-01-15 14:58:33.723 b.s.d.executor [INFO] Execute done TUPLE source: word-normalizer:3, stream: default, id: {-4210604260192247499=-9210764837221504154}, [is] TASK: 2 DELTA:
2016-01-15 14:58:33.724 b.s.d.executor [INFO] Processing received message FOR 2 TUPLE: source: word-normalizer:3, stream: default, id: {-4568501325903703450=6632671953480721225}, [great]
2016-01-15 14:58:33.724 b.s.d.executor [INFO] Processing received message FOR 1 TUPLE: source: word-counter:2, stream: __ack_ack, id: {}, [3019472566015270743 3194708398529701619]
2016-01-15 14:58:33.724 b.s.d.task [INFO] Emitting: word-counter default [great, {but=1, very=1, storm=3, test=1, application=1, are=1, is=2, simple=1, powerfull=1, great=2, an=1, really=1}]
2016-01-15 14:58:33.724 b.s.d.task [INFO] Emitting: word-counter __ack_ack [-4568501325903703450 6632671953480721225]
2016-01-15 14:58:33.724 b.s.d.task [INFO] Emitting direct: 4; __acker __ack_ack [3019472566015270743]
... View more
01-18-2016
06:59 AM
Following is my spout code which reads words @Artem Ervits public class WordReader extends BaseRichSpout
{
private SpoutOutputCollector collector;
private FileReader fileReader;
private boolean completed = false;
public void ack(Object msgId) {
System.out.println("OK:"+msgId);
}
public void close() {}
public void fail(Object msgId) {
System.out.println("FAIL:"+msgId);
}
/**
* The only thing that the methods will do It is emit each
* file line
*/
public void nextTuple() {
/**
* The nextuple it is called forever, so if we have been readed the file
* we will wait and then return
*/
if(completed){
try {
Thread.sleep(1000);
} catch (InterruptedException e) {
//Do nothing
}
return;
}
String str;
//Open the reader
BufferedReader reader = new BufferedReader(fileReader);
try{
//Read all lines
while((str = reader.readLine()) != null){
/**
* By each line emmit a new value with the line as a their
*/
this.collector.emit(new Values(str),str);
}
}catch(Exception e){
throw new RuntimeException("Error reading tuple",e);
}finally{
completed = true;
}
}
/**
* We will create the file and get the collector object
*/
public void open(Map conf, TopologyContext context,
SpoutOutputCollector collector) {
try {
this.fileReader = new FileReader(conf.get("wordsFile").toString());
} catch (FileNotFoundException e) {
throw new RuntimeException("Error reading file ["+conf.get("wordFile")+"]");
}
this.collector = collector;
}
/**
* Declare the output field "word"
*/
public void declareOutputFields(OutputFieldsDeclarer declarer) {
declarer.declare(new Fields("line"));
}
}
... View more
01-14-2016
07:24 AM
@bsaini @Artem Ervits @Neeraj Sabharwal @Kit Menke This is my code where I am submitting my Topology....Above this I have also submitted the code for the Bolts namely WordCounter & WordNormalizer....what do I need to do in these bolts ?? Thank You public class Program
{
public static void main(String[] args)
{
//Configuration
Config conf = new Config();
conf.put("wordsFile", args[0]);
conf.setDebug(true);
TopologyBuilder builder = new TopologyBuilder();
builder.setSpout("word-reader",new WordReader());
builder.setBolt("word-normalizer", new WordNormalizer())
.shuffleGrouping("word-reader");
builder.setBolt("word-counter", new WordCounter(),1)
.fieldsGrouping("word-normalizer", new Fields("word"));
try {
StormSubmitter.submitTopology("Storm Word Count", conf,builder.createTopology());
} catch (AlreadyAliveException e1) {
// TODO Auto-generated catch block
e1.printStackTrace();
} catch (InvalidTopologyException e1) {
// TODO Auto-generated catch block
e1.printStackTrace();
} catch (AuthorizationException e1) {
// TODO Auto-generated catch block
e1.printStackTrace();
}
try {
Thread.sleep(1000);
} catch (InterruptedException e) {
// TODO Auto-generated catch block
e.printStackTrace();
}
}
}
... View more
01-14-2016
07:23 AM
This is my code for WordCounter Bolt
public class WordCounter extends BaseBasicBolt
{
Integer id;
String name;
Map<String, Integer> counters;
private static final Logger LOG = LoggerFactory.getLogger(WordCounter.class);
/**
* At the end of the spout (when the cluster is shutdown
* We will show the word counters
*/
@Override
public void cleanup() {
System.out.println("-- Word Counter ["+name+"-"+id+"] --");
for(Map.Entry<String, Integer> entry : counters.entrySet()){
System.out.println("Count for word :: "+entry.getKey()+ " is :: "+entry.getValue());
LOG.info("Count for "+entry.getKey() +" is :"+entry.getValue());
}
}
/**
* On create
*/
@Override
public void prepare(Map stormConf, TopologyContext context) {
this.counters = new HashMap<String, Integer>();
this.name = context.getThisComponentId();
this.id = context.getThisTaskId();
}
//@Override
public void declareOutputFields(OutputFieldsDeclarer declarer) {}
//@Override
public void execute(Tuple input, BasicOutputCollector collector) {
String str = input.getString(0);
/**
* If the word dosn't exist in the map we will create
* this, if not We will add 1
*/
if(!counters.containsKey(str)){
counters.put(str, 1);
}else{
Integer c = counters.get(str) + 1;
counters.put(str, c);
}
}
}
... View more
01-14-2016
07:22 AM
This is my code for WordNormalizer Bolt
public class WordNormalizer extends BaseBasicBolt
{
public void cleanup() {}
/**
* The bolt will receive the line from the
* words file and process it to Normalize this line
*
* The normalize will be put the words in lower case
* and split the line to get all words in this
*/
public void execute(Tuple input, BasicOutputCollector collector) {
String sentence = input.getString(0);
String[] words = sentence.split(" ");
for(String word : words){
word = word.trim();
if(!word.isEmpty()){
word = word.toLowerCase();
collector.emit(new Values(word));
}
}
}
/**
* The bolt will only emit the field "word"
*/
public void declareOutputFields(OutputFieldsDeclarer declarer) {
declarer.declare(new Fields("word"));
}
}
... View more
01-14-2016
07:20 AM
@Artem Ervits : I am using 2 bolts WordNormalizer & WordCounter where WordCounter does the final job of counting the words present in input text file
... View more
01-14-2016
07:18 AM
@bsaini : The bolt is just writing it to sysout & also I have enable Loggers so with sysout,I am also using Loggers (slf4j)....In the logs of my application (Storm Word Count-3-1452753765-worker-6700.log) I do see which words have been emitted but I don`t see their count anywhere.....
... View more
01-13-2016
01:20 PM
Hello, I am newbie to Storm...I just executed a simple Word Count program in Storm using StormSubmitter ...I had set the debugging property to "true" ....But where do I get the output of my Word Count program ?? And is there any specific that you will see the output only after terminating Storm cluster or killing the topology?? Thank You
... View more
Labels:
01-04-2016
09:09 AM
@Neeraj Sabharwal :Can you please specify or mention how should my oozie-site.xml & core-site.xml be ?? Do I need to make any changes in oozie-site.xml for Falcon ??
... View more
12-24-2015
09:30 AM
Hello I am new to Apache Falcon & I am mirroring a dataset as shown here Mirroring Dataset between Hadoop Clusters using Apache Falcon ...... I saw the logs of Apache Falcon in "falcon.application.log" & it is throwing this exception :: org.apache.falcon.FalconException: Entity schedule failed for PROCESS: MirrorTest
at org.apache.falcon.resource.AbstractSchedulableEntityManager.scheduleInternal(AbstractSchedulableEntityManager.java:96)
at org.apache.falcon.resource.AbstractSchedulableEntityManager.schedule(AbstractSchedulableEntityManager.java:73)
at org.apache.falcon.resource.SchedulableEntityManager.schedule(SchedulableEntityManager.java:131)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at org.apache.falcon.resource.channel.IPCChannel.invoke(IPCChannel.java:49)
at org.apache.falcon.resource.proxy.SchedulableEntityManagerProxy$9.doExecute(SchedulableEntityManagerProxy.java:403)
at org.apache.falcon.resource.proxy.SchedulableEntityManagerProxy$EntityProxy.execute(SchedulableEntityManagerProxy.java:575)
at org.apache.falcon.resource.proxy.SchedulableEntityManagerProxy.schedule_aroundBody12(SchedulableEntityManagerProxy.java:405)
at org.apache.falcon.resource.proxy.SchedulableEntityManagerProxy$AjcClosure13.run(SchedulableEntityManagerProxy.java:1)
at org.aspectj.runtime.reflect.JoinPointImpl.proceed(JoinPointImpl.java:149)
at org.apache.falcon.aspect.AbstractFalconAspect.logAroundMonitored(AbstractFalconAspect.java:51)
at org.apache.falcon.resource.proxy.SchedulableEntityManagerProxy.schedule(SchedulableEntityManagerProxy.java:388)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at com.sun.jersey.spi.container.JavaMethodInvokerFactory$1.invoke(JavaMethodInvokerFactory.java:60)
at com.sun.jersey.server.impl.model.method.dispatch.AbstractResourceMethodDispatchProvider$TypeOutInvoker._dispatch(AbstractResourceMethodDispatchProvider.java:185)
at com.sun.jersey.server.impl.model.method.dispatch.ResourceJavaMethodDispatcher.dispatch(ResourceJavaMethodDispatcher.java:75)
at com.sun.jersey.server.impl.uri.rules.HttpMethodRule.accept(HttpMethodRule.java:288)
at com.sun.jersey.server.impl.uri.rules.RightHandPathRule.accept(RightHandPathRule.java:147)
at com.sun.jersey.server.impl.uri.rules.ResourceClassRule.accept(ResourceClassRule.java:108)
at com.sun.jersey.server.impl.uri.rules.RightHandPathRule.accept(RightHandPathRule.java:147)
at com.sun.jersey.server.impl.uri.rules.RootResourceClassesRule.accept(RootResourceClassesRule.java:84)
at com.sun.jersey.server.impl.application.WebApplicationImpl._handleRequest(WebApplicationImpl.java:1469)
at com.sun.jersey.server.impl.application.WebApplicationImpl._handleRequest(WebApplicationImpl.java:1400)
at com.sun.jersey.server.impl.application.WebApplicationImpl.handleRequest(WebApplicationImpl.java:1349)
at com.sun.jersey.server.impl.application.WebApplicationImpl.handleRequest(WebApplicationImpl.java:1339)
at com.sun.jersey.spi.container.servlet.WebComponent.service(WebComponent.java:416)
at com.sun.jersey.spi.container.servlet.ServletContainer.service(ServletContainer.java:537)
at com.sun.jersey.spi.container.servlet.ServletContainer.service(ServletContainer.java:699)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:820)
at org.mortbay.jetty.servlet.ServletHolder.handle(ServletHolder.java:511)
at org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1221)
at org.apache.falcon.security.FalconAuthorizationFilter.doFilter(FalconAuthorizationFilter.java:106)
at org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212)
at org.apache.falcon.security.FalconAuthenticationFilter$2.doFilter(FalconAuthenticationFilter.java:184)
at org.apache.hadoop.security.authentication.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:595)
at org.apache.hadoop.security.authentication.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:554)
at org.apache.falcon.security.FalconAuthenticationFilter.doFilter(FalconAuthenticationFilter.java:193)
at org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212)
at org.apache.falcon.security.FalconAuditFilter.doFilter(FalconAuditFilter.java:64)
at org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212)
at org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:399)
at org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216)
at org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182)
at org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:767)
at org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:450)
at org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
at org.mortbay.jetty.Server.handle(Server.java:326)
at org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:542)
at org.mortbay.jetty.HttpConnection$RequestHandler.headerComplete(HttpConnection.java:928)
at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:549)
at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:212)
at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404)
at org.mortbay.jetty.bio.SocketConnector$Connection.run(SocketConnector.java:228)
at org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582)
Caused by: org.apache.falcon.FalconException: E0501 : E0501: Could not perform authorization operation, Unauthorized connection for super-user: oozie
at org.apache.falcon.workflow.engine.OozieWorkflowEngine.dryRunInternal(OozieWorkflowEngine.java:234)
at org.apache.falcon.workflow.engine.OozieWorkflowEngine.schedule(OozieWorkflowEngine.java:172)
at org.apache.falcon.resource.AbstractSchedulableEntityManager.scheduleInternal(AbstractSchedulableEntityManager.java:94)
Am I missing any configuration for oozie or falcon in any configuration files ?? And also how should we deal with this following exception ??
... View more
Labels:
12-24-2015
08:56 AM
My falcon.application.log file shows the following exception : Caused by: org.apache.falcon.FalconException: E0501 : E0501: Could not perform authorization operation, Unauthorized connection for super-user: oozie from IP 52.8.144.45
at org.apache.falcon.workflow.engine.OozieWorkflowEngine.dryRunInternal(OozieWorkflowEngine.java:234)
at org.apache.falcon.workflow.engine.OozieWorkflowEngine.schedule(OozieWorkflowEngine.java:172)
at org.apache.falcon.resource.AbstractSchedulableEntityManager.scheduleInternal(AbstractSchedulableEntityManager.java:94)
What & How to configure oozie for falcon ??
... View more
