Member since
06-15-2017
11
Posts
1
Kudos Received
0
Solutions
07-21-2017
08:41 AM
Hello ,It is possible to connect storm to hbase installed in another machine ?
... View more
07-13-2017
02:04 PM
Hello, I created a storm topology with pyleus to bring data from kafka, but data is not processed from spout to bolt , so to verify can anyone give an example of a storm topology (file.yaml ) Thank you
... View more
07-13-2017
10:54 AM
Hello, I created a storm topology with pyleus to bring data from kafka, but data is not processed from spout to bolt , so to verify can anyone give an example of a storm topology (file.yaml )
Thank you.
... View more
Labels:
07-13-2017
08:54 AM
Hello,
I have a problem in storm, i'm sure that the storm topology is correct because at first i can see the data streaming from spout to bolt , but after a few seconds an error of kind 'shutdown in progress' apppears and everything is stopped. Thank you for any help.
This is the error: java.lang.ExceptionInInitializerError at kafka.metrics.KafkaMetricsGroup$class.newTimer(KafkaMetricsGroup.scala:52) at kafka.consumer.FetchRequestAndResponseMetrics.newTimer(FetchRequestAndResponseStats.scala:25) at kafka.consumer.FetchRequestAndResponseMetrics.<init>(FetchRequestAndResponseStats.scala:26) at kafka.consumer.FetchRequestAndResponseStats.<init>(FetchRequestAndResponseStats.scala:37) at kafka.consumer.FetchRequestAndResponseStatsRegistry$anonfun$2.apply(FetchRequestAndResponseStats.scala:50) at kafka.consumer.FetchRequestAndResponseStatsRegistry$anonfun$2.apply(FetchRequestAndResponseStats.scala:50) at kafka.utils.Pool.getAndMaybePut(Pool.scala:61) at kafka.consumer.FetchRequestAndResponseStatsRegistry$.getFetchRequestAndResponseStats(FetchRequestAndResponseStats.scala:54) at kafka.consumer.SimpleConsumer.<init>(SimpleConsumer.scala:39) at kafka.javaapi.consumer.SimpleConsumer.<init>(SimpleConsumer.scala:34) at storm.kafka.DynamicPartitionConnections.register(DynamicPartitionConnections.java:60) at storm.kafka.PartitionManager.<init>(PartitionManager.java:64) at storm.kafka.ZkCoordinator.refresh(ZkCoordinator.java:98) at storm.kafka.ZkCoordinator.getMyManagedPartitions(ZkCoordinator.java:69) at storm.kafka.KafkaSpout.nextTuple(KafkaSpout.java:135) at org.apache.storm.daemon.executor$fn__5136$fn__5151$fn__5182.invoke(executor.clj:647) at org.apache.storm.util$async_loop$fn__553.invoke(util.clj:484) at clojure.lang.AFn.run(AFn.java:22) at java.lang.Thread.run(Thread.java:745) Caused by: java.lang.IllegalStateException: Shutdown in progress at java.lang.ApplicationShutdownHooks.add(ApplicationShutdownHooks.java:66) at java.lang.Runtime.addShutdownHook(Runtime.java:211) at com.yammer.metrics.Metrics.<clinit>(Metrics.java:21)
... View more
Labels:
07-13-2017
08:48 AM
Hello i think that you should complete reading all the error text, you will find a file in /tmp that you should give it more permission. (this file will be created after building your file.yaml ) after that everything will work.
... View more
07-10-2017
10:30 AM
hello, I have this error when i use storm with the framework "pyleus". java.lang.RuntimeException: Error when launching multilang subprocess Traceback (most recent call last): File "/usr/lib64/python2.7/runpy.py", line 162, in _run_module_as_main "__main__", fname,
... View more
Labels:
07-10-2017
10:00 AM
Hello everyone
I'm new in the domain of big data and i need your help
So, I'm using "pyleus" to count the number of words using storm but when i check my storm node i find that there is no topologie and the number of tasks and workers is always zero.
So can anyone tell me what is the problem please ?
... View more
Labels:
06-15-2017
12:18 PM
Thank you @Andres Koitmäe But according to this link storm and kafka will not be removed from HDP version 3.0.0
... View more
06-15-2017
11:57 AM
1 Kudo
Thank you. I understood from the last link that : HDF - is used to handle Data in Motion HDP - is used to handle Data at Rest But HDP contains storm (real time message processing) and Kafka ( distributed messaging system ). So can we say that HDP can be used also to handle data in motion ?
... View more
06-15-2017
10:43 AM
Hello,
I'm new in the domain of Big data and i want to know the main differences between HDF(Hortonworks Data Flow) and HDP (Hortonworks Data Platform). that's means the usecases and the architecture(components) of each one.
... View more
Labels: