Member since
06-09-2016
185
Posts
22
Kudos Received
5
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
2161 | 04-21-2017 07:57 AM | |
1349 | 04-18-2017 07:07 AM | |
3192 | 02-27-2017 05:41 AM | |
890 | 12-09-2016 11:05 AM | |
1254 | 11-24-2016 11:20 AM |
05-04-2017
04:59 AM
Thanks @Alejandro Fernandez It will be great if you could share what technology/language it uses underline, if any. also custom ambari-services. How are those built.
... View more
04-25-2017
04:42 AM
Thanks @Matt Clarke - so if I pick one large file and write to hdfs - it will create 1 flowfile in content repository and will keep it for some duration until we clean it, same with one SQL read writing into nifi.
... View more
04-21-2017
07:57 AM
I deleted this directory under /stormdist - and the error went away
... View more
04-18-2017
07:07 AM
This issue got resolved by using maven-shade-plugin as mentioned here http://storm.apache.org/releases/0.10.0/storm-hdfs.html
... View more
04-17-2017
10:02 AM
HI All, while trying the twitter example on storm - getting this error I am using 1.0.1 on hdp2.5 I compiled the classes with 1.0.1 for storm-core and storm-hdfs also provided exclusion for hadoop-hdfs and hadoop-client in pom.xml 2017-04-17 09:52:33.863 STDERR [INFO] WARNING: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2017-04-17 09:52:34.408 o.a.s.h.b.HdfsBolt [INFO] Preparing HDFS Bolt...
2017-04-17 09:52:34.586 o.a.s.util [ERROR] Async loop died!
java.lang.RuntimeException: Error preparing HdfsBolt: No FileSystem for scheme: hdfs
at org.apache.storm.hdfs.bolt.AbstractHdfsBolt.prepare(AbstractHdfsBolt.java:123) ~[stormjar.jar:?]
at org.apache.storm.daemon.executor$fn__6573$fn__6586.invoke(executor.clj:798) ~[storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37]
at org.apache.storm.util$async_loop$fn__554.invoke(util.clj:482) [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37]
at clojure.lang.AFn.run(AFn.java:22) [clojure-1.7.0.jar:?]
at java.lang.Thread.run(Thread.java:745) [?:1.8.0_101] pls let me know if any other information required. Thanks, Avijeet
... View more
Labels:
- Labels:
-
Apache Hadoop
-
Apache Storm
04-17-2017
06:24 AM
Hi, I tried to run the Wordcount example storm-starter-0.0.1-storm-0.9.0.1.jar on storm in hdp2.5 The supervisor keeps going down and doesn't run giving below errro java.io.FileNotFoundException: File '/datadrive/hadoop/storm/supervisor/stormdist/WordCount-2-1491988512/stormconf.ser' does not exist
at org.apache.storm.shade.org.apache.commons.io.FileUtils.openInputStream(FileUtils.java:292) I killed the topology still, same error persisits. pls suggest. Thanks, Avijeet
... View more
Labels:
- Labels:
-
Apache Storm
04-13-2017
08:14 AM
1 Kudo
What error it throws? Thanks.
... View more
04-13-2017
08:03 AM
1 Kudo
Hi All, what would be the side effects of doing batch ingestion through nifi. Lets say large files copies, if we ingest through nifi, how would it behave? same with large db copies. Thanks, Avijeet
... View more
Labels:
- Labels:
-
Apache NiFi
04-12-2017
09:30 AM
Hi All, by default hive-atlas integration is enabled when we set up HDP2.5. And this integration needs kafka, hbase etc. as a side effect Is there a way to enable / disable this integration easily. Thanks, Avijeet
... View more
Labels:
- Labels:
-
Apache Hive
04-12-2017
09:08 AM
Hi All, With all the DevOps tools available (Docker, swram, kubernetes, Ansible, Puppet, Chef etc.) around configuration management, cluster management, container clustering etc. I was wondering where does Amabri fits in, how is it developed? What about Ambari blue prints? Thanks, Avijeet
... View more
Labels:
- Labels:
-
Apache Ambari