Storm-hdfs - java.lang.RuntimeException: Error preparing HdfsBolt: No FileSystem for scheme: hdfs

avijeetd — Mon, 17 Apr 2017 17:02:10 GMT

HI All,

while trying the twitter example on storm - getting this error

I am using 1.0.1 on hdp2.5

I compiled the classes with 1.0.1 for storm-core and storm-hdfs

also provided exclusion for hadoop-hdfs and hadoop-client in pom.xml

2017-04-17 09:52:33.863 STDERR [INFO] WARNING: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2017-04-17 09:52:34.408 o.a.s.h.b.HdfsBolt [INFO] Preparing HDFS Bolt...
2017-04-17 09:52:34.586 o.a.s.util [ERROR] Async loop died!
java.lang.RuntimeException: Error preparing HdfsBolt: No FileSystem for scheme: hdfs
	at org.apache.storm.hdfs.bolt.AbstractHdfsBolt.prepare(AbstractHdfsBolt.java:123) ~[stormjar.jar:?]
	at org.apache.storm.daemon.executor$fn__6573$fn__6586.invoke(executor.clj:798) ~[storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37]
	at org.apache.storm.util$async_loop$fn__554.invoke(util.clj:482) [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37]
	at clojure.lang.AFn.run(AFn.java:22) [clojure-1.7.0.jar:?]
	at java.lang.Thread.run(Thread.java:745) [?:1.8.0_101]

pls let me know if any other information required.

Thanks,

Avijeet

Re: Storm-hdfs - java.lang.RuntimeException: Error preparing HdfsBolt: No FileSystem for scheme: hdfs

avijeetd — Tue, 18 Apr 2017 14:07:52 GMT

This issue got resolved by using maven-shade-plugin

as mentioned here http://storm.apache.org/releases/0.10.0/storm-hdfs.html

question Storm-hdfs - java.lang.RuntimeException: Error preparing HdfsBolt: No FileSystem for scheme: hdfs in Archives of Support Questions (Read Only)

Storm-hdfs - java.lang.RuntimeException: Error preparing HdfsBolt: No FileSystem for scheme: hdfs

Re: Storm-hdfs - java.lang.RuntimeException: Error preparing HdfsBolt: No FileSystem for scheme: hdfs