question Re: Metron profiler client unbale to load native hadoop library in Archives of Support Questions (Read Only)

Metron profiler client unbale to load native hadoop library

giri_narasimha_ — Mon, 02 Oct 2017 21:37:15 GMT

Getting below Warnings when trying to read profile data from profiler client.

2017-10-02 14:30:15,502 WARN [AeshProcess: 1] util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2017-10-02 14:30:15,571 INFO [AeshProcess: 1] zookeeper.RecoverableZooKeeper: Process identifier=hconnection-0x575cabfa connecting to ZooKeeper ensemble=node1.c.academic-torch-179005.internal:2181
2017-10-02 14:30:16,069 WARN [AeshProcess: 1] shortcircuit.DomainSocketFactory: The short-circuit local reads feature cannot be used because libhadoop cannot be loaded.

Need help to resolve this. Thanks

Re: Metron profiler client unbale to load native hadoop library

jknulst — Tue, 03 Oct 2017 18:52:37 GMT

Hi Girish,

First of all this is a benign warning, it does not impact Hadoop / Metron functionality at all. You should not bother too much about it. It can be solved however if you edit HADOOP_OPTS this way:

export HADOOP_OPTS="$HADOOP_OPTS -Djava.library.path=$HADOOP_HOME/lib/native"

Re: Metron profiler client unbale to load native hadoop library

giri_narasimha_ — Tue, 03 Oct 2017 19:15:03 GMT

Thanks @Jasper , will check it

Re: Metron profiler client unbale to load native hadoop library

Dima_Kovalyov — Thu, 05 Oct 2017 23:50:07 GMT

Thank you Jasper,

I have set it like this in command-line:

export HADOOP_OPTS="$HADOOP_OPTS -Djava.library.path=/usr/hdp/current/hadoop-client/lib/native"

And then I ran:

/usr/metron/0.4.1/bin/stellar -z krishna-3:2181

but still received same warn. Can you please advise?