Support Questions

Find answers, ask questions, and share your expertise

Metron profiler client unbale to load native hadoop library

avatar

Getting below Warnings when trying to read profile data from profiler client.

2017-10-02 14:30:15,502 WARN [AeshProcess: 1] util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2017-10-02 14:30:15,571 INFO [AeshProcess: 1] zookeeper.RecoverableZooKeeper: Process identifier=hconnection-0x575cabfa connecting to ZooKeeper ensemble=node1.c.academic-torch-179005.internal:2181
2017-10-02 14:30:16,069 WARN [AeshProcess: 1] shortcircuit.DomainSocketFactory: The short-circuit local reads feature cannot be used because libhadoop cannot be loaded.

Need help to resolve this. Thanks

1 ACCEPTED SOLUTION

avatar
Super Collaborator

Hi Girish,

First of all this is a benign warning, it does not impact Hadoop / Metron functionality at all. You should not bother too much about it. It can be solved however if you edit HADOOP_OPTS this way:

export HADOOP_OPTS="$HADOOP_OPTS -Djava.library.path=$HADOOP_HOME/lib/native"

View solution in original post

3 REPLIES 3

avatar
Super Collaborator

Hi Girish,

First of all this is a benign warning, it does not impact Hadoop / Metron functionality at all. You should not bother too much about it. It can be solved however if you edit HADOOP_OPTS this way:

export HADOOP_OPTS="$HADOOP_OPTS -Djava.library.path=$HADOOP_HOME/lib/native"

avatar

Thank you Jasper,

I have set it like this in command-line:

export HADOOP_OPTS="$HADOOP_OPTS -Djava.library.path=/usr/hdp/current/hadoop-client/lib/native"

And then I ran:

/usr/metron/0.4.1/bin/stellar -z krishna-3:2181

but still received same warn. Can you please advise?

avatar

Thanks @Jasper , will check it