Support Questions
Find answers, ask questions, and share your expertise

Phoenix bulk load unable to load native hadoop libraries

Super Guru

I am using phoenix bulk load command

/usr/hdp/2*/phoenix/bin/psql.py -t AIRLINE 2007.csv

When I kick it off I get warning:

SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/usr/hdp/2.5.0.0-1245/phoenix/phoenix-4.7.0.2.5.0.0-1245-client.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/usr/hdp/2.5.0.0-1245/hadoop/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
16/10/13 19:32:02 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
16/10/13 19:32:03 WARN shortcircuit.DomainSocketFactory: The short-circuit local reads feature cannot be used because libhadoop cannot be loaded.
csv columns from database.


Why is it unable to find libhadoop for short-circuit local reads? I am using hdp2.5

1 REPLY 1

Re: Phoenix bulk load unable to load native hadoop libraries

Super Collaborator

The reason is because by default native directory is not included into ld library path.

try to run

LD_LIBRARY_PATH=/usr/hdp/2.5.x/hadoop/lib/native psql.py