Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Apache Spark - Error - Unable to load native-hadoop library

Solved Go to solution
Highlighted

Apache Spark - Error - Unable to load native-hadoop library

Rising Star
Below is what i get when I initiate spark-shell. Can the warning below ignored ?

[root@hdp-m hdfs]# spark-shell
16/02/27 01:52:04 WARN NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Welcome to
      ____              __
     / __/__  ___ _____/ /__
    _\ \/ _ \/ _ `/ __/  '_/
   /___/ .__/\_,_/_/ /_/\_\   version 1.5.2
      /_/


Using Scala version 2.10.4 (Java HotSpot(TM) 64-Bit Server VM, Java 1.8.0_60)
Type in expressions to have them evaluated.
Type :help for more information.
16/02/27 01:52:17 WARN MetricsSystem: Using default name DAGScheduler for source because spark.app.id is not set.
Spark context available as sc.
16/02/27 01:52:25 WARN DomainSocketFactory: The short-circuit local reads feature cannot be used because libhadoop cannot be loaded.
16/02/27 01:52:27 WARN NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
16/02/27 01:52:28 WARN DomainSocketFactory: The short-circuit local reads feature cannot be used because libhadoop cannot be loaded.
SQL context available as sqlContext.


1 ACCEPTED SOLUTION

Accepted Solutions
Highlighted

Re: Apache Spark - Error - Unable to load native-hadoop library

@Prakash Punj Yes, you can ignore that warning

View solution in original post

2 REPLIES 2
Highlighted

Re: Apache Spark - Error - Unable to load native-hadoop library

@Prakash Punj Yes, you can ignore that warning

View solution in original post

Highlighted

Re: Apache Spark - Error - Unable to load native-hadoop library

Don't have an account?
Coming from Hortonworks? Activate your account here