Cloudera Community

Support Questions

Find answers, ask questions, and share your expertise
cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Show  only  | Search instead for 
Did you mean: 
Advanced Search

Who agreed with this topic

java.lang.RuntimeException: native-lzo library not available Error on CDH 5.3 with Spark 1.2

avatar
author-rank dalbrecht
New Contributor

Created on ‎01-08-2015 12:35 PM - edited ‎09-16-2022 02:18 AM

I'm unable to get Spark to work with the LZO parcel on 5.3.

 

I've attempted the steps outlined here:

http://hsiamin.com/posts/2014/05/03/enable-lzo-compression-on-hadoop-pig-and-spark/

 

I have also verified that the path to the HADOOP_LZO parcel for both lib and native is listed in the java.library.path (As listed on the Spark Application WEB UI for failed submissions).

 

Any advice would be greatly appreciated. 

8,373
0 Kudos
1
Who agreed with this topic