Reply
New Contributor
Posts: 2
Registered: ‎05-11-2014

where can I get the packages of impala-lzo & hadoop-lzo for CDH50.0.1 & redhat 6.4 (64-bit)?

when I query a lzo table (eg., select coun(*) from lzo_table) in impala (1.3.1), I got the error below:

 

ERRORS: Impala LZO library was built against Impala version 1.3.1-cdh4, but the running Impala version is 1.3.1-cdh5
Error loading impala-lzo library. Check that the impala-lzo library is at version 1.3.1-cdh5


1. create lzo_table:
hive -e "SET mapreduce.output.fileoutputformat.compress.codec=com.hadoop.compression.lzo.LzopCodec;SET hive.exec.compress.output=true;SET mapreduce.output.fileoutputformat.compress=true; CREATE TABLE (...) partitioned BY (...)
STORED AS INPUTFORMAT 'com.hadoop.mapred.DeprecatedLzoTextInputFormat' OUTPUTFORMAT
'org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat';"

 

2. load data:
hive -e "INSERT INTO TABLE lzo_table PARTITION (...) SELECT * FROM text_table;"

 

3. creating the lzo index:
hadoop jar /usr/lib/hadoop/lib/hadoop-lzo-cdh4-0.4.15-gplextras.jar com.hadoop.compression.lzo.LzoIndexer /user/hive/warehouse/zo_table;

 

Highlighted
Cloudera Employee
Posts: 27
Registered: ‎09-27-2013

Re: where can I get the packages of impala-lzo & hadoop-lzo for CDH50.0.1 & redhat 6.4 (64-

Announcements