Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

HiBench unbound variable error

Highlighted

HiBench unbound variable error

Explorer

I

try to use HiBench benchmarking tool. I have set all the requested variables related to its github repo readme file. I got following error message:

./workloads/wordcount/prepare/prepare.sh: line 25: INPUT_HDFS: unbound variable

conf/99-user_defined_properties.conf looks like this:

# Hadoop home
hibench.hadoop.home<---><------>/opt/cloudera/parcels/CDH/bin/hadoop

# Spark home
hibench.spark.home<----><------>/opt/cloudera/parcels/CDH/bin/spark-shell

# HDFS master, set according to hdfs-site.xml
hibench.hdfs.master<---><------>hdfs://172.20.16.133:50470

# Spark master
#   standalone mode: `spark://xxx:7077`
#   YARN mode: `yarn-client`
#   unset: fallback to `local[1]`
hibench.spark.master<--><------>yarn-client
2 REPLIES 2
Highlighted

Re: HiBench unbound variable error

Master Guru
HiBench isn't something Cloudera ships or maintains, so it may be better to ask this to the HiBench community.

I took a cursory look at their script implementation and the issue seems to be that HiBench expects tarball-like home directories and paths, and will not work with CDH packages or parcels.

You can try passing it extracted tarball locations, by obtaining tarballs from http://archive.cloudera.com/cdh5/cdh/5/

P.s. The line you've quoted (INPUT_HDFS) is a post-error line. The real error would lie much above that one and is the one you need to solve to fix the issue.

Re: HiBench unbound variable error

Explorer

Is there maybe an official tool for similar reasons?

Don't have an account?
Coming from Hortonworks? Activate your account here