Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

HiBench unbound variable error

HiBench unbound variable error

Explorer

I

try to use HiBench benchmarking tool. I have set all the requested variables related to its github repo readme file. I got following error message:

./workloads/wordcount/prepare/prepare.sh: line 25: INPUT_HDFS: unbound variable

conf/99-user_defined_properties.conf looks like this:

# Hadoop home
hibench.hadoop.home<---><------>/opt/cloudera/parcels/CDH/bin/hadoop

# Spark home
hibench.spark.home<----><------>/opt/cloudera/parcels/CDH/bin/spark-shell

# HDFS master, set according to hdfs-site.xml
hibench.hdfs.master<---><------>hdfs://172.20.16.133:50470

# Spark master
#   standalone mode: `spark://xxx:7077`
#   YARN mode: `yarn-client`
#   unset: fallback to `local[1]`
hibench.spark.master<--><------>yarn-client
2 REPLIES 2
Highlighted

Re: HiBench unbound variable error

Master Guru
HiBench isn't something Cloudera ships or maintains, so it may be better to ask this to the HiBench community.

I took a cursory look at their script implementation and the issue seems to be that HiBench expects tarball-like home directories and paths, and will not work with CDH packages or parcels.

You can try passing it extracted tarball locations, by obtaining tarballs from http://archive.cloudera.com/cdh5/cdh/5/

P.s. The line you've quoted (INPUT_HDFS) is a post-error line. The real error would lie much above that one and is the one you need to solve to fix the issue.
Highlighted

Re: HiBench unbound variable error

Explorer

Is there maybe an official tool for similar reasons?

Don't have an account?
Coming from Hortonworks? Activate your account here