Community Articles
Find and share helpful community-sourced technical articles
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.
Labels (2)

Driven first-hand experience:

While researching for a Hive Query Metrics UI found this tool called driven.

Step1:

Register for a free trial at http://www.driven.io/hive/

5516-d1.jpg

Step2:

Upon clicking the verification link sent over email came to this page:

5517-d2.jpg

Click on “Install the Driven Agent”

Step3:

On clicking that two things will happen:

  • You will be taken to the configuration and install instructions
  • You will get an email with username and password

5518-d3.jpg

Step4:

Click on https://trial.driven.io/index.html#/apps from screenshot 2

You will be in the login screen. Then enter the id and password you got in your email.

5519-d4.jpg

Step5:

After logging in you will prompted to change the password. Change that and click submit.

5520-d5.jpg

Step6:

You will be logged into the user interface. But since the agent is not installed you cannot view anything. You will be also provided with your API Key.

5531-d6.jpg

Step7:

Hive is installed in the cluster in a node named hiveserver. Am going to install driven agent over there.

5532-d7.jpg

5533-d8.jpg

From a terminal/shell, execute the following commands.

 # latest Hive agent bundle
 > wget -i
http://files.concurrentinc.com/driven/2.1/driven-agent/latest-driven-agent-hive-bundle.txt
 # latest MapReduce agent bundle
 > wget -i http://files.concurrentinc.com/driven/2.1/driven-agent/latest-driven-agent-mr-bundle.txt

After execution you will see the below jars:

5535-d9.jpg

Step8:

Now you need to export the configurations for the user you want "driven" to run:

For Mapreduce 2.x

export YARN_CLIENT_OPTS="-javaagent:/ path/to/driven-agent-mr-<version>.jar=drivenHosts=<driven host>;drivenAPIkey=<driven api key>"

So my export becomes: export YARN_CLIENT_OPTS="-javaagent:/ sbin/driven-agent/driven-agent-mr-2.2.2.jar=drivenHosts=https://trial.driven.io;drivenAPIkey=<mykey>"

**Substitute value of my key For Hive on Tez/MR export HADOOP_OPTS="-javaagent:/path/ to/driven-agent-hive-<version>.jar=drivenHosts=<driven host>;drivenAPIkey=<driven api key>" export HADOOP_OPTS="-javaagent:/sbin/ driven-agent/driven-agent-hive-2.2.2.jar=drivenHosts=https://trial.driven.io;drivenAPIkey=<mykey>"

**Substitute value of my key

I have a user called storm setup in my cluster.

 su – storm
 export
YARN_CLIENT_OPTS="-javaagent:/
 sbin/driven-agent/driven-agent-mr-2.2.2.jar=drivenHosts=https://trial.driven.io;drivenAPIkey=<mykey>"
 export
HADOOP_OPTS="-javaagent:/sbin/
 driven-agent/driven-agent-hive-2.2.2.jar=drivenHosts=https://trial.driven.io;drivenAPIkey=<mykey>"

Step9:

Run a program

5536-d11.jpg

Step10:

Refresh https://trial.driven.io/index.html#/apps and the user interface will start populating

5537-d12.jpg

5538-d13.jpg

5539-d14.jpg

Now that we have successfully setup driven, we will explore the hive metrics user interface in part2 !!!


d1.jpg
669 Views
Don't have an account?
Coming from Hortonworks? Activate your account here
Version history
Revision #:
2 of 2
Last update:
‎08-17-2019 11:39 AM
Updated by:
 
Contributors
Top Kudoed Authors