Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here. Want to know more about what has changed? Check out the Community News blog.

Run Oryx on a machine that is not part of the cluster

SOLVED Go to solution

Re: Run Oryx on a machine that is not part of the cluster

Master Collaborator

Right, I forgot to mention that part: you need the cluster's binaries too, like ZK, HDFS, YARN, Spark, etc. It is using the cluster's distribution. 

As you can see, it's definitely intended to be run on a cluster edge node, so I'd strongly suggest running it that way.

Re: Run Oryx on a machine that is not part of the cluster

New Contributor

Hi, JasonChen.

You have to copy /opt/cloudera/CDH/jars , /etc/hadoop from a node of cluster to your machine runing oryx2.

I had tried a few ways to run it outside the cluster, but all failed.

The node running oryx2 had to be runed inside cluster.

My conclusion is that , CDH maybe requrie the same parcels version and cloudera agent on node to use the cluster resources.

 

 

Re: Run Oryx on a machine that is not part of the cluster

Master Collaborator

There shouldn't be any other dependencies. If the error is like what you showed before, it's just firewall/port config problems.

Highlighted

Re: Run Oryx on a machine that is not part of the cluster

New Contributor
Actually, I don't know the exact reasons and had stuck in this problem for a few day with firewalls on all machines disabled at very first.
I used to deploy hadoop, spark and so on by extracting source tarballs. Forturnately, edge node seems to be a good idea to acess cluster resources.