Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Edge node or utility node packages

Solved Go to solution
Highlighted

Edge node or utility node packages

New Contributor

Hello,

I need to plan a edge node or utility node to run hive jobs and few other standard jobs. What are the standard packages needed for client? I know it all depends on the jobs, but just wondering what are the base packages needed.

1 ACCEPTED SOLUTION

Accepted Solutions

Re: Edge node or utility node packages

Mentor

@Mokkan Mok

Edge nodes are the interface between the Hadoop cluster and the outside network. For this reason, at times referred to as gateway nodes. Most commonly, edge nodes are used to run client applications and cluster administration tools.

The edge node should be the access point to your cluster for your developers/data analysts. Usually, you install all the client software on the edge node some of them are listed below


  • MAPREDUCE2_CLIENT
  • HDFS_CLIENT
  • YARN_CLIENT
  • ZOOKEEPER_CLIENT
  • KERBEROS CLIENT
  • HIVE CLIENT
  • PIG CLIENT
  • SQOOP CLIENT
  • OOZIE CLIENT
  • FALCON CLIENT
  • INFRA SOLR CLIENT
  • ATLAS METADATA
  • SPARK2 CLIENT
  • SPARK CLIENT

With all the user's confined to the edge node securing the edge node is very important and easier to manage.

Hope that helps in your decision

2 REPLIES 2

Re: Edge node or utility node packages

Mentor

@Mokkan Mok

Edge nodes are the interface between the Hadoop cluster and the outside network. For this reason, at times referred to as gateway nodes. Most commonly, edge nodes are used to run client applications and cluster administration tools.

The edge node should be the access point to your cluster for your developers/data analysts. Usually, you install all the client software on the edge node some of them are listed below


  • MAPREDUCE2_CLIENT
  • HDFS_CLIENT
  • YARN_CLIENT
  • ZOOKEEPER_CLIENT
  • KERBEROS CLIENT
  • HIVE CLIENT
  • PIG CLIENT
  • SQOOP CLIENT
  • OOZIE CLIENT
  • FALCON CLIENT
  • INFRA SOLR CLIENT
  • ATLAS METADATA
  • SPARK2 CLIENT
  • SPARK CLIENT

With all the user's confined to the edge node securing the edge node is very important and easier to manage.

Hope that helps in your decision

Re: Edge node or utility node packages

New Contributor

Thank you very much, we are using centos we should be able to install using yum?