Support Questions

Find answers, ask questions, and share your expertise

Edge node or utility node packages

avatar
Explorer

Hello,

I need to plan a edge node or utility node to run hive jobs and few other standard jobs. What are the standard packages needed for client? I know it all depends on the jobs, but just wondering what are the base packages needed.

1 ACCEPTED SOLUTION

avatar
Master Mentor

@Mokkan Mok

Edge nodes are the interface between the Hadoop cluster and the outside network. For this reason, at times referred to as gateway nodes. Most commonly, edge nodes are used to run client applications and cluster administration tools.

The edge node should be the access point to your cluster for your developers/data analysts. Usually, you install all the client software on the edge node some of them are listed below


  • MAPREDUCE2_CLIENT
  • HDFS_CLIENT
  • YARN_CLIENT
  • ZOOKEEPER_CLIENT
  • KERBEROS CLIENT
  • HIVE CLIENT
  • PIG CLIENT
  • SQOOP CLIENT
  • OOZIE CLIENT
  • FALCON CLIENT
  • INFRA SOLR CLIENT
  • ATLAS METADATA
  • SPARK2 CLIENT
  • SPARK CLIENT

With all the user's confined to the edge node securing the edge node is very important and easier to manage.

Hope that helps in your decision

View solution in original post

2 REPLIES 2

avatar
Master Mentor

@Mokkan Mok

Edge nodes are the interface between the Hadoop cluster and the outside network. For this reason, at times referred to as gateway nodes. Most commonly, edge nodes are used to run client applications and cluster administration tools.

The edge node should be the access point to your cluster for your developers/data analysts. Usually, you install all the client software on the edge node some of them are listed below


  • MAPREDUCE2_CLIENT
  • HDFS_CLIENT
  • YARN_CLIENT
  • ZOOKEEPER_CLIENT
  • KERBEROS CLIENT
  • HIVE CLIENT
  • PIG CLIENT
  • SQOOP CLIENT
  • OOZIE CLIENT
  • FALCON CLIENT
  • INFRA SOLR CLIENT
  • ATLAS METADATA
  • SPARK2 CLIENT
  • SPARK CLIENT

With all the user's confined to the edge node securing the edge node is very important and easier to manage.

Hope that helps in your decision

avatar
Explorer

Thank you very much, we are using centos we should be able to install using yum?