Edge node or utility node packages

[#1]

Hello,

I need to plan a edge node or utility node to run hive jobs and few other standard jobs. What are the standard packages needed for client? I know it all depends on the jobs, but just wondering what are the base packages needed.

[#2 · Accepted solution]

@Mokkan Mok

Edge nodes are the interface between the Hadoop cluster and the outside network. For this reason, at times referred to as gateway nodes. Most commonly, edge nodes are used to run client applications and cluster administration tools.

The edge node should be the access point to your cluster for your developers/data analysts. Usually, you install all the client software on the edge node some of them are listed below

• MAPREDUCE2_CLIENT
• HDFS_CLIENT
• YARN_CLIENT
• ZOOKEEPER_CLIENT
• KERBEROS CLIENT
• HIVE CLIENT
• PIG CLIENT
• SQOOP CLIENT
• OOZIE CLIENT
• FALCON CLIENT
• INFRA SOLR CLIENT
• ATLAS METADATA
• SPARK2 CLIENT
• SPARK CLIENT
  

With all the user's confined to the edge node securing the edge node is very important and easier to manage.

Hope that helps in your decision

[#3]

Thank you very much, we are using centos we should be able to install using yum?