question Re: Edge node or utility node packages in Archives of Support Questions (Read Only)

Edge node or utility node packages

mokkan — Fri, 16 Sep 2022 13:16:12 GMT

Hello,

I need to plan a edge node or utility node to run hive jobs and few other standard jobs. What are the standard packages needed for client? I know it all depends on the jobs, but just wondering what are the base packages needed.

Re: Edge node or utility node packages

Shelton — Thu, 24 May 2018 21:20:49 GMT

@Mokkan Mok

Edge nodes are the interface between the Hadoop cluster and the outside network. For this reason, at times referred to as gateway nodes. Most commonly, edge nodes are used to run client applications and cluster administration tools.

The edge node should be the access point to your cluster for your developers/data analysts. Usually, you install all the client software on the edge node some of them are listed below

MAPREDUCE2_CLIENT
HDFS_CLIENT
YARN_CLIENT
ZOOKEEPER_CLIENT
KERBEROS CLIENT
HIVE CLIENT
PIG CLIENT
SQOOP CLIENT
OOZIE CLIENT
FALCON CLIENT
INFRA SOLR CLIENT
ATLAS METADATA
SPARK2 CLIENT
SPARK CLIENT

With all the user's confined to the edge node securing the edge node is very important and easier to manage.

Hope that helps in your decision

Re: Edge node or utility node packages

mokkan — Thu, 24 May 2018 21:25:07 GMT

Thank you very much, we are using centos we should be able to install using yum?