Member since
10-16-2019
3
Posts
0
Kudos Received
0
Solutions
11-29-2019
12:17 AM
First of all thanks for the reply, We are in the very beginning of our journey and most of our workload right now is architectural decisions as in my question. We were also considering building a DevOps pipeline, Nexus as you mentioned is being considered as well as GitLab with or without Jenkins. But it has not occurred to me that we can cover this problem with an DevOps pipeline setup, before you mentioned. Your suggestion has become more than helpful for me. Best regards
... View more
11-28-2019
12:03 AM
Hello All,
We have applications in our data organization like Oracle Data Integrator and Jupyter Hub.
Those set of applications require up to date jars, core-site.xml, hdfs-site xml etc to integrate properly with the cluster.
Our Application Architects suggests we should install those applications' clients and/or agents on edge nodes of our cluster.
I don't want to do this because:
*I might need to deal with conflicting environment requirements.
*I will have limited control over server resource consumption
*Application level operations such as upgrades might have adverse affects on the cluster
I am considering to offer mounting jars/conf directories of edge nodes on read only mode to application servers.
Any suggestions and evaluations about both architectures or alternatives are more than welcome.
Best regards
... View more
Labels:
- Labels:
-
Apache Hadoop