Member since
12-09-2015
3
Posts
0
Kudos Received
0
Solutions
10-31-2016
08:27 PM
Dear All, I just started Hortonworks HDF - Apache Nifi - developed first Flow. Now wanted to deploy this code from dev to production or Qa environment. I read documentation and other articles I can select a sub-section of a flow, create a template and import it. But my requirement is to deploy the whole flow I developed from one environment (dev) to another environment (say QA server). Also how can I change the proper values at runtime based on the environment (dev vs QA vs PROD) without changing the flow logic. I read flow.gz file but I did not understand basically how can I manage multiple flows within my web page. Basically how can I create an installer similar to .war or .ear or .targ.gz which contains all the artifacts for a particular data flow (say ingesting change data capture from RDBMS into HDFS). When deployed and executed in different environments (say dev or qa or prod) the same code is deployed but different configuration parameters are provided at runtime. Reason for this is in a large enterprise once a code is tagged in SVN and installer is prepared for deployment, IT support team will not provide access to QA or PROD cluster to developers. And everything is automated through Hudson / DevOps tools where by click of a button code is deployed on higher environments. We cannot expect IT support team to import templates, drag and drop to develop the Flows on prod environment. They expecting everything is developed with automation at the backdrop (automation I mean Hudson/DevOps tool click of adeployment, changing runtime configuration values with an external configuration file etc) Please help me, above is very important to share my views on Nifi to large group within my dev team. Thanks,
... View more
Labels:
- Labels:
-
Apache NiFi
-
Cloudera DataFlow (CDF)