Member since
07-19-2018
613
Posts
101
Kudos Received
117
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
4901 | 01-11-2021 05:54 AM | |
3337 | 01-11-2021 05:52 AM | |
8642 | 01-08-2021 05:23 AM | |
8157 | 01-04-2021 04:08 AM | |
36035 | 12-18-2020 05:42 AM |
10-01-2020
09:48 AM
@aniket5003 NiFi can be added to ambari using one of the HDF Management packs. Depending on your relationship with Cloudera, you may need to use your account to get after the NiFi 1.12.1 management pack. I do know other versions are out on the open internet (1.9 and below), but newest versions will require a cloudera username and password to access repos and artifacts. Once you have a management pack added to ambari, you should be able to install nifi and other HDF components in an HDP cluster. Additionally you can get 1.12.1 from nifi.apache.org and install outside of ambari interface if you need something quick. If this answer resolves your issue or allows you to move forward, please choose to ACCEPT this solution and close this topic. If you have further dialogue on this topic please comment here or feel free to private message me. If you have new questions related to your Use Case please create separate topic and feel free to tag me in your post. Thanks, Steven
... View more
09-30-2020
08:41 AM
@Elf IMO anything is possible with ambari. That said, out of the box, maybe it would not appear to be possible without some advanced ambari admin skills. I took a look at the link you provided and that is an example of how to spin up a single machine with many of the services you may already have in your ambari cluster. To install griffin in an ambari cluster you would need to pick a node, install griffin, missing requirements (services/components not in your cluster), and thoughtfully modify the configuration to use the existing services from the ambari cluster. For example, feed griffin you configuration locations for hadoop, hdfs, hive, etc and NOT use the specific directions to install those parts based on sample documentation. If you do decide to go down this path, please update here with your progress or create new Questions with specific errors you may have.
... View more
09-30-2020
07:04 AM
@ujay Of course. The link referenced xml is a template file. Click through and get the raw xml code and save to a file. From here you import the template: Then in the upper navigation grab the template icon and drag to the nifi canvas: It should automatically choose the last template uploaded: Once the template is on the canvas click through into the process group created: You will need to do some work in Controller Services so check out the notes in the Red Box. The flow is an example of how to generate many flow files and detect duplicates. Be sure to do some research on the processor (google search) to understand how others have resolved working with the processor as your begin to integrate this into your own flow. This community is also a great research tool too:
... View more
09-30-2020
05:08 AM
@praneet Adding the value to the processor (+) is a suitable method. You just need to make sure you get the right string in that field. It's blocked out, but appears not just the actual token but prepended with "Bearer". Try just the token string. One thing I like to do for any API, before I start to work on invokeHttp configuration, is to use Postman to help me identify all of the required settings to test connection to an API. Once this is complete, I can definitively ensure that nifi invokeHttp is sending the same request. If this answer resolves your issue or allows you to move forward, please choose to ACCEPT this solution and close this topic. If you have further dialogue on this topic please comment here or feel free to private message me. If you have new questions related to your Use Case please create separate topic and feel free to tag me in your post. Thanks, Steven
... View more
09-30-2020
05:03 AM
@Manoj90 In addition o @PVVK point, you need to be careful with routing relationships back on the originating processor. During development I like to use a output port that I call End of Line or EOL1, EOL2, EOL3 as I need more in larger flows. This is to evaluate if something goes to fail, retry, etc. Later once I am certain the flow is working as I need, I either auto terminate these routes, or I route them out of my processor group to an Event Notification system. It looks like this: Using an output port to hold un needed routes during testing If this answer resolves your issue or allows you to move forward, please choose to ACCEPT this solution and close this topic. If you have further dialogue on this topic please comment here or feel free to private message me. If you have new questions related to your Use Case please create separate topic and feel free to tag me in your post. Thanks, Steven
... View more
09-30-2020
04:54 AM
@Elf Can you sure the method and failure details for install with ambari? There is always a way to work around those issues even if its some manual adjustments in ambari or the agent during install.
... View more
09-30-2020
04:52 AM
@mansu You need to make sure the file and locations have the correct permissions for the nifi user. For example in linux: chown -R nifi:nifi /path/to/files If this answer resolves your issue or allows you to move forward, please choose to ACCEPT this solution and close this topic. If you have further dialogue on this topic please comment here or feel free to private message me. If you have new questions related to your Use Case please create separate topic and feel free to tag me in your post. Thanks, Steven
... View more
09-28-2020
03:54 PM
@gnavarro54 This error is suggesting that your yarn node is out of memory. You need to inspect what services are running on your node may be causing it to not have enough memory to start yarn. If there are to o many services for your node spec (amount of ram) then all of the services may not be able to start. If possible add more ram, or considering removing some services from that node to another node. If you respond back with more details about your environment, myself or other community members can respond with deeper details. If this answer resolves your issue or allows you to move forward, please choose to ACCEPT this solution and close this topic. If you have further dialogue on this topic please comment here or feel free to private message me. If you have new questions related to your Use Case please create separate topic and feel free to tag me in your post. Thanks, Steven
... View more
09-28-2020
03:54 PM
@vikrant_kumar24 Based on what you describe you are either exceeding the capabilities of the outbound network connection from nifi, or the receiving end API. I suspect the latter but its hard to tell without seeing the number of nodes and processor scheduling settings. You can try to slow down the execution of invokeHttp to confirm. If it is set to 0 sec it can create a lot of connections to the endpoint. Try 5,10,15 seconds and re-evaluate. Also If you have more than 1 one nifi node, it can create a great deal of concurrent connections. If this answer resolves your issue or allows you to move forward, please choose to ACCEPT this solution and close this topic. If you have further dialogue on this topic please comment here or feel free to private message me. If you have new questions related to your Use Case please create separate topic and feel free to tag me in your post. Thanks, Steven
... View more
09-28-2020
03:46 PM
@aniket5003 Check out the following post for a few different ways to locate or update the password: https://community.cloudera.com/t5/Support-Questions/Default-password-for-Metron-UI-Version-0-4-0/td-p/199277 If this answer resolves your issue or allows you to move forward, please choose to ACCEPT this solution and close this topic. If you have further dialogue on this topic please comment here or feel free to private message me. If you have new questions related to your Use Case please create separate topic and feel free to tag me in your post. Thanks, Steven
... View more