Member since
07-19-2018
613
Posts
101
Kudos Received
117
Solutions
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 5098 | 01-11-2021 05:54 AM | |
| 3422 | 01-11-2021 05:52 AM | |
| 8790 | 01-08-2021 05:23 AM | |
| 8386 | 01-04-2021 04:08 AM | |
| 36692 | 12-18-2020 05:42 AM |
04-03-2020
10:08 AM
I have now completed the DFHz Hue Management Pack which you can now use to install Hue 3 or Hue 4 in HDP 2 or HDP3. Just be careful in selecting your correct version(s) and getting the correct mpack install command. They are each very specific. Check out the repo: https://github.com/steven-dfheinz/dfhz_hue_mpack
... View more
04-03-2020
09:49 AM
1 Kudo
@bhara This morning I did a 3 node HDP 2.6.5 cluster with NameNode HA (the point you had conflict in). The install worked from management pack without issues. Hue install and started. No problems. In my early morning testing, I had installed Hue before doing NameNode HA. So for the HA test, I stopped hue, executed 2 rms below, deleted service from ambari, and did a re-install from ambari. 14 rm -rf /usr/local/hue 15 rm -rf /usr/hdp/current/hue-server If you continue to have issues, you will need to debug using method I showed you before: edit the files that are throwing errors. Looking at the conflicts, and commenting/debugging python is how I even got this to work at all. In my original article I discuss some important information about debugging the service files directly, and using the retry button during the install or start section of the Ambari Add Service Wizard. If you do find a solution that needs to be changed, please report it back so that I can get the repo updated. I am doing an update now to include the rms above, making an install/reinstall from ambari easier.
... View more
04-03-2020
05:48 AM
@Former Member here is an article that explains how to use variables: https://community.cloudera.com/t5/Community-Articles/Introduction-into-Process-Group-Variables/ta-p/247625 You should create important variables at the main root canvas level for all your NiFi environments. Then access these variables within your NiFi Registry controlled process groups via variable syntax: ${variableName}. Then when you import that to another environment the variables already exist and the flow works after importing.
... View more
04-02-2020
02:50 PM
I will check again in the morning. Some of what you are seeing now is that the original Ambari hue service wasn’t finished for high availability. This is a customer service so... The last changes I suggest are to get around those settings manually. High Availability and SSL is on my list of things to do but so far I have been very busy just getting the base of this all working with single node cluster. I will run a multi node cluster in the morning and update repo.
... View more
04-02-2020
02:01 PM
@bhara Install completed, that's some good progress! Congrats. Your start error is saying problem with: Execution of '/var/lib/ambari-agent/cache/common-services/HUE/4.6.0/package/files/configs.sh set catl0dlbd00028.corp.cox.com HDP_ANALYTICS_DEV httpfs-site 'httpfs.proxyuser.hue.groups' '*'' returned 1. [ERROR] "httpfs-site" not found in server response. [ERROR] Output of `curl -k -s -u admin:admin "http://catl0dlbd00028.corp.cox.com:8080/api/v1/clusters/HDP_ANALYTICS_DEV?fields=Clusters/desired_configs"` is:
[ERROR] You will need to fix that to get it to start. In that error its trying to login to Ambari API via admin user with admin password. Does this login work? If your user is different or password is changed you need to adjust the ambari user credentials in this file: /var/lib/ambari-agent/cache/common-services/HUE/4.6.0/package/files/configs.sh Then try to start again. If admin user is correct. Then I think best bet is to comment line 92,93,94 in common.py: /var/lib/ambari-agent/cache/common-services/HUE/4.6.0/package/scripts/common.py Or can bypass this section entirely in params.py: /var/lib/ambari-agent/cache/common-services/HUE/4.6.0/package/scripts/common.py Set line X True to False (line 182)
... View more
04-02-2020
11:50 AM
@bhara you should be good to do a full reset and re-install and it should work. Make sure you follow all the commands for reset. If it fails again its going to be from previous attempts (not removing all parts) or dependency (should be resolved). HDP 2.6.5 Hue 4.6.0 Management pack worked for me today: ambari-server install-mpack --mpack=https://github.com/steven-dfheinz/dfhz_hue_mpack/raw/master/hue_mpack-4.6.0-0.0.tar.gz --verbose
ambari-server restart https://github.com/steven-dfheinz/dfhz_hue_mpack
... View more
04-02-2020
11:45 AM
@Gubbi I think your ListFile proc is still executing 0 sec. Reference our private message.
... View more
04-02-2020
06:46 AM
@Gubbi please share you nifi info: How many nodes? How much ram and how many cores per node? What is min/max memory setting in NiFi? Have you done anything with configuring nifi for performance? For example Increasing Min/Max Ram? Disk Partitioning? Changing the Max Thread Count in Admin->Controller Services? Setting Concurrent Tasks in processor scheduling tab?
... View more
04-02-2020
06:42 AM
@bhara In a previous post you got past the "Hue Service is installed" step, which means all dependencies must have not caused any errors in "make install". Your last reply is an error in make install. Maybe you can just try again and see if that resolves it. Also make sure you have package npm and maven. If you are stuck in install attempt, you can also manually go to the node and finish the install: rm -rf /usr/local/hue cd /usr/local/hue-4.6.0 PREFIX=/usr/local/ make install Let this run and see if it finishes. It is sometimes necessary to do the manual install and resolve the issues for dependency or to at least know confidently the make install works. If it does work, the dependencies are good. After this manual test, the next thing to do is a full reset from ambari and try all over again. Full reset is: Stop Service in Ambari Delete Service Execute the rm commands rm -rf /var/lib/ambari-server/resources/stacks/HDP/2.6/services/HUE rm -rf /var/lib/ambari-agent/cache/stacks/HDP/2.6/services/HUE/ rm -rf /usr/local/hue rm -rf /usr/hdp/current/hue-server rm -rf /usr/local/hue-* Re-install Custom Hue Service or Install Management Pack Restart Ambari Attempt fresh install
... View more
04-02-2020
06:32 AM
1 Kudo
@Gubbi The next solution here is to just add each route for today, yesterday, day before yesterday. Then route all 3 to the next proc. Anything not matching won't be routed.
... View more