About muanang

muanang · ‎06-25-2019

Hi @mgergely, Following this guide, will this work with Ambari HDF? I can't find these path (or should I say, they're not available) You should also enter the passwords into the following files as plain text: /etc/ambari-logsearch-portal/conf/keys/ks_pass.txt /etc/ambari-logsearch-portal/conf/keys/ts_pass.txt /etc/ambari-logsearch-logfeeder/conf/keys/ks_pass.txt /etc/ambari-logsearch-logfeeder/conf/keys/ts_pass.txt Thank you!

muanang · ‎06-18-2019

Following this thread. Also facing this kind of error on our cluster. We did not experience this on our dev env. All users/accounts are available to all nodes across cluster. BTW, I'm using PAM auth module for user-impersonation.

muanang · ‎03-15-2019

Hi All, Is there a way to enable/add security feature on Ranger Admin UI to lockout user/ip when hits a number of failed login attempt? Thank you, MD

muanang · ‎01-09-2019

Helped me big time! Thank you for sharing! Kafka all-the-way!

muanang · ‎08-09-2018

Just got what I'm looking for... 🙂 http://public-repo-1.hortonworks.com/HDF/ubuntu16/3.x/updates/3.1.2.0/HDF-3.1.2.0-7.xml Thanks for the quick response.

muanang · ‎08-09-2018

Hi @Jonathan Sneep, Thanks for the response. Just got what I'm looking for. 🙂 http://public-repo-1.hortonworks.com/HDF/ubuntu16/3.x/updates/3.1.2.0/HDF-3.1.2.0-7.xml Just not available from the HDF release note page https://docs.hortonworks.com/HDPDocuments/HDF3/HDF-3.1.2/bk_release-notes/content/ch_hdf_relnotes.html

muanang · ‎08-09-2018

Hi @here, I'm trying to install HDF cluster via ambari, but, I'm stucked with VDF file for HDF.. Does HDF have a "Version Definition File" just like with HDP? Regards, MD

muanang · ‎07-13-2018

Already found the file 🙂 sorry for the trouble... just had some error running testbench Error: Error while compiling statement: FAILED: SemanticException [Error 10001]: Line 3:6 Table not found 'date_dim' (state=42S02,code=10001) Error: Error while compiling statement: FAILED: SemanticException [Error 10001]: Line 13:1 Table not found 'lineitem' (state=42S02,code=10001)

muanang · ‎07-13-2018

Hi! May I ask what's the content of testbench.settings file? I can't find the file.. 😞 beeline -i testbench.settings -u jdbc:hive2://localhost:10500/tpcds_bin_partitioned_orc_30 Thanks!

muanang · ‎07-05-2018

Hi, Anyone knows how to get value of yarn.nodemanager.hostname to public hostname instead of hostname? I have hostname set for NM to worker00X.mylocal, and want to use my alias/public_hostname to nm1.dev.local. Already changes ng webapps url to use public_hostname by following https://docs.hortonworks.com/HDPDocuments/Ambari-2.6.2.0/bk_ambari-administration/content/ch_amb_ref_using_custom_host_names.html But unfortunately, yarn.nodemanager.hostname doesnt get the public_hostname. Thanks in advance

muanang · ‎07-04-2018

already got the solution(guide) from a friend. #Solution-for-LOGJAM-CVE-2015-4000-on-HST-server thanks!

muanang · ‎07-04-2018

Medium (CVSS: 4.0) NVT: SSL/TLS: Die-Hellman Key Exchange Insucient DH Group Strength Vulnerability

muanang · ‎07-04-2018

Hi! We're VA scanning our HDP cluster and found a medium alert on TLS/SSL vulnerability: Vulnerability Detection Result Server Temporary Key Size: 1024 bits Where do I need to put the newly generated Diffie-Hellman file for Ranger Usersync? Any help is appreciated. thanks!

muanang · ‎07-04-2018

This is resolved. Issue was I have an hostname set on servers, while I used aliases to register the servers on ambari. btw, i'm installing my cluster via blueprints. thanks!

muanang · ‎06-30-2018

So I replicate the issue. Working ambari-server 1. install all prerequisites using local repo without internet 2. allow internet connection 3. install ambari-server (using local repor) and start 4. working Problematic 1. install all prerequisites using local repo without internet 2. install ambari-server (using local repor) and start -- here comes the prob. - start will fail coz of error message above. 3. restart ambari-server -- service will start but it wont listen to port 8080 Any suggestions?

muanang · ‎06-30-2018

Hi, I'm trying to create a cluster using local repo (without internet). I've successfully install all prerequisites up to ambari-server. Now im having issues starting ambari-server. 01 Jul 2018 02:41:20,645 INFO [Stack Version Loading Thread] RepoUrlInfoCallable:94 - Loading latest URL info from http://public-repo-1.hortonworks.com/HDP/hdp_urlinfo.json for stacks HDP-2.3.GlusterFS,HDP-2.3.ECS,HDP-2.5,HDP-2.6,HDP-2.3,HDP-2.4,HDP-2.1.GlusterFS,HDP-2.1,HDP-2.2,HDP-2.0 01 Jul 2018 02:41:20,665 INFO [Stack Version Loading Thread] RepoUrlInfoCallable:107 - Could not load the URI from http://public-repo-1.hortonworks.com/HDP/hdp_urlinfo.json, stack defaults will be used 01 Jul 2018 02:41:20,665 INFO [Stack Version Loading Thread] RepoUrlInfoCallable:110 - Loaded URI http://public-repo-1.hortonworks.com/HDP/hdp_urlinfo.json for stacks HDP-2.3.GlusterFS,HDP-2.3.ECS,HDP-2.5,HDP-2.6,HDP-2.3,HDP-2.4,HDP-2.1.GlusterFS,HDP-2.1,HDP-2.2,HDP-2.0 in 23ms 01 Jul 2018 02:41:20,666 INFO [main] StackContext:208 - Loaded urlinfo in 29ms 01 Jul 2018 02:41:20,667 ERROR [main] StackContext:217 - Could not load repo results Does ambari-server needs internet connection to start correctly?

muanang · ‎06-30-2018

Already solved this my problem. I've used wrong URL, instead of `../clusters/cluster_name` I've put `../blueprints/cluster_name`

muanang · ‎06-30-2018

Hi, I'm trying to deploy latest HDP version 2.6.5.0 via blueprints. I already have working simple blueprint for HDP-2.6.4.0. BUT now, when trying to to use it against latest version, I have error like below when loading the hostmap.json. error message: "status" : 400, "message" : "The properties [blueprint, repository_version_id, default_password] specified in the request or predicate are not supported for the resource type Blueprint." here my hostmap.json { "blueprint" : "clustername", "default_password" : "clusterpass", "repository_version_id": 1, "host_groups" :[ { "name" : "host_group_1", "hosts" : [ { "fqdn" : "{{ master1_hostname }}"} ] }, { "name" : "host_group_2", "hosts" : [ { "fqdn" : "{{ master2_hostname }}" } ] }, { "name" : "host_group_3", "hosts" : [ { "fqdn" : "{{ master3_hostname }}" } ] }, { "name" : "host_group_4", "hosts" : [ { "fqdn" : "{{ worker1_hostname }}" }, { "fqdn" : "{{ worker2_hostname }}" }, { "fqdn" : "{{ worker3_hostname }}" } ] } ] }

muanang · ‎06-01-2018

is the step #4 necessary for HDP-2.6.4 version? btw, I had some error after enabling SSL on Mapred (<urlopen error [SSL: WRONG_VERSION_NUMBER] wrong version number (_ssl.c:590)>)

muanang · ‎05-24-2018

Hi @here, Is it possible to deploy HDP cluster with SSL enabled via Blueprints?

muanang · ‎05-21-2018

Hi, Would like to ask help on installing ranger and enable its plugins via blueprint vs via ambari. I've installed Ranger HA via blueprint, successfully with plugins enabled. But, when accessing the ranger dashboard, default services is missing, unlike when enabling the plugins manually via ambari, service is already available. see screenshots: Enabled plugin via Ambari Enabled plugin via Blueprint Any inputs is highly appreciated. Thank you!

muanang · ‎05-08-2018

Thanks for this guide.. 🙂 ...Will this work on a HA setup?

muanang · ‎04-24-2018

Hi @All, Just done setting up my cluster and installation completed. Just had some issue with zookeeper. Connecting to m1-cluster1.com:2181 log4j:WARN No appenders could be found for logger (org.apache.zookeeper.ZooKeeper). log4j:WARN Please initialize the log4j system properly. log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info. Welcome to ZooKeeper! JLine support is enabled [zk: m1-cluster1.com:2181(CONNECTING) 0] delete /zk_smoketest Exception in thread "main" org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss for /zk_smoketest at org.apache.zookeeper.KeeperException.create(KeeperException.java:99) at org.apache.zookeeper.KeeperException.create(KeeperException.java:51) at org.apache.zookeeper.ZooKeeper.delete(ZooKeeper.java:873) at org.apache.zookeeper.ZooKeeperMain.processZKCmd(ZooKeeperMain.java:708) at org.apache.zookeeper.ZooKeeperMain.processCmd(ZooKeeperMain.java:596) at org.apache.zookeeper.ZooKeeperMain.executeLine(ZooKeeperMain.java:368) at org.apache.zookeeper.ZooKeeperMain.run(ZooKeeperMain.java:328) at org.apache.zookeeper.ZooKeeperMain.main(ZooKeeperMain.java:287) Zookeeper Smoke Test: Failed Zookeeper service is running, but other services won't start and when trying to run zookeeper service check, errors show above. Any help is appreciated. Thanks! HDP-2.6.4.0

muanang · ‎04-23-2018

My bad, it's written on the prerequisites section of the documentation https://docs.hortonworks.com/HDPDocuments/Ambari-2.6.1.5/bk_ambari-operations/content/oozie_high_availability.html. (facepalm)

muanang · ‎04-23-2018

hi @Kuldeep Kulkarni, just a follow up question here. I just wondering what should I use on the oozie_url=http://<load-balancer>:11000/oozie. Is this some hostname I need to define in my DNS config and to which ip should i point it? Or i just need to leave it as default (pointing to hiveserver2 number 1). Thanks in advanced!

muanang · ‎04-04-2018

Issue fixed by setting up a local repository. Not sure why I'm having error when using public repo. Thank for helping out!

muanang · ‎03-28-2018

Bump to same 'repo_name' issue. But I got an error when trying to register the repo... https://community.hortonworks.com/questions/182868/blueprint-registration-error.html

muanang · ‎03-28-2018

Hi @Geoffrey Shelton Okot That URL is inaccessible is your host able to connect to the internet? Yes. I can download the VDF and hdp.list files from it. But when trying to access it via browser it got this <Error> <Code>NoSuchKey</Code> <Message>The specified key does not exist.</Message> "); vertical-align: bottom; height: 10px;"><Key> HDP/ubuntu16/2.x/updates/2.6.4.0/dists/HDP-2.6.4.0/ </Key> <RequestId>324F1BB13AAAF858</RequestId> "); vertical-align: bottom; height: 10px;"><HostId> jzXWBknZCZ+SyMzIlw4n0HDFiwykhvO5EPZmzONxou0CnaJVzxQQZLoDfgEOwVY8Q7mkSrZgJQc= </HostId> </Error> Have you setup and started your Ambari server? Yes. Can you post contents of your /etc/apt/sources.list.d/ambari.list cat /etc/apt/sources.list.d/hdp.list # VERSION_NUMBER=2.6.4.0-91 deb http://public-repo-1.hortonworks.com/HDP/ubuntu16/2.x/updates/2.6.4.0 HDP main deb http://public-repo-1.hortonworks.com/HDP-UTILS-1.1.0.22/repos/ubuntu16 HDP-UTILS main cat /etc/apt/sources.list.d/ambari.list #VERSION_NUMBER=2.6.1.3-3 deb http://public-repo-1.hortonworks.com/ambari/ubuntu16/2.x/updates/2.6.1.3 Ambari main

muanang · ‎03-28-2018

Hi! It's good to be back here.. 🙂 I'm trying to create my cluster using blueprints, I'm stucked at repo registration using public repo.... { "status" : 400, "message" : "java.lang.IllegalArgumentException: Could not access base url . http://public-repo-1.hortonworks.com/HDP/ubuntu16/2.x/updates/2.6.4.0 . http://public-repo-1.hortonworks.com/HDP/ubuntu16/2.x/updates/2.6.4.0/dists/HDP-2.6.4.0/Release" } Here's the json file { "Repositories" : { "repo_name" : "HDP-2.6.4.0", "base_url" : "http://public-repo-1.hortonworks.com/HDP/ubuntu16/2.x/updates/2.6.4.0", "verify_base_url" : true } } Any help would be appreciated. Thanks!

muanang · ‎03-31-2017

Will post later, on the road. 🙂

Online	Offline
Last Visited	‎01-23-2020 01:33 AM

Date Registered	‎02-03-2016 12:53 AM
Last Visited	‎01-23-2020 01:33 AM
Total Messages Posted	119
Total Kudos Received	55

Re: Create Diffie-Hellman 2048 for ranger usersync...

Re: Could not load the URI from http://public-repo...

Re: Blueprint Registration STATUS: 400 HDP-2.6.5.0

Re: Blueprint - Registration Error

Re: Bind Ambari UI port 8080

Re: Log Search and SSL

Re: Zeppelin Impersonation giving InterpreterExcep...

Ranger Admin UI - Login Lockout

Re: Kafka Mirror Maker Best Practices

Re: HDF Version Definition File

Re: HDF Version Definition File

HDF Version Definition File

Re: How to use Hive testbench to perform benchmark...

Re: How to use Hive testbench to perform benchmark...

SET yarn.nodemanager.hostname to USE public_hostna...

Re: Create Diffie-Hellman 2048 for ranger usersync...

Re: Create Diffie-Hellman 2048 for ranger usersync...

Create Diffie-Hellman 2048 for ranger usersync. (C...

Re: Could not load the URI from http://public-repo...

Re: Could not load the URI from http://public-repo...

Could not load the URI from http://public-repo-1.h...

Re: Blueprint Registration STATUS: 400 HDP-2.6.5.0

Blueprint Registration STATUS: 400 HDP-2.6.5.0

Re: Enable HTTPS for YARN and MAPREDUCE2

Enabling SSL for HDP Components via BLUEPRINT

Ranger Blueprint Installation with plugins enabled

Re: Setting up a secure cluster with Ranger enable...

Zookeeper Service Checker - FAILS (Fresh Install)

Re: Oozie HA - Configure of OOZIE_URL for schedule...

Re: Oozie HA - Configure of OOZIE_URL for schedule...

Re: Blueprint - Registration Error

Re: Installing HDP using ambari blueprints

Re: Blueprint - Registration Error

Blueprint - Registration Error

Re: HDP 2.5 Sandbox - Ambari Server Wont Start