Re: how to implement provisoned server name in clo...

indrek_maestu · ‎12-03-2018

I'm trying todo without external server setup, because I dont want add additional server into cloud. It's not only postgres service what I should describe in blueprint, there some other service confs too, which may need servername in bp. tried different mustache variations, didn't work as I want. Into AWS provisoned internal server IP-s are 10.0.x.x, not possible use IP in bp. Problably best option is use localhost in bp, so services, which needs databases, will reside in first (master) server

indrek_maestu · ‎11-23-2018

I like to use in my blueprint dynamic provisonied server names. For example define in blueprint under ranger-env master hostgroup server name "ranger_privelege_user_jdbc_url": "jdbc:postgresql://%HOSTGROUP::master%:5432/postgres" or oozie or hive server names in jdbc parameters tried few variants, didn't work I can use IP-s, due I know server will probably provisoned in specific IP always, but I'm wondering is it a way to use provisioned host names using cloudbreak 2.7.2

indrek_maestu · ‎08-27-2018

Even if I made "yum clean", there wasn't slider_3_0_1_1_5 package. I still don't understand wahy and from where this package should come. Downloaded and searched in rpm packages (not in hdf 3.0.1 and earlier and later), this slider_* doesn't exists.

indrek_maestu · ‎08-27-2018

I was able to fix problem differently. I guess I installed in my fustration hdp-select 2.6.5.0-292, which wasn't current target version. I installed back right hdp-select version and looked over in ambari stack&versions repo URL-s. And yes made yum clean all too. After that everything went correctly in host version install.

indrek_maestu · ‎08-26-2018

I upgraded in HDP cluster HDF 3.0 package to HDF 3.1 (upgrade mpack) Now I can get around this problem. Already spent 2 days, I don't understand what is wrong. I can fix manually if I find slider_3_0_1_1_5, but can't find this rpm either? I'm fustrated about this trivial problem, beacuse I don't need this slider at all

indrek_maestu · ‎08-14-2018

in hbase-site.xml hbase.coprocessor.region.classes should contain also org.apache.hadoop.hbase.security.token.TokenProvider

indrek_maestu · ‎05-04-2018

When creating cluster with custom blueprint, host FQDN domain names isn't created always *.ax.internal.cloudapp.net in azure Why?

indrek_maestu · ‎07-06-2017

Yeah. added into "Custom webhcat-site" under hive conf in ambari webhcat.proxyuser.HTTP.groups=* webhcat.proxyuser.HTTP.hosts=*

indrek_maestu · ‎07-06-2017

Ambari 2.5.1 hadoop 2.5 running check from ambari it fails resource_management.core.exceptions.ExecutionFailed: Execution of '/var/lib/ambari-agent/tmp/templetonSmoke.sh server.domain.com ambari-qa 50111 idtest.ambari-qa.1499352141.17.pig /etc/security/keytabs/smokeuser.headless.keytab true /usr/bin/kinit ambari-qa-Cluster@DOMAIN.COM /var/lib/ambari-agent/tmp' returned 1. Templeton Smoke Test (ddl cmd): Failed. : {"error":"java.lang.reflect.UndeclaredThrowableException"}http_code <500>

indrek_maestu · ‎07-06-2017

Ambari 2.5.1 hadoop 2.5 running check from ambari it fails resource_management.core.exceptions.ExecutionFailed: Execution of '/var/lib/ambari-agent/tmp/templetonSmoke.sh server.domain.com ambari-qa 50111 idtest.ambari-qa.1499352141.17.pig /etc/security/keytabs/smokeuser.headless.keytab true /usr/bin/kinit ambari-qa-Cluster@DOMAIN.COM /var/lib/ambari-agent/tmp' returned 1. Templeton Smoke Test (ddl cmd): Failed. : {"error":"java.lang.reflect.UndeclaredThrowableException"}http_code <500>

indrek_maestu · ‎07-06-2017

Ambari 2.5.1 hadoop 2.5 running check from ambari it fails resource_management.core.exceptions.ExecutionFailed: Execution of '/var/lib/ambari-agent/tmp/templetonSmoke.sh server.domain.com ambari-qa 50111 idtest.ambari-qa.1499352141.17.pig /etc/security/keytabs/smokeuser.headless.keytab true /usr/bin/kinit ambari-qa-Cluster@DOMAIN.COM /var/lib/ambari-agent/tmp' returned 1. Templeton Smoke Test (ddl cmd): Failed. : {"error":"java.lang.reflect.UndeclaredThrowableException"}http_code <500>

indrek_maestu · ‎06-21-2017

We using flume ingestig data into HDFS. Flume sink is configured fileType=CompressedStream and codeC=snappy If on any reason flume agent dies or namenode (HA) restarts, flume current sink file will left open - .tmp extension. testfile.snappy.tmp for example. Is there any way to decompress such file and get data back human readable form? Or is there any tool to fix such files? We can use any other compression too, if there is a way to fix such files.

indrek_maestu · ‎01-04-2017

I found that there was problem in repo_version table, version column value should be "2.5.0.0-1245". I had only "2.5.0.0" Beacuse of that all services failed start or restart, with this error: ambari-python-wrap /usr/bin/conf-select set-conf-dir --package hadoop --stack-version 2.5.0.0 --conf-version 0' returned 1. 2.5.0.0 Incorrect stack version I still don't know how this situation happend. I updated version column to "2.5.0.0-1245" in database repo_version table

indrek_maestu · ‎01-03-2017

it isn't safe to delete, because at least cluster_version and host_version tables referencing to repo_version_id. I don't know how this situation can happen anyway (see ambari-repo-version.png) where data in table repo_version don't match

indrek_maestu · ‎01-03-2017

Yes error 500 in API output curl -u admin -H 'X-Requested-By:admin' -X GET 'http://localhost:8080/api/v1/clusters/Prelive/stack_versions' { "status": 500, "message": "Server Error" } sql query output in here ambari-repo-version.png Is it safe to delete 2nd row from database (repo_version_id 201)?

indrek_maestu · ‎01-03-2017

it error 500 and ambari server log contains same errors (see attachment above) curl -u admin -H 'X-Requested-By:admin' -X GET 'http://localhost:8080/api/v1/clusters/Prelive/stack_versions?ClusterStackVersions/version=2.5&fields=ClusterStackVersions/state' { "status": 500, "message": "Server Error" }

indrek_maestu · ‎01-03-2017

should be visible all logs now. also browser dev tools output screenshot ambari-stacks.png

indrek_maestu · ‎01-03-2017

ambari-serverlog.txt slider-client-installlog.txt

indrek_maestu · ‎01-03-2017

We recently upgraded HDP from 2.3 to 2.5 (1245) Ambari version 2.4.1.0. Also today we tried install zeppelin, which failed. Probably some data in database is now inconsistent Ambari server log error is in attachment

indrek_maestu · ‎09-01-2016

looking errors in xa-portal.log, there is error Please make sure while create/update given userId should be of x_user I tried delete users from ranger database (through rest api) delete operation hung. I canceled. Seems that database left some weird status, where some data weren't deleted Now updating again userdata from LDAP, some user groups failing to update, because some old id-s still exists in database. Deleting wrongly syncronized data from ranger is very essential function, which today is not there!

indrek_maestu · ‎09-01-2016

xa-portal.txt

indrek_maestu · ‎09-01-2016

Usersync finds correclty users from given user seachfilter string, but fails with update with bad request 400 ----grep 01 Sep 2016 13:46:04 INFO LdapUserGroupBuilder [UnixUserSyncThread] - Updating user count: 13, userName: user1, groupList: [group1, group2] 01 Sep 2016 13:46:04 INFO LdapUserGroupBuilder [UnixUserSyncThread] - LDAPUserGroupBuilder.updateSink() completed with user count: 13 01 Sep 2016 13:46:04 ERROR LdapUserGroupBuilder [UnixUserSyncThread] - sink.addOrUpdateUser failed with exception: POST http://server1:6080/service/users/default returned a response status of 400 Bad Request, for user: user1, groups: [group1, group2] ----grep why it uses URL (API I guess) http://server1:6080/service/users/default which gives bad request 400 ? Ranger 0.5.0.2.4

Online	Offline
Last Visited	‎10-23-2020 07:15 AM

Date Registered	‎09-01-2016 10:52 AM
Last Visited	‎10-23-2020 07:15 AM
Total Messages Posted	25
Total Kudos Received	2

Re: how to implement provisoned server name in clo...

how to implement provisoned server name in cloudbr...

Re: how to get areound storm_3_0_1_1_5-slider-clie...

Re: how to get areound storm_3_0_1_1_5-slider-clie...

how to get areound storm_3_0_1_1_5-slider-client-1...

Re: Spark can't connect to HBase using Kerberos i...

Why Cloudbreak creates sometimes hosts with wrong ...

Re: ambari HIVE check fails

ambari HIVE check fails

ambari HIVE check fails

ambari HIVE check failure

decompress snappy file if it was left open in hdfs

Re: Ambari admin stack versions hangs

Re: Ambari admin stack versions hangs

Re: Ambari admin stack versions hangs

Re: Ambari admin stack versions hangs

Re: Ambari admin stack versions hangs

Re: Ambari admin stack versions hangs

Ambari admin stack versions hangs

Re: Ranger usersync fails with returned a response...

Re: Ranger usersync fails with returned a response...

Ranger usersync fails with returned a response sta...