Member since
09-01-2016
25
Posts
2
Kudos Received
0
Solutions
12-03-2018
02:38 PM
I'm trying todo without external server setup, because I dont want add additional server into cloud. It's not only postgres service what I should describe in blueprint, there some other service confs too, which may need servername in bp. tried different mustache variations, didn't work as I want. Into AWS provisoned internal server IP-s are 10.0.x.x, not possible use IP in bp. Problably best option is use localhost in bp, so services, which needs databases, will reside in first (master) server
... View more
11-23-2018
06:51 PM
I like to use in my blueprint dynamic provisonied server names. For example define in blueprint under ranger-env master hostgroup server name "ranger_privelege_user_jdbc_url": "jdbc:postgresql://%HOSTGROUP::master%:5432/postgres" or oozie or hive server names in jdbc parameters tried few variants, didn't work I can use IP-s, due I know server will probably provisoned in specific IP always, but I'm wondering is it a way to use provisioned host names using cloudbreak 2.7.2
... View more
Labels:
- Labels:
-
Apache Ambari
-
Hortonworks Cloudbreak
08-27-2018
03:35 AM
Even if I made "yum clean", there wasn't slider_3_0_1_1_5 package. I still don't understand wahy and from where this package should come. Downloaded and searched in rpm packages (not in hdf 3.0.1 and earlier and later), this slider_* doesn't exists.
... View more
08-27-2018
03:30 AM
I was able to fix problem differently. I guess I installed in my fustration hdp-select 2.6.5.0-292, which wasn't current target version. I installed back right hdp-select version and looked over in ambari stack&versions repo URL-s. And yes made yum clean all too. After that everything went correctly in host version install.
... View more
08-26-2018
06:48 AM
I upgraded in HDP cluster HDF 3.0 package to HDF 3.1 (upgrade mpack) Now I can get around this problem. Already spent 2 days, I don't understand what is wrong. I can fix manually if I find slider_3_0_1_1_5, but can't find this rpm either? I'm fustrated about this trivial problem, beacuse I don't need this slider at all
... View more
Labels:
- Labels:
-
Cloudera DataFlow (CDF)
08-14-2018
11:59 AM
1 Kudo
in hbase-site.xml hbase.coprocessor.region.classes should contain also org.apache.hadoop.hbase.security.token.TokenProvider
... View more
05-04-2018
03:17 PM
When creating cluster with custom blueprint, host FQDN domain names isn't created always *.ax.internal.cloudapp.net in azure Why?
... View more
Labels:
- Labels:
-
Hortonworks Cloudbreak
07-06-2017
05:39 PM
Yeah. added into "Custom webhcat-site" under hive conf in ambari webhcat.proxyuser.HTTP.groups=* webhcat.proxyuser.HTTP.hosts=*
... View more
07-06-2017
02:50 PM
Ambari 2.5.1 hadoop 2.5 running check from ambari it fails resource_management.core.exceptions.ExecutionFailed: Execution of '/var/lib/ambari-agent/tmp/templetonSmoke.sh server.domain.com ambari-qa 50111 idtest.ambari-qa.1499352141.17.pig /etc/security/keytabs/smokeuser.headless.keytab true /usr/bin/kinit ambari-qa-Cluster@DOMAIN.COM /var/lib/ambari-agent/tmp' returned 1. Templeton Smoke Test (ddl cmd): Failed. : {"error":"java.lang.reflect.UndeclaredThrowableException"}http_code <500>
... View more
Labels:
- Labels:
-
Apache Ambari
07-06-2017
02:49 PM
Ambari 2.5.1
hadoop 2.5 running check from ambari it fails resource_management.core.exceptions.ExecutionFailed: Execution of '/var/lib/ambari-agent/tmp/templetonSmoke.sh server.domain.com ambari-qa 50111 idtest.ambari-qa.1499352141.17.pig /etc/security/keytabs/smokeuser.headless.keytab true /usr/bin/kinit ambari-qa-Cluster@DOMAIN.COM /var/lib/ambari-agent/tmp' returned 1. Templeton Smoke Test (ddl cmd): Failed. : {"error":"java.lang.reflect.UndeclaredThrowableException"}http_code <500>
... View more
Labels:
- Labels:
-
Apache Ambari
-
Apache Hive
07-06-2017
02:45 PM
Ambari 2.5.1
hadoop 2.5 running check from ambari it fails
resource_management.core.exceptions.ExecutionFailed: Execution of '/var/lib/ambari-agent/tmp/templetonSmoke.sh server.domain.com ambari-qa 50111 idtest.ambari-qa.1499352141.17.pig /etc/security/keytabs/smokeuser.headless.keytab true /usr/bin/kinit ambari-qa-Cluster@DOMAIN.COM /var/lib/ambari-agent/tmp' returned 1. Templeton Smoke Test (ddl cmd): Failed. : {"error":"java.lang.reflect.UndeclaredThrowableException"}http_code <500>
... View more
Labels:
- Labels:
-
Apache Ambari
-
Apache Hive
06-21-2017
11:29 AM
We using flume ingestig data into HDFS. Flume sink is configured fileType=CompressedStream and codeC=snappy If on any reason flume agent dies or namenode (HA) restarts, flume current sink file will left open - .tmp extension. testfile.snappy.tmp for example. Is there any way to decompress such file and get data back
human readable form? Or is there any tool to fix such files? We can use any other compression too, if there is a way to
fix such files.
... View more
Labels:
- Labels:
-
Apache Flume
01-04-2017
08:09 AM
I found that there was problem in repo_version table, version column value should be "2.5.0.0-1245". I had only "2.5.0.0" Beacuse of that all services failed start or restart, with this error: ambari-python-wrap /usr/bin/conf-select set-conf-dir --package hadoop --stack-version 2.5.0.0 --conf-version 0' returned 1. 2.5.0.0 Incorrect stack version I still don't know how this situation happend. I updated version column to "2.5.0.0-1245" in database repo_version table
... View more
01-03-2017
12:24 PM
it isn't safe to delete, because at least cluster_version and host_version tables referencing to repo_version_id. I don't know how this situation can happen anyway (see ambari-repo-version.png) where data in table repo_version don't match
... View more
01-03-2017
11:57 AM
Yes error 500 in API output curl -u admin -H 'X-Requested-By:admin' -X GET 'http://localhost:8080/api/v1/clusters/Prelive/stack_versions' { "status": 500, "message": "Server Error" } sql query output in here ambari-repo-version.png Is it safe to delete 2nd row from database (repo_version_id 201)?
... View more
01-03-2017
10:34 AM
it error 500 and ambari server log contains same errors (see attachment above) curl -u admin -H 'X-Requested-By:admin' -X GET 'http://localhost:8080/api/v1/clusters/Prelive/stack_versions?ClusterStackVersions/version=2.5&fields=ClusterStackVersions/state' { "status": 500, "message": "Server Error" }
... View more
01-03-2017
10:20 AM
should be visible all logs now. also browser dev tools output screenshot ambari-stacks.png
... View more
01-03-2017
10:02 AM
1 Kudo
We recently upgraded HDP from 2.3 to 2.5 (1245) Ambari version 2.4.1.0. Also today we tried install zeppelin, which failed. Probably some data in database is now inconsistent Ambari server log error is in attachment
... View more
Labels:
- Labels:
-
Apache Ambari
09-01-2016
02:27 PM
looking errors in xa-portal.log, there is error
Please make sure while create/update given userId should be of x_user I tried delete users from ranger database (through rest api) delete operation hung. I canceled. Seems that database left some weird status, where some data weren't deleted Now updating again userdata from LDAP, some user groups failing to update, because some old id-s still exists in database. Deleting wrongly syncronized data from ranger is very essential function, which today is not there!
... View more
09-01-2016
11:17 AM
xa-portal.txt
... View more
09-01-2016
10:58 AM
Usersync finds correclty users from given user seachfilter string, but fails with update with bad request 400 ----grep 01 Sep 2016 13:46:04 INFO LdapUserGroupBuilder [UnixUserSyncThread] - Updating user count: 13, userName: user1, groupList: [group1, group2] 01 Sep 2016 13:46:04 INFO LdapUserGroupBuilder [UnixUserSyncThread] - LDAPUserGroupBuilder.updateSink() completed with user count: 13 01 Sep 2016 13:46:04 ERROR LdapUserGroupBuilder [UnixUserSyncThread] - sink.addOrUpdateUser failed with exception: POST http://server1:6080/service/users/default returned a response status of 400 Bad Request, for user: user1, groups: [group1, group2] ----grep why it uses URL (API I guess) http://server1:6080/service/users/default which gives bad request 400 ? Ranger 0.5.0.2.4
... View more
Labels:
- Labels:
-
Apache Ranger