Member since
05-15-2017
31
Posts
3
Kudos Received
2
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
2140 | 08-03-2017 01:58 PM | |
2302 | 07-26-2017 03:16 PM |
07-19-2018
01:48 PM
thanks for your answer. this means that the first three numbers are referring to hbase itself, and the last ones to the HDP version?in your example HDP 3.0.0.0. is this correct?
... View more
07-19-2018
11:49 AM
Hi, I'm looking for a list of artifact-versions for HDP 3.0 in order to use with Maven (Java), so I get the correct version for e.g. hbase-client. I can't seem to find the list. Thanks in advance
... View more
Labels:
08-09-2017
12:24 PM
I don't know of any best practice, but I did refer to an existing service, e.g. HBase This example shows that the dependencies are only defined for the Master component. But anyhow, it totally depends on your components. So if your slave depends on having e.g. a RegionServer on the same host you should add this dependency to your slave component. If you just require to have a RegionServer on the cluster I'd just go with defining the dependency at the Master component. What's also important is the '<requiredServices>' section in the sample linked to above. I hope this information helps.
... View more
08-09-2017
11:57 AM
Thanks for your answer @Akhil S Naik. It seems that it really was the issue with the config. I now changed my service to contain a config, although it's not used, but I don't have the issue anymore. Nevertheless, I didn't test the ambari-server configuration change, as it would have only been a workaround for me.
... View more
08-07-2017
01:32 PM
When I'm trying to test an (express) upgrade of a stack including my custom component I get the following error: Last Service Check should be more recent than the last configuration change for the given service Reason: Unexpected server error happenedFailed on: As you can see, it doesn't tell me which component. Anyhow, as I'm having my own component installed with the stack I suppose it's my own. My colleague now pointed out that it's maybe because I do not have a "Config" tab in my component. Could this be the issue? To shortly explain what my service does: I want to be able to have 2+ RegionServers on one host, thus I just copy the configuration from the original RegionServer and just do some changes within two configuration files before the component gets started. That's why I do not need any configuration within Ambari itself. Hopefully somebody can explain a bit about my issue. Thanks
... View more
Labels:
- Labels:
-
Apache Ambari
08-03-2017
01:58 PM
1 Kudo
hi @Sayed Anisul Hoque. @1. you already linked to the resources handling custom services, maybe the sub-menu brings more light @2. depdency.name: this is <Service>/<Component>, have a look at the other metainfo.xml definitions. As another example, if you depend on an HBase Master you would write HBASE/HBASE_MASTER @2 dependency.scope: this is the scope the dependency has to have. In your example, 'cluster' means that a Zookeeper Server has to be installed somewhere on your cluster. When you have scope 'host' it would mean that the component Zookeeper Server has to be on the same host as your custom service. Hope that helps.
... View more
07-26-2017
03:18 PM
Thanks for the hint. The log files provided me further details, but in the end I ended up with other problems. see my other questions. Thanks
... View more
07-26-2017
03:16 PM
I (kind of) managed to change the files when they get copied during installation, and I'm changing the files after the copy via python. Anyhow, I'm having another issue now, see my question: https://community.hortonworks.com/questions/115875/unable-to-determine-stack-version-for-custom-servi.html Thanks
... View more
06-30-2017
05:28 AM
Thanks for the hint, but I'm looking for a way to change settings of the copied hbase-site.xml and hbase-env.sh file, before it gets started, via python.
... View more
06-29-2017
02:47 PM
Hi, I'm trying to add an additional regionserver to a (HBase) cluster. I have the following metainfo.xml <metainfo>
<schemaVersion>2.0</schemaVersion>
<services>
<service>
<name>RS_HBASE_01</name>
<displayName>RS-HBASE-01</displayName>
<comment>Additional Regionserver on a host</comment>
<version>1.1.2</version>
<components>
<component>
<name>RS_HBASE_01</name>
<displayName>RS-01</displayName>
<category>SLAVE</category>
<cardinality>1+</cardinality>
<versionAdvertised>true</versionAdvertised>
<decommissionAllowed>true</decommissionAllowed>
<!-- the default category used to store generated metrics data -->
<timelineAppid>HBASE</timelineAppid>
<!-- the list of components that this component depends on -->
<dependencies>
<dependency>
<name>HBASE/HBASE_MASTER</name>
<scope>cluster</scope>
<auto-deploy>
<enabled>true</enabled>
<!--<co-locate>HBASE/HBASE_MASTER</co-locate>-->
</auto-deploy>
</dependency>
<dependency>
<name>HBASE/HBASE_REGIONSERVER</name>
<scope>host</scope>
<auto-deploy>
<enabled>true</enabled>
</auto-deploy>
</dependency>
</dependencies>
<commandScript>
<script>scripts/hbase_regionserver.py</script>
<scriptType>PYTHON</scriptType>
<timeout>1200</timeout>
</commandScript>
<bulkCommands>
<displayName>RegionServers</displayName>
<!-- Used by decommission and recommission -->
<masterComponent>HBASE/HBASE_MASTER</masterComponent>
</bulkCommands>
<logs>
<log>
<logId>hbase_regionserver01</logId>
<primary>true</primary>
</log>
</logs>
</component>
</components>
<commandScript>
<script>scripts/service_check.py</script>
<scriptType>PYTHON</scriptType>
<timeout>300</timeout>
</commandScript>
<!-- what other services that should be present on the cluster -->
<requiredServices>
<service>ZOOKEEPER</service>
<service>HDFS</service>
<service>HBASE</service>
</requiredServices>
<!-- configuration files that are expected by the service (config files owned by other services are specified in this list) -->
<configuration-dependencies>
<config-type>core-site</config-type> <!-- hbase puts core-site in it's folder -->
<config-type>hbase-policy</config-type>
<config-type>hbase-site</config-type>
<config-type>hbase-env</config-type>
<config-type>hbase-log4j</config-type>
</configuration-dependencies>
</service>
</services>
</metainfo> where I define my required services, and also the configuration files I need from the other services. The installation itself works already, all files/symlinks are created and put into their directoy. But in order to successfully start up I need some configuration values changed, e.g. hbase.regionserver.port and hbase.regionserver.info.port (within hbase-site.xml) , PID file location, log-file name etc (within hbase-env.sh) . How can I change the values in the configuration files? I suppose there is some helper method where I can read the configuration file before starting, and change the values. Thanks for your suggestions.
... View more
Labels:
- Labels:
-
Apache Ambari
-
Apache HBase