Member since
07-10-2025
5
Posts
0
Kudos Received
0
Solutions
08-22-2025
12:07 AM
@abdulpasithali You may got notified on my last post. Because I forgot the @ on your name. You may can read the post below. Thanks
... View more
08-21-2025
03:07 AM
Hi Abdulpasithali, thank you for looking at my post. The template you point me is totally different to the template we are using. I try to deploy the template and got empty brackets returned. curl -X POST -H "Content-Type: application/json" -d @/tmp/cloudera_base_new.json http://admin:admin@9.152.187.116:7180/api/v54/cm/importClusterTemplate?addRepositories=true
{ } You can find the template we using is to deploy a cloudera node here Creating a Runtime Cluster Using a Cloudera Manager Template We export the configuration from an existing Cloudera Cluster, changed some values at the json file and try to deploy it on a new cluster. But this import failed. curl -X POST -H "Content-Type: application/json" -d @/tmp/cloudera_base.json http://admin:admin@my_cloudera_ip:7180/api/v54/cm/importClusterTemplate?addReposiies=true
{
"message" : "The following host(s) are not available: hdfs-44.vmlocal,hdfs-42.vmlocal,hdfs-43.vmlocal,hdfs-41.vmlocal."
} Looking at the logfile at the cloudera node I see two java exceptions 2025-08-21 10:20:19,003 INFO scm-web-81:com.cloudera.server.web.cmf.AuthenticationSuccessEventListener: Authentication success for user: 'admin' from 9.152.187.253
2025-08-21 10:20:19,008 INFO scm-web-81:com.cloudera.enterprise.JavaMelodyFacade: Entering HTTP Operation: Method:POST, Path:/v54/cm/importClusterTemplate
2025-08-21 10:20:19,054 INFO scm-web-81:com.cloudera.enterprise.AbstractWrappedEntityManager: Rolling back transaction that wasn't marked for rollback-only.
java.lang.Exception: Non-thrown exception for stack trace.
at com.cloudera.enterprise.AbstractWrappedEntityManager.close(AbstractWrappedEntityManager.java:163)
at com.cloudera.cmf.persist.CmfEntityManager.close(CmfEntityManager.java:408)
at com.cloudera.server.web.cmf.AuthFilterEntityManager.close(AuthFilterEntityManager.java:202)
at com.cloudera.api.dao.impl.ManagerDaoBase.runInNewTransaction(ManagerDaoBase.java:270)
at com.cloudera.api.dao.impl.ManagerDaoBase.access$100(ManagerDaoBase.java:95)
2025-08-21 10:20:19,064 INFO scm-web-81:com.cloudera.api.ApiExceptionMapper: Exception caught in API invocation. Msg:The following host(s) are not available: hdfs-44.vmlocal,hdfs-42.vmlocal,hdfs-43.vmlocal,hdfs-41.vmlocal.
java.lang.IllegalArgumentException: The following host(s) are not available: hdfs-44.vmlocal,hdfs-42.vmlocal,hdfs-43.vmlocal,hdfs-41.vmlocal.
at com.google.common.base.Preconditions.checkArgument(Preconditions.java:143)
at com.cloudera.api.dao.impl.ClouderaMasterServerDaoImpl.validateAndPrepareContext(ClouderaMasterServerDaoImpl.java:309)
at com.cloudera.api.dao.impl.ClouderaMasterServerDaoImpl.importClusterTemplate(ClouderaMasterServerDaoImpl.java:235)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) The template we try to deploy looks like this {
"cdhVersion":"7.1.9",
"displayName":"storageScale",
"cmVersion":"7.11.3",
"repositories":[
"http://ip_address/repos/jenkins/BDA_CSTL/CDP7.1.9-CHF6/cdh-7.1.9.9/redhat8/"
],
"products":[
{
"product":"7.1.9-1.cdh7.1.9.p9.52289703-el8.parcel",
"version":"CDH"
}
],
"services":[
{
"refName":"spectrumscale",
"serviceType":"SPECTRUMSCALE",
"serviceConfigs":[
{
"name":"default_fs_name",
"value":"hdfs://cesnet-cluster-4.vmlocal:8020"
},
{
"name":"webhdfs_url",
"value":"http://cesnet-cluster-4.vmlocal:50070/webhdfs/v1"
}
],
"roleConfigGroups":[
{
"refName":"spectrumscale-TRANSPARENCY_DATANODE-BASE",
"roleType":"TRANSPARENCY_DATANODE",
"base":true
},
{
"refName":"spectrumscale-TRANSPARENCY_NAMENODE-BASE",
"roleType":"TRANSPARENCY_NAMENODE",
"base":true
},
{
"refName":"spectrumscale-GATEWAY-BASE",
"roleType":"GATEWAY",
"base":true
}
]
},
{
"refName":"core_settings",
"serviceType":"CORE_SETTINGS",
"roleConfigGroups":[
{
"refName":"core_settings-GATEWAY-BASE",
"roleType":"GATEWAY",
"base":true
}
]
}
],
"hostTemplates":[
{
"refName":"HostTemplate-0-from-hdfs-[43-44].vmlocal",
"cardinality":"2",
"roleConfigGroupsRefNames":[
"spectrumscale-GATEWAY-BASE",
"spectrumscale-TRANSPARENCY_DATANODE-BASE"
]
},
{
"refName":"HostTemplate-1-from-hdfs-42.vmlocal",
"cardinality":1,
"roleConfigGroupsRefNames":[
"spectrumscale-GATEWAY-BASE",
"spectrumscale-TRANSPARENCY_NAMENODE-BASE"
]
},
{
"refName":"HostTemplate-2-from-hdfs-41.vmlocal",
"cardinality":1,
"roleConfigGroupsRefNames":[
"core_settings-GATEWAY-BASE",
"spectrumscale-GATEWAY-BASE",
"spectrumscale-TRANSPARENCY_NAMENODE-BASE"
]
}
],
"tags":[
{
"name":"_cldr_cluster.core_settings.service_name",
"value":"core_settings"
}
],
"instantiator":{
"clusterName":"storageScale",
"hosts":[
{
"hostName":"hdfs-41.vmlocal",
"hostTemplateRefName":"HostTemplate-2-from-hdfs-41.vmlocal"
},
{
"hostName":"hdfs-42.vmlocal",
"hostTemplateRefName":"HostTemplate-1-from-hdfs-42.vmlocal"
},
{
"hostNameRange":"hdfs-[43-44].vmlocal",
"hostTemplateRefName":"HostTemplate-0-from-hdfs-[43-44].vmlocal"
}
],
"lenient":false
}
}
... View more
08-20-2025
06:49 AM
Hi, we using the cdh_version: 7.1.9 and cm_version: 7.11.3 We want to deploy the cloudera manager with the json template file for our test automation. We want to use the rest API call "/cm/importClusterTemplate?addRepositories=true". But we get the following error when we deploy the template json file. {"message": "The following host(s) are not available: hdfs-11.vmlocal,hdfs-14.vmlocal,hdfs-12.vmlocal,hdfs-13.vmlocal." The hdfs nodes are available and can be ping or ssh from the cloudera host. The following packages are installed on each hdfs node: cloudera-manager-daemons-7.11.3.7-52024171.el8.x86_64
cloudera-manager-agent-7.11.3.7-52024171.el8.x86_64
openjdk8-1.8.0_372_cloudera-1.x86_64 The cloudera-scm-agent running and the server_host entry in /etc/cloudera-scm-agent/config.ini points to the cloudera manager host (server_host=10.0.100.101) We have read the cloudera documentation multiple times. Does anyone has an idea why this error appears or how we can verify that the cloudera manager knows this hosts. If we switch to the cloudera gui the hdfs nodes are find and it works.
... View more
Labels:
- Labels:
-
Cloudera Manager
07-16-2025
01:36 AM
Hi @upadhyayk04, thanks for you answer and the link to the documentation you pointed us. But we have read the documentation multiple time but it doesn't help us We need to understand why we get this error. So we still get the error. By mistake I pressed the resolve button, even the problem is not solved. Is there any way to reopen this post ?
... View more
07-10-2025
07:52 AM
We would like to automate the installation / configuration of the Cloudera Manager instead of using the GUI. We are using ansible for the automation steps. We have uploaded the license file with the REST API call in ansible. This works fine. Now we try to import a cluster template that we took from another setup. We did some modification at that template and start to do the import via ansible. The import failed with an error that the cluster host can't are not available. The cluster hosts are available, they can be ping from the cloudera manager host. The cloudera-scm-agent are installed at cluster host and up and running. The /var/log/cloudera-scm-server log shows two java exceptions and the following message The following host(s) are not available: test-22.vmlocal,test-23.vmlocal,test-21.vmlocal,test-24.vmlocal. 2025-07-10 15:50:44,353 INFO scm-web-75:com.cloudera.api.ApiExceptionMapper: Exception caught in API invocation. Msg:The following host(s) are not available: test-22.vmlocal,test-23.vmlocal,test-21.vmlocal,test-24.vmlocal.
java.lang.IllegalArgumentException: The following host(s) are not available: test-22.vmlocal,test-23.vmlocal,test-21.vmlocal,test-24.vmlocal.
at com.google.common.base.Preconditions.checkArgument(Preconditions.java:143)
at com.cloudera.api.dao.impl.ClouderaMasterServerDaoImpl.validateAndPrepareContext(ClouderaMasterServerDaoImpl.java:309)
at com.cloudera.api.dao.impl.ClouderaMasterServerDaoImpl.importClusterTemplate(ClouderaMasterServerDaoImpl.java:235)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) My question now is - Do we need to add those cluster host to the cloudera manager first (via the rest api call), before we import the template ? - how does the cloudera manager check are the hosts available (via the cloudera-scm-agent) ??
... View more
Labels:
- Labels:
-
Cloudera Manager