Member since
08-06-2020
5
Posts
0
Kudos Received
0
Solutions
08-20-2020
03:40 AM
@abajwa , Thanks - I am able to use the new AMI
... View more
08-19-2020
07:02 AM
@abajwa , I have tried to use the given AMI and received the below message. You currently do not have a Cloudera Data Platform License.
Please upload a valid license to access Cloudera Manager Admin Console. Your cluster is still functional, and all of your data remains intact. Do you know how to get the 60 days trail version added to the given AMI file? Thanks in advance
... View more
08-09-2020
08:15 AM
@carrossoni , Thanks for the inputs. After checking the file /etc/cloudera-scm-agent/config.ini it has server_host=10.0.2.15 listening_ip=found: I have changed the values as below. server_host=cloudera listening_ip=10.0.2.15 and restarted the cloudera-scm-agent "sudo service cloudera-scm-agent restart" After almost 90 minutes wait, the parcels download is completed and I can see the services up and running on CM. Thanks for your kind support.
... View more
08-08-2020
04:09 AM
@carrossoni , when I open Cloudera Manager, it is taking me to the installation page. That means it has not registered the hosts yet. The error is also confirming that " Deployment should contain hosts. It must be something to deal with the below function. mgmt_api.auto_assign_roles() # needed? If I comment that and run below via "vagrant ssh", python ~/CDPDCTrial/scripts/create_cluster.py ~/CDPDCTrial/conf/cdpsandbox.json
{'active': False,
'can_retry': True,
'children': {'items': []},
'cluster_ref': None,
'end_time': '2020-08-08T08:06:09.975Z',
'host_ref': None,
'id': 16.0,
'name': 'GlobalHostInstall',
'parent': None,
'result_data_url': 'http://cloudera:7180/cmf/command/16/download',
'result_message': 'Failed to complete installation.',
'role_ref': None,
'service_ref': None,
'start_time': '2020-08-08T08:04:44.671Z',
'success': False}
Traceback (most recent call last):
File "/root/CDPDCTrial/scripts/create_cluster.py", line 78, in <module>
mgmt_api.setup_cms(body=api_service)
File "/usr/lib/python2.7/site-packages/cm_client/apis/mgmt_service_resource_api.py", line 1013, in setup_cms
(data) = self.setup_cms_with_http_info(**kwargs)
File "/usr/lib/python2.7/site-packages/cm_client/apis/mgmt_service_resource_api.py", line 1091, in setup_cms_with_http_info
collection_formats=collection_formats)
File "/usr/lib/python2.7/site-packages/cm_client/api_client.py", line 326, in call_api
_return_http_data_only, collection_formats, _preload_content, _request_timeout)
File "/usr/lib/python2.7/site-packages/cm_client/api_client.py", line 153, in __call_api
_request_timeout=_request_timeout)
File "/usr/lib/python2.7/site-packages/cm_client/api_client.py", line 379, in request
body=body)
File "/usr/lib/python2.7/site-packages/cm_client/rest.py", line 273, in PUT
body=body)
File "/usr/lib/python2.7/site-packages/cm_client/rest.py", line 219, in request
raise ApiException(http_resp=r)
cm_client.rest.ApiException: (400)
Reason: Bad Request
HTTP response headers: HTTPHeaderDict({'X-XSS-Protection': '1; mode=block', 'X-Content-Type-Options': 'nosniff', 'Transfer-Encoding': 'chunked', 'Set-Cookie': 'SESSION=b8021e6e-91e8-4b18-895e-8cd1f3a287a0;Path=/;HttpOnly', 'Expires': 'Thu, 01 Jan 1970 00:00:00 GMT', 'Pragma': 'no-cache', 'Cache-Control': 'no-cache, no-store, max-age=0, must-revalidate', 'Date': 'Sat, 08 Aug 2020 08:06:10 GMT', 'X-Frame-Options': 'DENY', 'Content-Type': 'application/json;charset=utf-8'})
HTTP response body: {
"message" : "Cannot find a suitable default host for cluster 'null'."
}
... View more
08-06-2020
02:27 AM
Just tried to follow instructions and received the error below when I run Vagrant Up command. Any help is much appreciated. default: 'result_data_url': 'http://cloudera:7180/cmf/command/12/download',
default: 'result_message': 'Failed to complete installation.',
default: 'role_ref': None,
default: 'service_ref': None,
default: 'start_time': '2020-08-06T09:22:58.606Z',
default: 'success': False}
default: Traceback (most recent call last):
default: File "/root/CDPDCTrial/scripts/create_cluster.py", line 76, in <module>
default: mgmt_api.auto_assign_roles() # needed?
default: File "/usr/lib/python2.7/site-packages/cm_client/apis/mgmt_service_resource_api.py", line 65, in auto_assign_roles
default: (data) = self.auto_assign_roles_with_http_info(**kwargs)
default: File "/usr/lib/python2.7/site-packages/cm_client/apis/mgmt_service_resource_api.py", line 131, in auto_assign_roles_with_http_info
default: collection_formats=collection_formats)
default: File "/usr/lib/python2.7/site-packages/cm_client/api_client.py", line 326, in call_api
default: _return_http_data_only, collection_formats, _preload_content, _request_timeout)
default: File "/usr/lib/python2.7/site-packages/cm_client/api_client.py", line 153, in __call_api
default: _request_timeout=_request_timeout)
default: File "/usr/lib/python2.7/site-packages/cm_client/api_client.py", line 379, in request
default: body=body)
default: File "/usr/lib/python2.7/site-packages/cm_client/rest.py", line 273, in PUT
default: body=body)
default: File "/usr/lib/python2.7/site-packages/cm_client/rest.py", line 219, in request
default: raise ApiException(http_resp=r)
default: cm_client.rest.ApiException
default: : (400)
default: Reason: Bad Request
default: HTTP response headers: HTTPHeaderDict({'X-XSS-Protection': '1; mode=block', 'X-Content-Type-Options': 'nosniff', 'Transfer-Encoding': 'chunked', 'Set-Cookie': 'SESSION=9d9bab89-f03e-4fd6-aba7-8eaa64a38128;Path=/;HttpOnly', 'Expires': 'Thu, 01 Jan 1970 00:00:00 GMT', 'Pragma': 'no-cache', 'Cache-Control': 'no-cache, no-store, max-age=0, must-revalidate', 'Date': 'Thu, 06 Aug 2020 09:24:24 GMT', 'X-Frame-Options': 'DENY', 'Content-Type': 'application/json;charset=utf-8'})
default: HTTP response body: {
default: "message" : "Deployment should contain hosts."
default: }
default: usermod: group 'hadoop' does not exist
default: sudo: unknown user: hdfs
default: sudo: unable to initialize policy plugin
default: sudo: unknown user: hdfs
default: sudo: unable to initialize policy plugin
default: sudo: unknown user: hdfs
default: sudo: unable to initialize policy plugin
default: sudo: unknown user: hdfs
default: sudo: unable to initialize policy plugin
default: sudo: unknown user: hdfs
default: sudo: unable to initialize policy plugin As it has failed to run create_cluster.py, I have ssh to vargant box and tried and received the below error message [root@cloudera ~]# python ~/CDPDCTrial/scripts/create_cluster.py ~/CDPDCTrial/conf/cdpsandbox.json
{'active': False,
'can_retry': True,
'children': {'items': []},
'cluster_ref': None,
'end_time': '2020-08-06T11:10:10.014Z',
'host_ref': None,
'id': 16.0,
'name': 'GlobalHostInstall',
'parent': None,
'result_data_url': 'http://cloudera:7180/cmf/command/16/download',
'result_message': 'Failed to complete installation.',
'role_ref': None,
'service_ref': None,
'start_time': '2020-08-06T11:08:49.716Z',
'success': False}
Traceback (most recent call last):
File "/root/CDPDCTrial/scripts/create_cluster.py", line 76, in <module>
mgmt_api.auto_assign_roles() # needed?
File "/usr/lib/python2.7/site-packages/cm_client/apis/mgmt_service_resource_api.py", line 65, in auto_assign_roles
(data) = self.auto_assign_roles_with_http_info(**kwargs)
File "/usr/lib/python2.7/site-packages/cm_client/apis/mgmt_service_resource_api.py", line 131, in auto_assign_roles_with_http_info
collection_formats=collection_formats)
File "/usr/lib/python2.7/site-packages/cm_client/api_client.py", line 326, in call_api
_return_http_data_only, collection_formats, _preload_content, _request_timeout)
File "/usr/lib/python2.7/site-packages/cm_client/api_client.py", line 153, in __call_api
_request_timeout=_request_timeout)
File "/usr/lib/python2.7/site-packages/cm_client/api_client.py", line 379, in request
body=body)
File "/usr/lib/python2.7/site-packages/cm_client/rest.py", line 273, in PUT
body=body)
File "/usr/lib/python2.7/site-packages/cm_client/rest.py", line 219, in request
raise ApiException(http_resp=r)
cm_client.rest.ApiException: (400)
Reason: Bad Request
HTTP response headers: HTTPHeaderDict({'X-XSS-Protection': '1; mode=block', 'X-Content-Type-Options': 'nosniff', 'Transfer-Encoding': 'chunked', 'Set-Cookie': 'SESSION=3677d4cf-2406-4989-86c9-f6f896700889;Path=/;HttpOnly', 'Expires': 'Thu, 01 Jan 1970 00:00:00 GMT', 'Pragma': 'no-cache', 'Cache-Control': 'no-cache, no-store, max-age=0, must-revalidate', 'Date': 'Thu, 06 Aug 2020 11:10:10 GMT', 'X-Frame-Options': 'DENY', 'Content-Type': 'application/json;charset=utf-8'})
HTTP response body: {
"message" : "Deployment should contain hosts."
} Checked the file /root/CDPDCTrial/scripts/create_cluster.py and I can confirm that the hostname has changed to cloudera as below instargs = cm_client.ApiHostInstallArguments(
host_names=['cloudera'],
user_name='root',
private_key=key,
cm_repo_url='https://archive.cloudera.com/cm7/7.1.1/',
java_install_strategy='NONE',
ssh_port=22,
passphrase='')
... View more