Member since
07-08-2013
548
Posts
59
Kudos Received
53
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
2560 | 08-17-2019 04:05 PM | |
2541 | 07-26-2019 12:18 AM | |
8789 | 07-17-2019 09:20 AM | |
4970 | 06-18-2018 03:38 AM | |
12405 | 04-06-2018 07:13 AM |
04-03-2018
03:56 PM
The BDR should run on different hosts, does your CM Server version match our release notes [0] Only use healthy HDFS/Hive hosts for launching replication jobs BDR Replication Host Selection Policy has been updated. The process that launches and coordinates a HDFS/Hive replication job will now only run on the following hosts: Hosts that run any role of the HDFS/Hive Service (for HDFS or Hive replication) Hosts that have a Non-Gateway role Hosts where the health status is in the GOOD or CONCERNING state with preference given to GOOD Hosts that are whitelisted, if configured Cloudera: OPSAPS-40040 [0] https://www.cloudera.com/documentation/enterprise/release-notes/topics/cm_rn_fixed_issues.html#id_pd4_vrn_l1b [1] https://www.cloudera.com/documentation/enterprise/release-notes/topics/cm_rn_fixed_issues.html#rn_593
... View more
09-15-2017
01:07 AM
Quote: "Do you know when the new 5.12.x maintenance release will be available?" It's available now; [ANNOUNCE] Cloudera Enterprise 5.12.1 Released [0] [0] http://community.cloudera.com/t5/Community-News-Release/ANNOUNCE-Cloudera-Enterprise-5-12-1-Released/m-p/59612#M195
... View more
09-12-2017
10:29 AM
It seems that you are running into the same issue you've reported initially. If the workaround doesn't work, you can use the CM 5.12.1 contain the fix to allow you to proceed with the installation.
... View more
09-05-2017
09:43 AM
Hi Amit, Looking into the errors your've posted the initial issue can be likely resolved using the workaround I've posted initially. The second issue is likely that an old apt thread is locking the package manager, see below. You might need to kill the other process which is holding the lock, once you've done so it will allow the package manager to proceed with the installation. ... E: Could not get lock /var/lib/dpkg/lock - open (11: Resource temporarily unavailable)
E: Unable to lock the administration directory (/var/lib/dpkg/), is another process using it? ... Best, Michalis
... View more
09-01-2017
02:28 PM
Hi Amit, The solution I've provided was for the issue you've reported initially/at the begining of this thread, I can see that you are reporting multiple issues. Would you mind clarifying what you meant "Same error is there.", this is so I or a community member can guide you accordingly. Thank you, M
... View more
08-31-2017
10:42 AM
The bash for loop that you executed indicated which mount point is inaccessible, you should try umounting that and see if you can progress. root@PC355406:/# for mnt in $(mount|cut -d ' ' -f 3); do stat $mnt 1>/dev/null 2>&1; rc=$?; if [ $rc -ne 0 ]; then echo "error accessing $mnt"; fi; done
error accessing /run/user/1000/gvfs
... View more
08-29-2017
02:54 AM
1 Kudo
based on your stack trace, it's likely you're running into the same issue as a fellow community member [0], can you try the workaround posted in the [1] [24/Aug/2017 15:47:21 +0000] 9533 MainThread agent ERROR Failed to connect to previous supervisor.
>>Traceback (most recent call last):
>> File "/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/agent.py", line 2109, in find_or_start_supervisor
>> self.configure_supervisor_clients()
>> File "/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.12.0-py2.7.egg/cmf/agent.py", line 2290, in configure_supervisor_clients
>> supervisor_options.realize(args=["-c", os.path.join(self.supervisor_dir, "supervi-sord.conf")])
>> File "/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/supervisor-3.0-py2.7.egg/supervisor/options.py", line 1599, in realize
>> Options.realize(self, *arg, **kw)
>> File "/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/supervisor-3.0-py2.7.egg/supervisor/options.py", line 333, in realize
>> self.process_config()
>> File "/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/supervisor-3.0-py2.7.egg/supervisor/options.py", line 341, in process_config
>> self.process_config_file(do_usage)
>> File "/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/supervisor-3.0-py2.7.egg/supervisor/options.py", line 376, in process_config_file >> self.usage(str(msg))
>> File "/usr/lib/cmf/agent/build/env/lib/python2.7/site-packages/supervisor-3.0-py2.7.egg/supervisor/options.py", line 164, in usage
>> self.exit(2) >>SystemExit: 2 >>[24/Aug/2017 15:47:21 +0000] 9533 Dummy-1 daemonize WARNING Stopping dae-mon.
>>[24/Aug/2017 15:47:21 +0000] 9533 Dummy-1 agent INFO Stopping agent... [0] https://community.cloudera.com/t5/Cloudera-Manager-Installation/Cloudera-Manager-Heartbeat-Python-Supervisor-Issue-System-Exit/m-p/57547 [1] http://community.cloudera.com/t5/Cloudera-Manager-Installation/CDH-5-12-0-clouder-manager-agent-can-not-start/m-p/58726
... View more
08-17-2017
04:59 PM
"Are SSL-enabled custom parcel repositories supported?" yes, as we can use this https://archive.cloudera.com/cdh5/parcels/ Ths error is likely due to the AWS Cloudfront SNI [0], and the current version of async-http-client-1.7.5.jar that CM uses does not support SNI, see related [1a,b,c] Testing the URL with openssl excluding the -servername flag # openssl s_client -connect repository.cask.co:443
CONNECTED(00000003)
140455651178400:error:14077410:SSL routines:SSL23_GET_SERVER_HELLO:sslv3 alert handshake failure:s23_clnt.c:744:
---
no peer certificate available
---
No client certificate CA names sent
---
SSL handshake has read 7 bytes and written 247 bytes
---
New, (NONE), Cipher is (NONE)
Secure Renegotiation IS NOT supported
Compression: NONE
Expansion: NONE
--- with -servername [repository|downloads].cask.co # openssl s_client -connect repository.cask.co:443 -servername repository.cask.co </dev/null | grep "Verify"
depth=4 C = US, O = "Starfield Technologies, Inc.", OU = Starfield Class 2 Certification Authority
verify return:1
depth=3 C = US, ST = Arizona, L = Scottsdale, O = "Starfield Technologies, Inc.", CN = Starfield Services Root Certificate Authority - G2
verify return:1
depth=2 C = US, O = Amazon, CN = Amazon Root CA 1
verify return:1
depth=1 C = US, O = Amazon, OU = Server CA 1B, CN = Amazon
verify return:1
depth=0 CN = repository.cask.co
verify return:1
DONE
Verify return code: 0 (ok) setting-Djavax.net.debug=all in /etc/default/cloudera-scm-server [...] export CMF_JAVA_OPTS="... -Djavax.net.debug=all" [...] Notice handshake_failure *** ClientHello, TLSv1 [...] [Raw read]: length = 2
0000: 02 28 .(
New I/O worker #6, READ: TLSv1 Alert, length = 2
New I/O worker #6, RECV TLSv1 ALERT: fatal, handshake_failure
New I/O worker #6, fatal: engine already closed. Rethrowing javax.net.ssl.SSLException: Received fatal alert: handshake_failure
New I/O worker #6, fatal: engine already closed. Rethrowing javax.net.ssl.SSLException: Received fatal alert: handshake_failure
New I/O worker #6, called closeOutbound()
New I/O worker #6, closeOutboundInternal()
New I/O worker #6, SEND TLSv1 ALERT: warning, description = close_notify
New I/O worker #6, WRITE: TLSv1 Alert, length = 2
New I/O worker #6, called closeInbound()
New I/O worker #6, fatal: engine already closed. Rethrowing javax.net.ssl.SSLException: Inbound closed before receiving peer's close_notify: possible truncation attack?
[Raw write]: length = 7
0000: 15 03 01 00 02 01 00 .......
New I/O worker #6, called closeOutbound()
New I/O worker #6, closeOutboundInternal() We currently track this internally in /OPSAPS-30976/ Regards, Michalis [0] https://aws.amazon.com/about-aws/whats-new/2014/03/05/amazon-cloudront-announces-sni-custom-ssl/ [1a] https://groups.google.com/forum/#!topic/play-framework/T7ZhclgAAMU [1b] https://github.com/loopj/android-async-http/issues/224 [1c] https://bz.apache.org/bugzilla/show_bug.cgi?id=57935
... View more
08-17-2017
02:15 AM
If your objective: "..get the state of the last execution (failed/succeded)", and if I remember correctly each replication job generates an AUDIT event [0], a workaround would be to filter the Events [1]. On you CM> Diagnostics> Events filter; Category: AUDIT_EVENT Event Code: EV_HDFS_DISTCP parsing the COMMAND_ARGS you can get the scheduleId Then you can group the results (by COMMAND_ID) to get the execution flow COMMAND_STATUS will contain when it STARTED, FAILED, SUCCEEDED, ABORTED [0] https://cloudera.github.io/cm_api/apidocs/v17/path__events.html [1] http://cm.cloudera.com:7180/api/v12/events?query=category==AUDIT_EVENT;attributes.eventcode==EV_HDFS_DISTCP
... View more
08-16-2017
01:42 PM
The link you provided will list all your replication schedules and their job result history. If you know the replication schedule id (eg. below is id=5) perhaps using the replication/{id}/history endpoint [0] may help you. You can limit the history size by doing so. http://cm-host.cloudera.com:7180/api/v17/clusters/Cluster%201/services/HDFS-1/replications/5/history?limit=1&offset=0 [0] https://cloudera.github.io/cm_api/apidocs/v17/path__clusters_-clusterName-_services_-serviceName-_replications_-scheduleId-_history.html
... View more