Member since
10-01-2018
802
Posts
143
Kudos Received
130
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
2331 | 04-15-2022 09:39 AM | |
1798 | 03-16-2022 06:22 AM | |
5262 | 03-02-2022 09:44 PM | |
2128 | 03-02-2022 08:40 PM | |
1331 | 01-05-2022 07:01 AM |
06-24-2020
02:45 PM
@Mondi As far as I know real time replication is not possible but tow cluster can be in sync using BDR feature. https://docs.cloudera.com/documentation/enterprise/6/6.3/topics/cm_bdr_replication_intro.html
... View more
06-23-2020
03:28 AM
@dv_conan Make sure the agent is heart beating in the CM > Hosts > All hosts page. Then check the agent logs (/var/log/cloudera-scm-agent/cloudera-scm-agent.log) and see if there is any error.
... View more
06-22-2020
09:26 AM
@Marek Parcels can be downloaded. This is strange I am not able to reproduce though. Can you please deactivate the CDSWc parcels and then remove the CSD and again download a fresh one and restart the CM server form terminal and let me know how this goes.
... View more
06-22-2020
06:25 AM
@Marek Please add the CSD (jar file) in the CM first as per your CDH version by following the doc below: https://docs.cloudera.com/documentation/data-science-workbench/1-7-x/topics/cdsw_install_parcel.html#csd Then restart the CM server and you will hopefully get the Parcels listed there for CDSW.
... View more
05-09-2020
06:59 AM
@ankesh_clo Can you delete below files and try to restart the agent. -rw------- 1 root root 14575 May 5 02:19 response.avro -rw------- 1 root root 2 May 6 03:09 active_parcels.json
... View more
04-30-2020
10:31 AM
3 Kudos
It was either written with less repicas by the client, or someone changed it after it was written. For example Solr Tlogs I believe are written with a replica of 1. Each DFSClient has the ability to control the number of replicas. As said, Solr uses 1 for Tlogs, MR uses (or used to use) 10 for job files for better chance of data locality. It’s a decision made by whoever creates the client. So it is expected that any file can have a different replication factor, within the limits of dfs.namenode.replication.min and dfs.replication.max which is enforced by the NameNode.
... View more
04-29-2020
05:14 AM
1 Kudo
@wert_1311 You can use the HDFS command line to ls the file. The second column of the output will show the replication factor of the file. For example, $ hdfs dfs -ls /usr/GroupStorage/data1/out.txt
-rw-r--r-- 3 hadoop test 11906625598 2020-04-29 17:31 /usr/GroupStorage/data1/test Here the replication factor is 3.
... View more
04-29-2020
04:53 AM
@ankesh_clo Looking at the logs the issue is also seems because of wrong parcel URL. 2020-04-29 01:28:33,070 ERROR ParcelUpdateService:com.cloudera.parcel.components.ParcelDownloaderImpl: (1 skipped) Failed to download manifest. Status code: 404 URI: https://archive.cloudera.com/accumulo-c6/parcels/latest/manifest.json/ The correct link is https://archive.cloudera.com/accumulo/parcels/latest/ Either correct this link in Parcel configuration or just remove this Accumulo parcel link and try again.
... View more
04-28-2020
11:05 AM
@EnableMe For trial version you have to follow the steps on Given Link. The location https://archive.cloudera.com/p/cdh7/7.0/parcels/ is for valid subscription users for which you have to follow the steps given in this Link where you have to generate a user name and password form you Valid CM license.
Trial Installation Ideal for trying CDP Data Center for the first time, this installer will download Cloudera Manager and guide you through the setup process. This creates a self-contained environment and doesn’t require installing any additional software. Users setting up CDP Data Center for production use should not use these instructions but instead follow the installation instructions in CDP documentation. Note: A trial installation cannot easily be upgraded, backed up, or migrated into a production-ready configuration without manual steps, described here. If you plan to migrate this system into a production system, consider using the Production Installation process described here instead. Pre-requisites: Creating a CDP cluster requires multiple, Internet-connected Linux machines. For details please see the CDP system requirements. Installation instructions: Type the following at a Linux command prompt to begin an automated CDP installation. $ wget https://archive.cloudera.com/cm7/7.0.3/cloudera-manager-installer.bin $ chmod u+x cloudera-manager-installer.bin $ sudo ./cloudera-manager-installer.bin
... View more
04-27-2020
10:46 AM
Yes, Can you upload agent CM server log file and agent log file (New host), let's see if we can find something.
... View more