Member since
04-09-2021
2
Posts
0
Kudos Received
0
Solutions
05-05-2021
04:10 PM
Hey everyone.
I'm in the process of migrating data from a CDH 6.3.2 cluster to CDP 7.1.6.
I'm using distcp to migrate data as it seems to be impossible to perform in-place migrations from CDH 6.3.2 and CDP 7.1.6 (according to cloudera documentation -- https://docs.cloudera.com/cdp-private-cloud/latest/upgrade/topics/cdpdc-upgrade-paths.html).
I migrated all the resources that I need from HDFS but now I would like to also migrate the yarn application logs (the ones that we can access in resource manager UI or using yarn logs command).
I tried to use distcp to copy the logs from the old cluster to the new, to the directory that is configurable using yarn-site.xml. However, the migrated logs don't appear in resource manager UI neither using yarn logs -applicationId <app-id>. There is any way to make the logs from the old cluster available in the new cluster and accessible via resource manager or using the yarn logs command?
Thanks in advance.
Cheers!
... View more
Labels:
04-09-2021
01:29 AM
Hi everyone, I noticed that after CDP 7.1.2.1, you aren't exposing the yum repositories anymore, at least in the URLs that I know. For example, in https://archive.cloudera.com/p/cdh7/7.1.2.1/redhat7/yum/ we have access to packages like hadoop, but in https://archive.cloudera.com/p/cdh7/7.1.6.0/ we don't have access to yum path anymore and it becomes impossible to install the packages that you distribute with CDP 7.1.6 using yum. Do you provide access to the yum repository in any other location or are we forced to install cloudera manager if we want to have access to some packages that could be installed previously with yum but now only using parcels? Thanks in advance.
... View more