I found two problems:

1. The first one was the IP address of the main host. It was using 127.0.0.1 which the new host couldn't reach.

2. I had to upgrade the Cloudera Management Agent on the new host after I installed Cloudera on it, which seems weird. You'd think it would install everything with the same version as the main host.