For evaluation purpose, I am planning to install everything on the same host machine. Do I have to install Ambari-Agent also before I can add the host machine as a node in the cluster ??
Yes, install both server and agent on same node. Be careful with trying to do too many components/services on a single node with small ram/cores. If you try to run/install all of them you will have troubles getting cluster stable. Minimal install is like Hdfs, Yarn, MapReduce, AmbariMetrics, Zookeeper, Hive/Tez, Ranger.
If this answer resolves your issue or allows you to move forward, please choose to ACCEPT this solution and close this topic. If you have further dialogue on this topic please comment here or feel free to private message me. If you have new questions related to your Use Case please create separate topic and feel free to tag me in your post.