I want to know how shall i decide upon the --executor-cores,--executor-memory,--num-executors considering i have cluster configuration as : 40 Nodes,20 cores each,100GB each. I have a data in file of 2GB size and performing filter and aggregation function. How much value should be given to parameters for --spark-submit command and how will it work. (I don't want to use dynamic memory allocation for this particular case) ... View more

Please tell me what is the minimum specification required in laptop for HDPCD exam? I am aware that screen resolution should be 1600*900. But can someone tell me about minimum RAM and any other specific hardware requirements? ... View more

For HDPCD Exam, All the Deamons will already be running in exam? In practice test i had to start the services by executing command specified in reference PDF and in one case i had to restart ambari also. I just want to know, do i have to start services in real exam also as it took quite a while to up and running all the services? If yes, Will this time will be consider to start all services? or how time is noted in real exam? ... View more

Is it necessary to remove header record while analysis of CSV format file? When i checked solution for practice exam of HDPCD I observed, header record for CSV is not been removed and data is analysed. Shall we remove the header record or not ,because it may affect the final output and record count? How this kind of solutions will be rated in real exam? ... View more