@divyesh, Welcome to the Cloudera Community. As this is an older post, you would have a better chance of receiving a resolution by starting a new thread. This will also be an opportunity to provide details specific to your environment that could aid others in assisting you with a more accurate answer to your question. You can link this thread as a reference in your new post. ... View more

Your tip was spot on Umesh! We realised that as a part of installing CDH 5.5 and Spark, the default configuration for the parameters you mentioned, were changed (not sure how). We restored them to the default values and were able to run Pyspark and Spark-shell. Many thanks for your help. ... View more

Have you tried the solutions posted above? Enabling Intel-VT /AMD-V in the BIOS? Checking for conflicting virtualization platforms, checking the hash of the downloaded image, etc? ... View more