@sivasaravanakumar k You would need to do something like this gunzip -c fileinRC_2015-01.bz2 | hadoop fs -put - /path/fileinhdfs ... View more

@mlanciaux Please see this thread. ... View more

@Ali Bajwa Spark on YARN 4X usage compared to on MESOS* * http://cdn2.hubspot.net/hubfs/438089/DataBricks_Surveys_-_Content/Spark-Survey-2015-Infographic.pdf?t=1443116345933 Kerberos Support Dynamic Executor Allocation – Scale up & down Dynamic Executor Allocation with Data locality (Hortonworks Eng added Data locality to dynamic executor allocation) Better cluster utilization - More than one Executor per node Spark on Mesos No Kerberos Support No data locality for Dynamic Executor Allocation Dynamic executor Allocation – Only scale down*** Inefficient cluster utilization – limits one executor per slave**** http://spark.apache.org/docs/latest/running-on-mes... http://apache-spark-developers-list.1001551.n3.nab... ... View more

@Mike Li I believe you are giving ldap url as Primary URL* {host:port} (ldap://ldap.xxxxxxx.com:389): ldap://ldap.xxxxx.com:389 Please see the following format. Primary URL* {host:port} xxxxx:389 ( You don't need to give ldap://xxxxx:389) http://docs.hortonworks.com/HDPDocuments/Ambari-2.1.2.1/bk_Ambari_Security_Guide/content/_setting_up_ldap_user_authentication.html authentication.ldap.primaryUrlserver:portThe hostname and port for the LDAP or AD server. Example: my.ldap.server:389 ... View more