@egarelnabi  Hi Im trying this method and I'm also getting Heart Beat message continously. Any idea ?   Thanks ... View more

Hello! I also encountered a similar problem with you, I would like to ask you, how did you finally solve it? Thank you very much! ,, ... View more

You can see more info from YARN logs yarn logs -applicationId application_1484116726997_0144 ... View more

Without the full exception stack trace its difficult to know what happened. If you are instantiating hive then you may need to add hive-site.xml and the data-nucleus jars to the job. e.g. like --jars /usr/hdp/current/spark-client/lib/datanucleus-api-jdo-3.2.6.jar,/usr/hdp/current/spark-client/lib/datanucleus-rdbms-3.2.9.jar,/usr/hdp/current/spark-client/lib/datanucleus-core-3.2.10.jar --files /usr/hdp/current/spark-client/conf/hive-site.xml ... View more

Here is the requested info http://hdb.docs.pivotal.io/210/hawq/clientaccess/ldap.html http://hdb.docs.pivotal.io/210/hawq/clientaccess/kerberos.html ... View more

Thanks Kyle, GCP machines were somehow overriding these settings and the request size was increasing the buffer size each time the HAWQ master was trying to come up. I enforced the shmmax parameter and it successfully came up thereafter. ... View more

Hi Artem, I'm currently stuck in a particular use case where in I'm trying to access Hive Table data using spark.read.jdbc as shown below: export SPARK_MAJOR_VERSION=2 spark-shell import org.apache.spark.sql.{DataFrame, Row,SparkSession} val connectionProperties = new java.util.Properties() val hiveQuery = "(SELECT * from hive_table limit 10) tmp" val hiveResult = spark.read.jdbc("jdbc:hive2://hiveServerHostname:10000/hiveDBName;user=hive;password=hive", hiveQuery, connectionProperties).collect() But when I check for the results in hiveResult it's just empty. Could you please suggest what's going on here? I know we can access Hive tables using HiveSesssion and I've successfully tried that but is it possible to run hive queries and access Hive data using the above method? ... View more