Member since
05-04-2018
30
Posts
0
Kudos Received
0
Solutions
05-22-2018
07:08 PM
Exit code 137 generally means, containers are killed are killed by OS due to lack of memory. Check output of below command: cat /var/log/messages|grep 'Kill process' There is less memory available in nodemanager to run container. Check you memory parameters settings for yarn nodemanager and container whether there is possiblity to decrease.
... View more
05-08-2018
03:06 AM
@Sim kaur <property>
<name>hive.spark.client.connect.timeout</name>
<value>1000ms</value>
<description>
Expects a time value with unit (d/day, h/hour, m/min, s/sec, ms/msec, us/usec,ns/nsec), which is msec if not specified. Timeout for remote Spark driver in connecting back to Hive client.
</description>
</property>
<property>
<name>hive.spark.client.server.connect.timeout</name>
<value>90000ms</value>
<description>
Expects a time value with unit (d/day, h/hour, m/min, s/sec, ms/msec, us/usec, ns/nsec), which is msec if not specified. Timeout for handshake between Hive client and remote Spark driver. Checked by
both processes.
</description>
</property> You can add the above properties in hive-site.xml. As the Spark will refer the hive-site.xml file, it will automatically gets updated in spark config. Hope this helps you.
... View more
05-07-2018
07:37 AM
@Sim kaur Can you share the latest version of these 2 files /var/log/hive/*.err and /var/log/hive/*.log
... View more