Member since
11-08-2016
15
Posts
0
Kudos Received
1
Solution
My Accepted Solutions
Title | Views | Posted |
---|---|---|
3481 | 05-21-2017 05:45 PM |
09-05-2017
06:10 PM
@btandel Good to know you got that message. Did you "Create Table As Select (CTAS) " from 2 different tables to see the lineage?
... View more
10-11-2017
12:33 PM
1 Kudo
@btandel @Saurabh, Did you try setting "livy.spark.yarn.appMasterEnv.PYSPARK3_PYTHON" in the livy interperter setting. Use %livy.python3 in your paragraph. Thanks, Aditya
... View more
06-20-2017
01:29 PM
@btandel It's not a must, usually the default (FIFO) scheduling policy works fine, because in a usual use case you need to be "fair" (in a sense) among the queues, not within one queue. But if you need equal resource sharing within one queue, it does make perfect sense.
... View more
05-21-2017
05:45 PM
Thanks a lot @Geoffrey Shelton Okot, @Namit Maheshwari and @snukavarapu for the support. However we found the issue, one of the internal port was already in used and so it was not coming up. We finally resolved by killing the process and restarting the datanode.
... View more