Member since
11-04-2016
74
Posts
16
Kudos Received
7
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
3184 | 02-28-2019 03:22 AM | |
2842 | 02-01-2019 01:15 AM | |
4083 | 04-16-2018 03:38 AM | |
32375 | 09-16-2017 04:36 AM | |
8991 | 09-11-2017 02:43 PM |
11-19-2018
04:05 AM
Hi @Harsh J You mentioning the Safe Valve gave me an idea! I thought maybe the UI in CM is not setting one or both of those key/values. So I did this manually and it worked! Now every container asked by Spark Pipe() has the same owner as the Spark application itself (no more nobody or yarn! - there must be something with the UI that won't map one of those two configs back to yarn-site.xml):
... View more
11-18-2018
04:48 PM
Have you found any way to run YARN container as the user who'is launched it? I also have set these two and have all the nodes sync with LDAP, still runs as nobody despite the fact I can see it says the yarn user request is ...
... View more
06-22-2018
01:17 AM
Hi I'm still get error in CDH 14 and spark2-shell
... View more
06-20-2018
01:55 PM
As you mentioned correctly Apache Spark is offering MlLib (or ML) which it comes with a set of features for some basic NLP, most popular algorithms for clustering and classifications, etc. But that is not all! You can use many libraries which are released to complete Spark in a domain of Machine Learning and Deep Learning. Basically, these libraries are using Spark APIs and Engine. You can have a look here (or other lists): https://github.com/awesome-spark/awesome-spark#machine-learning-extension
... View more
04-16-2018
03:38 AM
I followed the instruction of downgrading back to 5.14.1 on Ubuntu from here: https://www.cloudera.com/documentation/enterprise/5-14-x/topics/cm_ag_downgrade_to_cm4.html The server started without a problem, I upgraded CM to 5.14.2 on all the masters again and on the Web console, I upgraded agents to 5.14.2 on all the machines. I am guessing an interruption caused by the unexpected shutdown or a leftover of hard-coded apt pointing to 5.14.1 may have caused this. But now everything has been resolved. Thank you.
... View more
01-22-2018
07:48 AM
1 Kudo
Unfortunately this happened again in 5.13.1 as I did "Update Hive Metastore NameNodes" and it added the port twice.
... View more
11-02-2017
01:57 AM
1 Kudo
I think you are missing this which it was mentioned here: [desktop] use_new_editor=true Hope it helps
... View more
10-20-2017
04:25 AM
3 Kudos
I had the simillar issue, although symlinking did not help. What I did was setting livy.repl.enableHiveContext = true in my livy.conf file. It is commented by default.
... View more
09-14-2017
12:42 PM
Hi, Set this in livy-env.sh instead to get it working in a more maintainable way: export HADOOP_CONF_DIR=/etc/hive/conf
... View more
02-06-2017
11:15 AM
Same for me in CDH 5.10 and latest Livy. Everything else is ok as long as Hive is not involved.
... View more
- « Previous
-
- 1
- 2
- Next »