Member since
10-06-2017
8
Posts
0
Kudos Received
0
Solutions
01-15-2020
07:40 AM
... you have to adapt the configuration to your needs, of course, by changing metastore host and warehouse dir, accordingly
... View more
01-15-2020
07:39 AM
Although this thread is quite old, I post my solution, as it may still be helpful to some people. I encountered the problem in spark2-shell, as the hive metastore.uri was not set in client mode, After adding the following to spark-defaults.conf (via cloudera manger's Spark 2 Client Advanced Configuration Snippet (Safety Valve) for spark2-conf/spark-defaults.conf) spark.sql.warehouse.dir=hdfs://nameservice1/user/hive/warehouse spark.executor.extraJavaOptions=-Dhive.metastore.uris=thrift://hive.metastore.net:9083 spark.driver.extraJavaOptions=-Dhive.metastore.uris=thrift://hive.metastore.net:9083 I could list and access all tables from the hive metastore from within spark-shell.
... View more
11-23-2018
10:07 AM
Hi, according to the CDH6 datasheet the free version is limited to 100 nodes. We currently run CDH 5.14 with more than hundred nodes, does this mean, I cannot upgrade to CDH6 or does this only apply to a "new" cluster ? Cheers, Maurice
... View more
10-04-2018
12:54 AM
There is the same question related to debian (see https://community.cloudera.com/t5/CDH-Manual-Installation/CDH-6-supported-OS/td-p/79686) do you have an answer to this one as well? Best regards, Maurice
... View more