Member since
07-16-2017
4
Posts
0
Kudos Received
0
Solutions
05-07-2019
02:26 AM
2 Kudos
Hi MKay, As mentioned in my previous posts the Anaconda parcel for CDH comes only with Python 2.7 and I could find a free way to get a parcel with Python 3+. We ended up manually installing the different Python versions we needed by keeping different virtual envs for different Python versions. We executed the following procedure to install python 3.5: yum install python-pip curl "https://bootstrap.pypa.io/get-pip.py" -o "get-pip.py" python get-pip.py pip install virtualenv yum install -y https://centos7.iuscommunity.org/ius-release.rpm yum install -y python35u python35u-libs python35u-devel python35u-pip mkdir -p /opt/venv35 cd /opt/venv35 virtualenv venv35 -p python3.5 source venv35/bin/activate Best, Eyal
... View more
03-25-2019
08:06 AM
Hi, So how do you scale Hive Metastore when you need to support more than 80 active connections? According to Cloudera's documentation they only mention supporting up to 80 connections which needs 16-24GB. Does passing 80 connection requires to continue extending the Heap Memory? How big can it be since 24GB is already too big isn't it? Attaching Cloudera's memory setup recommendations: https://www.cloudera.com/documentation/enterprise/5-15-x/topics/cdh_ig_hiveserver2_configure.html Best, Eyal
... View more