Looks like there are different types of AWS Load Balancers, and the one that can handle TCP sessions are either Network Load Balancer (NLB) or Classic Load Balancer. Which one are you using? I believe stickiness also works for NLB, but do validate with your AWS team.   The session timeout is two-fold: LB session timeout. These are settings inside of the load balancer, nothing to do with Impala itself. The recommendation is to set this timeout to 12 hours, 6 hours at a minimum for both client and server timeouts. Hue session timeout (idle_session_timeout). This is how long Hue will keep the connection to Impala alive. Default may be 15 minutes. If no queries run in this time amount of time, and then you run a new query, you'll get this error "Results have expired". Hue will need to start a new session. Also if your query takes longer than idle_session_timeout, then you'll definitely need to increase the timeout setting. 1 hour timeout may be appropriate here.   Regards, Alex     ... View more

Hi Andrea,   There is not much different from how you would install R and SparkR on any other host. The steps to install would be the same. How that R runtime integrates with CDP DataHub would need to be configured after the installation.  Instead of SparkR, I would actually recommend you use sparklyr, as it's more compatible with Spark.    Regards, Alex ... View more

Ok, @aval, if you are after the CDP Base requirements that are needed to install CDP Data Services (formerly experiences), then check the list at the bottom of this page:  https://docs.cloudera.com/cdp-private-cloud-data-services/1.3.4/installation-ecs/topics/cdppvc-installation-base-software-requirements.html   For all dependencies between various services, you can consult this table: https://docs.cloudera.com/cdp-private-cloud-base/7.1.7/installation/topics/cdpdc-service-dependencies.html   Hope this helps, Alex ... View more

Hello @Data1701 ,   The metrics you are looking for would be under the Hosts view in Cloudera Manager. On the left-hand panel in Cloudera Manager click on Hosts > All Hosts. This will list all of the hosts in the cluster, along with their physical memory and cores for each. Note that, by default, not all of the necessary columns may be visible in the table. To add columns of interest (e.g. cores), in the top right corner next to "Columns:" click Selected dropdown menu and choose the columns you need to see.   Hope this helps.     Regards, Alex ... View more

Hi @Ragavend,   Happy to hear that you are exploring CDP Private Cloud and taking on the learning of the platform in a lab environment. To answer your questions: 1.  There are a few steps that are needed to access CDP Private Cloud CLI. Instructions are here: https://docs.cloudera.com/management-console/1.3.3/private-cloud-cli/topics/mc-private-cloud-cli-client-setup.html. Note that you will need to allow external connections to your AWS EC2 instances in order to be able to issue commands from your laptop to the CDP cluster. This is also assuming you are talking about CDP CLI. If you are talking about AWS CLI (different tool entirely), then please see the many AWS tutorials available.  2. In order to run pyspark, the user who is executing the the job needs to be able to create a log directory on hdfs. So, instead of running your command as root (i.e. centos) try running it as your CDP admin user.    Hope this helps.   Regards, Alex ... View more

If you are talking about the little icons that show up next to the table names in the table list on the left-hand side of your Hue editor, then yes, "table" icon is a proper physical table, "eye" icon is a view defined on top of some statement.      Hope this helps, Alex ... View more

Hi @banshidhar_saho ,   Unfortunately, there is no configuration in CM that will let you change the header of the alert email or the format of the alert email. However, there is a customization you can do by developing a custom script that (a) takes in a JSON string of alerts; and (b) builds and email object and sends it off to your SMTP server.  It takes some effort to write the script, but gives you all the flexibility.   See more details here: https://docs.cloudera.com/cdp-private-cloud-base/7.1.3/monitoring-and-diagnostics/topics/cm-alerts-script.html   If this is helpful, please accept this reply as a solution.   Regards, Alex ... View more

Hi @Melon ,   Sounds like you are wanting to send an email alert (e.g. when a CDSW job finishes) via your corporate SFTP server. Is that correct? For configuring CDSW SMTP connection you will need to have at least CDSW Admin role and go to Admin > Settings (tab). Here under SMTP you will need to provide the following information: SMTP host address SMTP port SMTP username SMTP password Optionally, you may check "Use TLS" if your SMTP server requires this.    What you are talking about in terms of VPN (Citrix Gateway) is something you may want to check with your IT organization. You should be able to upload and download project files in CDSW via the browser, when you are connected through VPN.     Hope this help, Alex ... View more

Hi Alexis,   for CDP Experiences (aka Data Services) there is integration available. Please see the link below: https://docs.cloudera.com/cdp-private-cloud-experiences/1.1/installation/topics/cdppvc-installation-external-vault.html For CDP Base, I don't believe we support external vault.   Hope this helps, Alex ... View more