Community Articles

Find and share helpful community-sourced technical articles.
Labels (1)
avatar
Contributor

There are 4 options available for SmartSense Server to upload bundles to Hortonworks Datalake, depending on the

HDP environment and customer preference. Below are more details about each options and how to configure the same.


Option 1: Direct Connection from SmartSense Server

40522-hst-direct.png

SmartSense Server (with embedded Gateway in 1.3.0 and above) having direct connection to Hortonworks Datalake.

No additional configurations needed. SmartSense is preconfigured to connect to Datalake via HTTPS protocol

Option 2: Dedicated Gateway Server with direct connection

40523-hst-gw.png

When using SmartSense version earlier to 1.3.0, we need a gateway host to be configured to upload bundles.

Also in an SmartSense 1.3.0 environment with multiple HDP clusters running, they can be configured to share

a dedicated Gateway Server to upload the bundles. If needed the Gateway Server can be located in DMZ area as well.


Step 1: Install / Configure SmartSense Gateway Software.

To install and configure SmartSense Gateway Software on the Dedicated Gateway Server use the procedures from below links, corresponding to the SmartSense version used.

SmartSense 1.2.0 :

https://docs.hortonworks.com/HDPDocuments/SS1/SmartSense-1.2.0/bk_smartsense_admin/content/hst_gatew...

SmartSense 1.3.0 :

https://docs.hortonworks.com/HDPDocuments/SS1/SmartSense-1.3.0/bk_installation/content/gateway_insta...


Step 2: Configure SmartSense Server to use the Dedicated Gateway Host

Use the below links to configure SmartSense Server, corresponding to versions

SmartSense 1.2.0:

https://docs.hortonworks.com/HDPDocuments/SS1/SmartSense-1.2.0/bk_smartsense_admin/content/ambari_hs...

SmartSense 1.3.0 :

https://docs.hortonworks.com/HDPDocuments/SS1/SmartSense-1.3.0/bk_installation/content/ambari_gatewa...


Option 3: Embedded Gateway Server via Proxy

When the SmartSense Server with Embedded Gateway doesn't have direct connection to Internet, it can be configured

to use an existing HTTP / HTTPS Proxy server to reach Hortonworks Datalake Server.

Configure /etc/hst/conf/gateway.ini file on the SmartSense Server host as below.

; All proxy configurations are applicable only for HTTPS provider type 
; set to true to set up a proxy between gateway and SmartSense environment 
provider.https.proxy.enabled=true 
; fully qualified proxy hostname 
provider.https.proxy.hostname= mysquid.mydomain.com
; proxy port that will be used by gateway for outbound access 
provider.https.proxy.port= 3128 
; supported proxy types : HTTP / HTTPS [default:HTTP] 
provider.https.proxy.type=HTTP 
; supported proxy authentication types : NONE / BASIC / DIGEST [default:NONE] 
provider.https.proxy.auth.type= NONE 
; proxy username for identified auth.type 
provider.https.proxy.auth.username= <proxy_user_name_if_needed> 
; proxy password for identified auth.type 
provider.https.proxy.auth.password= <proxy_user_password> 
; [optional] any additional proxy setup parameters 
; use "|" to separate multiple parameters 
; for example: digest requires parameters such as 
; realm=default|nonce=12GHtqeZA!7Ke43 
provider.https.proxy.auth.parameters=

Also add the following parameter under [gateway] section

[gateway] 
start.validation.enabled=false



Option 4: Dedicated Gateway Server via Proxy

When the Dedicated Gateway Server doesn't have direct connection to Internet, it can configured to

use an existing HTTP / HTTPS Proxy server to reach Hortonworks Datalake server.

Configure /etc/hst/conf/gateway.ini file on the Gateway host as below.

; All proxy configurations are applicable only for HTTPS provider type 
; set to true to set up a proxy between gateway and SmartSense environment 
provider.https.proxy.enabled=true 
; fully qualified proxy hostname 
provider.https.proxy.hostname= mysquid.mydomain.com
; proxy port that will be used by gateway for outbound access 
provider.https.proxy.port= 3128 
; supported proxy types : HTTP / HTTPS [default:HTTP] 
provider.https.proxy.type=HTTP 
; supported proxy authentication types : NONE / BASIC / DIGEST [default:NONE] 
provider.https.proxy.auth.type= NONE 
; proxy username for identified auth.type 
provider.https.proxy.auth.username= <proxy_user_name_if_needed> 
; proxy password for identified auth.type 
provider.https.proxy.auth.password= <proxy_user_password> 
; [optional] any additional proxy setup parameters 
; use "|" to separate multiple parameters 
; for example: digest requires parameters such as 
; realm=default|nonce=12GHtqeZA!7Ke43 
provider.https.proxy.auth.parameters=

Also add the following parameter under [gateway] section

[gateway] 
start.validation.enabled=false
Notes: 

1. From SmartSense 1.3.0, SmartSense Gateway uses HTTPS protocol by default. Earlier versions used SFTP protocol.

2. For configuring HTTPS Proxy with HST Gateway, please contact Hortonworks Support to import the Proxy servers SSL certificate. 
3,824 Views