Data loading in CDP Private Cloud using beeline and impala-shell

Prerequisites 

• Base cluster with Hive on Tez, Zookeeper, Spark services installed 
• DDL files copied to the base cluster

Steps

Using beeline

1. Kinit with hive user to base cluster host where Zookeeper is installed. We can get Zookeeper using CM client services.
   Example:
2. Execute beeline command on Zookeeper host. Sample beeline URL:
   

   beeline -f {data.sql} -u 'jdbc:hive2://{zookeeper_server}:2181/default;" \
f"serviceDiscoveryMode=zooKeeper;ssl=true;sslTrustStore={crt.jks};trustStorePassword={password}


Using Impala shell  

• Kinit with impala user to base cluster host where Zookeeper/impala-server is installed. We can get Zookeeper, impala server using CM client services 
• Execute impala-shell command on Zookeeper/Impala host. Sample impala-shell command: 
  

  impala-shell -i {impala_server}:25003 -d default -k --ssl -f {data}.sql