Incremental record count after Kerberos Authentication implementation and Ranger Installation

Question

Hi.....

We are using following commands to get the updated records count in our table after Kerberos Authentication implementation and Ranger Installation.

We get count1 variable before update the table

count1=$(beeline -u "jdbc:hive2://dev-lisa.realm.com:10000/default;principal=hive/dev-lisa.intranet.slt.com.lk@REALM.COM;ssl=true;sslTrustStore=/var/lib/cloudera-scm-agent/agent-cert/cm-auto-global_truststore.jks" -n hadoopuser02 -e 'SELECT count(*) from table_name; ')

We get count2 variable after update the table

count2=$(beeline -u "jdbc:hive2://dev-lisa.realm.com:10000/default;principal=hive/dev-lisa.intranet.slt.com.lk@REALM.COM;ssl=true;sslTrustStore=/var/lib/cloudera-scm-agent/agent-cert/cm-auto-global_truststore.jks" -n hadoopuser02 -e 'SELECT count(*) from table_name; ')

entries=$(echo "$count2-$count1")

we unable to get the "entries" value into variable. please support to fix this.

smruti · Accepted Answer

@Choolake Try this:count1=$(beeline -u "jdbc:hive2://dev-lisa.realm.com:10000/default;principal=hive/dev-lisa.intranet.slt.com.lk@REALM.COM;ssl=true;sslTrustStore=/var/lib/cloudera-scm-agent/agent-cert/cm-auto-global_truststore.jks" --showHeader=false --silent=true --outputformat=tsv2 -e 'SELECT count(*) from table_name;')  These beeline flags will remove all the unnecessary texts from the stdout. Compute count2 the same way.

smruti · Answer

@Choolake Try :entries=$((count2-count1))This should work provided we have valid values on both variables.

Sign up

Please use your Cloudera account.

Login to the community

Please use your Cloudera account.