Incremental record count after Kerberos Authentication implementation and Ranger Installation

[#1]

Hi.....

We are using following commands to get the updated records count in our table after Kerberos Authentication implementation and Ranger Installation.

We get count1 variable before update the table

count1=$(beeline -u "jdbc:hive2://dev-lisa.realm.com:10000/default;principal=hive/[email protected];ssl=true;sslTrustStore=/var/lib/cloudera-scm-agent/agent-cert/cm-auto-global_truststore.jks" -n hadoopuser02 -e 'SELECT count(*) from table_name; ')

We get count2 variable after update the table

count2=$(beeline -u "jdbc:hive2://dev-lisa.realm.com:10000/default;principal=hive/[email protected];ssl=true;sslTrustStore=/var/lib/cloudera-scm-agent/agent-cert/cm-auto-global_truststore.jks" -n hadoopuser02 -e 'SELECT count(*) from table_name; ')

entries=$(echo "$count2-$count1")

we unable to get the "entries" value into variable. please support to fix this.

[#2]

@Choolake Try :

entries=$((count2-count1))

This should work provided we have valid values on both variables.

[#3]

Thank you for the support comment. still issue not fixed. i think there is an issue in count1 and count2 getting commands. Please support?

[#4 · Accepted solution]

@Choolake Try this:

count1=$(beeline -u "jdbc:hive2://dev-lisa.realm.com:10000/default;principal=hive/[email protected];ssl=true;sslTrustStore=/var/lib/cloudera-scm-agent/agent-cert/cm-auto-global_truststore.jks" --showHeader=false --silent=true --outputformat=tsv2 -e 'SELECT count(*) from table_name;')
 

 These beeline flags will remove all the unnecessary texts from the stdout. Compute count2 the same way.

[#5]

Great... Thank you very much!

it's working....