Bundle Anonymization fails with NPE after upgrade

[#1]

Symptoms:

Bundle capture will fail with the following error found in the hst-agent.log, during the anonymization process:

ERROR anonymize.py:62 - Execution of script /usr/jdk64/jdk1.7.0_67/bin/java -Xmx2048m
-Xms1024m -Dlog.file.name=anonymization.log -cp :/etc/hst/conf/:/usr/hdp/share/hst/hst-common/lib/* com.hortonworks.smartsense.anonymization.Main -m /var/lib/smartsense/hst-agent/data/tmp/06-01-17.io-a-00000000-c-00000000_hdp_0_2017-06-01_12-00-00 -c /etc/hst/conf/hst-agent.ini failed 

ERROR anonymize.py:63 - Execution of command returned 1. 

Exception in thread "main" java.lang.NullPointerException at
com.hortonworks.smartsense.anonymization.rules.RuleType.from(RuleType.java:47) at
com.hortonworks.smartsense.anonymization.rules.Rules.createRule(Rules.java:161)at
com.hortonworks.smartsense.anonymization.rules.Rules.createRules(Rules.java:148)at
com.hortonworks.smartsense.anonymization.rules.Rules.createRules(Rules.java:132)at
com.hortonworks.smartsense.anonymization.AnonymizerFactory.createAnonymizer(AnonymizerFactory.java:94)at
com.hortonworks.smartsense.anonymization.Main.start(Main.java:202) at
com.hortonworks.smartsense.anonymization.Main.main(Main.java:294) 


ERROR AnonymizeBundleCommand.py:60 - Anonymization failed. Please check logs. Traceback (most recent call last): 
File "/usr/hdp/share/hst/hst-agent/lib/hst_agent/command/AnonymizeBundleCommand.py",
line 56, in execute  
context['bundle_dir'] = anonymizer.anonymize(bundle_dir)  
File "/usr/hdp/share/hst/hst-agent/lib/hst_agent/anonymize.py",
line 64, in anonymize  
raise Exception("Anonymization failed.") Exception: Anonymization failed.

Diagnosis:

During the SmartSense HST upgrade process, the anonymization-rules.json file will be modified. This error typically indicates that the process of updating/modifying the anonymization-rules.json file somehow failed to complete successfully.

Solution:

This exception occurs when the /etc/hst/conf/anonymization-rules.json file does not update as expected during the upgrade process. To correct this you must first replace the anonymization-rules.json with the valid base version and then re-add any customizations that you had prior to the upgrade.

Administrators can extract a valid version of the anonymization-rules.json from the RPM using the rpm2cpio utility in Linux or Mac. The extracted file should then be manually copied out to /etc/hst/conf/anonymization-rules.json on the server where the HST server is installed. Once this has been done, you can then re-add any customizations that you had prior to the upgrade via the UI.