Hi ,   How to define JSON datatype for any Attribute in Avro schema Registry? Thanks Abhishek Singh ... View more

Hi , I want to move source DB data to destination DB. Source db table has  'metadat' column, dataType='JSON'. I am using 'captureChangeMySql' processor to ready the change data from  mysql binary-log file and put a data to destination db. 'captureChangeMySql' processor to reading the change data from  mysql binary-log file but 'metadat' column, dataType='JSON' , value is showing as some encoded format. 1. Can anyone suggest why JSON datatype value is coming encoded like below? 2. Which format is it encoded and how can we get it back as a JSON data to save at destination db.   Flowfile output: [ { "id" : 18, "name" : "Transitional Licenses - Provider", "external_id" : "101", "product_tag" : null, "tenant_id" : 1, "metadata" : "\u0000\u0001\u0000I\u0000\u000B\u0000\u000E\u0000\u0002\u0019\u0000mappedProducts\u0004\u00000\u0000\f\u0010\u0000\f\u0018\u0000\f \u0000\f(\u0000\u000720-4040\u000720-4041\u000720-4042\u000720-4043", "duration_in_days" : null, "offline_completion_duration" : null, "product_code" : "cps_provider_7_ed", "external_code" : null, "external_url" : null, "short_description" : "This course is for Providers", "long_description" : "This course is for Providers", "meta_keyword" : null, "meta_description" : null, "meta_title" : null, "status" : "Active", "event_type" : "ESSENTIALS", "event_participation_type" : "REGISTER_ILE", "terms" : null, "product_type_id" : 1, "is_perpetual" : null, "sort_order" : "20", "transitional_sort_order" : null, "completion_cert_type" : null, "ecard_cert_type" : null, "ecard_validity" : null, "ecard_name" : null, "is_deleted" : "{}", "created_at" : "Thu Mar 04 13:15:53 IST 2021", "updated_at" : "Thu Mar 04 13:15:53 IST 2021", "created_by" : null, "updated_by" : null, "is_legacy" : "{0}", "has_ce" : "{}", "region" : "CA", "self_registration_override" : "{}", "allow_assignment" : "{0}", "default_license_type" : null, "dispatch_confirmation" : "{}", "multi_package" : "{}" } ] Original data in db:  {"mappedProducts": ["20-4040", "20-4041", "20-4042", "20-4043"]} ... View more

Hi, I want to  modify the ddl query table name. I am using the replaceText processor to modify the flowfile query table name. Currently I am able to achieve it   because I have one source DB and only one table name I have changed in destination DB. Like sourceDBName: nrpsubscriotion and tableName: status -> destinationDBName: nrpresport and tableName: subscription_status.   Now I have two source DB(1. nrpsubscriotion, 2. nrpuserorg) and both have same tableName: status. Now Source DB 2 , tableName in destination DB nrpreport has tableName: user_org_status.   I have stuck here , I am not getting how can define a condition to replce a tableName in DDL based on schema name and ddl query able name:   It should map like below:   1. SourceDBName: nrpsubscriotion and tableName: status -> destinationDBName: nrpresport and tableName: subscription_status. Flow File input:   { "type" : "ddl", "timestamp" : 1658314685000, "binlog_gtidset" : "e75d07af-eb37-11ec-9d1d-a86daa745b08:1-206", "database" : "nrpsubscription", "table_name" : null, "table_id" : null, "query" : "ALTER TABLE `status` ADD COLUMN `is_test` VARCHAR(255) NULL AFTER `code`" } Expected output: { "type" : "ddl", "timestamp" : 1658314685000, "binlog_gtidset" : "e75d07af-eb37-11ec-9d1d-a86daa745b08:1-206", "database" : "nrpsubscription", "table_name" : null, "table_id" : null, "query" : "ALTER TABLE `subscription_status` ADD COLUMN `is_test` VARCHAR(255) NULL AFTER `code`" } 2. SourceDBName: nrpuserorg and  tableName: status -> destinationDBName: nrpreport and tableName: user_org_status.   { "type" : "ddl", "timestamp" : 1658314686000, "binlog_gtidset" : "e75d07af-eb37-11ec-9d1d-a86daa745b08:1-207", "database" : "nrpuserorg", "table_name" : null, "table_id" : null, "query" : "ALTER TABLE `status` ADD COLUMN `is_test` VARCHAR(255) NULL AFTER `code`" } Expected output: { "type" : "ddl", "timestamp" : 1658314686000, "binlog_gtidset" : "e75d07af-eb37-11ec-9d1d-a86daa745b08:1-207", "database" : "nrpuserorgdb", "table_name" : null, "table_id" : null, "query" : "ALTER TABLE `user_org_status` ADD COLUMN `is_test` VARCHAR(255) NULL AFTER `code`" }     ... View more