Member since
12-01-2017
4
Posts
0
Kudos Received
0
Solutions
12-21-2017
05:57 AM
@Onkar Pathak Hey Onkar, if you are still looking for API to get controller services for given process group then its, GET /flow/process-groups/{id}/controller-services
... View more
12-02-2017
08:29 AM
@Matt Burgess Hi Matt, can you please help? Basically I'm trying to read from short-avro schema and write using complex-avro schema. Complex-avro schema has an array in which I want to map the short-avro fields, is this doable?
... View more
12-01-2017
11:39 AM
Docker image of hortonworks schema registry: https://hub.docker.com/r/thebookpeople/hortonworks-registry/
... View more
12-01-2017
11:18 AM
I'm using ConvertRecord processor to convert incoming Avro format records to Json records using Avro schema Each value of avro record should be mapped to JsonArray element in the Json record and _not directly as Json element Incoming Avro records are like below: (formatted) I've attached file with such avro-binary records 56702205798738-7d4a2b1c-bf7c-4aad-936f-b6f894ad117.txt [ {
"ID" : 1,
"Name" : "Jackey",
"Age" : 23,
"JoinedOn" : "1990-11-11"
}, {
"ID" : 2,
"Name" : "Kiwi",
"Age" : 32,
"JoinedOn" : "1990-11-11"
}] Avro Schema: {
"type": "record",
"name": "EmployeeRecord",
"fields": [
{
"name": "timestamp",
"type": "long",
"default": 1507541500000
},
{
"name": "database",
"type": "string",
"default": "testdb"
},
{
"name": "table_name",
"type": "string",
"default": "employees"
},
{
"name": "columns",
"type": {
"type": "array",
"items": {
"type": "record",
"name": "columnValues",
"fields": [
{
"name": "ID",
"type": "long",
"default": 0
},
{
"name": "Name",
"type": "string",
"default": "defaultName"
},
{
"name": "Age",
"type": [
"null",
"long"
]
"default": 0
},
{
"name": "JoinedOn",
"type": "string"
"default": "defaultDate"
}
]
}
}
}
]
} What I think I should get for each record: {
"timestamp" : 1507541500000,
"database" : "testdb",
"table_name" : "employees",
"columns" : [
{
"ID" : 1,
"Name": "Jackey",
"Age" : 23,
"JoinedOn" : "1990-11-11"
}]
} But, this is what I am getting: (columns : null) {
"timestamp" : 1507541500000,
"database" : "testdb",
"table_name" : "employees",
"columns" : null
} Can someone comment what's going wrong here?
... View more
Labels:
- Labels:
-
Schema Registry