Support Questions
Find answers, ask questions, and share your expertise

Unable to load data from Mongodb to Bigquery

New Contributor

Hi,
I have been working on creating a data pipeline with Getmongo and putBigQueryBatch processors. I am getting a nullpointer exception error. GetMongo processor is working perfectly well. The putBigQueryBatch processor is well connected to Bigquery. Below is a screenshot
This is MongoDB schema I have 

{
"_id" : {
"$oid" : "60b71a32e8bcd23a92096be0"
},
"title" : "Incident",
"content" : "Incident Report",
"postDate" : "12/12/2021",
"status" : "active",
"categoryId" : {
"$oid" : "60b6a250a6d9a030c2f181e8"
},
"author_id" : {
"$oid" : "60b6a0926b91ac2e25a09e2a"
},
"createdAt" : {
"$date" : 1622612531056
},
"updatedAt" : {
"$date" : 1622612531056
},
"__v" : 0
}


And this is the bigquery schema representation

[
{
"name": "_id",
"type": "STRING",
"mode": "NULLABLE"
},
{
"name": "title",
"type": "STRING",
"mode": "NULLABLE"
},
{
"name": "content",
"type": "STRING",
"mode": "NULLABLE"
},
{
"name": "postDate",
"type": "STRING",
"mode": "NULLABLE"
},
{
"name": "status",
"type": "STRING",
"mode": "NULLABLE"
},
{
"name": "categoryId",
"type": "STRING",
"mode": "NULLABLE"
},
{
"name": "author_id",
"type": "STRING",
"mode": "NULLABLE"
},
{
"name": "createdAt",
"type": "TIMESTAMP",
"mode": "NULLABLE"
},
{
"name": "updatedAt",
"type": "TIMESTAMP",
"mode": "NULLABLE"
},
{
"name": "__v",
"type": "INTEGER",
"mode": "NULLABLE"
}
]



Screenshot from 2021-06-12 15-39-14.png

0 REPLIES 0