Support Questions

Find answers, ask questions, and share your expertise
Announcements
Check out our newest addition to the community, the Cloudera Data Analytics (CDA) group hub.

Unable to load Json file into Google Bigquery

New Contributor

Hi,

I am not able to load Json file into Google bigquery table. I am getting below error.

108693-1557914119749.png

The configuration of "PutBigQueryBatch" processor is as below:

108664-1557914175580.png

108723-1557914185157.png

Schema of the file is as below:

[

{

"name":"firstName",

"type":"string"

},

{

"name":"lastName",

"type":"string"

},

{

"name":"age",

"type":"integer"

}

]

Content of the file is as below:

{"firstName": "John","lastName": "Doe","age": "21"}, {"firstName": "Jack","lastName": "Wills","age": "35"}]


Bigquery configuration is as below:

108724-1557914334245.png


I am using Apache NiFi version:1.9.1

I am getting Java nullpointer Exception. I am not sure if there is any problem in file schema or some configurations.

If anyone need any other information then please let me know.

Please help me in resolving above issue.

Thanks in advance!!

2 REPLIES 2

New Contributor

Issue has been resolved. It was schema issue. Schema should be as below.

[

{

"mode": "NULLABLE",

"name": "firstName",

"type": "STRING"

},

{

"mode": "NULLABLE",

"name": "lastName",

"type": "STRING"

},

{

"mode": "NULLABLE",

"name": "age",

"type": "INTEGER"

}

]

The above question, and the entire reply below, was originally posted in the Community Help track. On Mon May 20 00:49 UTC 2019, a member of the HCC moderation staff moved it to the Data Ingestion & Streaming track. The Community Help Track is intended for questions about using the HCC site itself.

Bill Brooks, Community Moderator
Was your question answered? Make sure to mark the answer as the accepted solution.
If you find a reply useful, say thanks by clicking on the thumbs up button.
Take a Tour of the Community
Don't have an account?
Your experience may be limited. Sign in to explore more.