Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Unable to load Json file into Google Bigquery

Highlighted

Unable to load Json file into Google Bigquery

New Contributor

Hi,

I am not able to load Json file into Google bigquery table. I am getting below error.

108693-1557914119749.png

The configuration of "PutBigQueryBatch" processor is as below:

108664-1557914175580.png

108723-1557914185157.png

Schema of the file is as below:

[

{

"name":"firstName",

"type":"string"

},

{

"name":"lastName",

"type":"string"

},

{

"name":"age",

"type":"integer"

}

]

Content of the file is as below:

{"firstName": "John","lastName": "Doe","age": "21"}, {"firstName": "Jack","lastName": "Wills","age": "35"}]


Bigquery configuration is as below:

108724-1557914334245.png


I am using Apache NiFi version:1.9.1

I am getting Java nullpointer Exception. I am not sure if there is any problem in file schema or some configurations.

If anyone need any other information then please let me know.

Please help me in resolving above issue.

Thanks in advance!!

2 REPLIES 2

Re: Unable to load Json file into Google Bigquery

New Contributor

Issue has been resolved. It was schema issue. Schema should be as below.

[

{

"mode": "NULLABLE",

"name": "firstName",

"type": "STRING"

},

{

"mode": "NULLABLE",

"name": "lastName",

"type": "STRING"

},

{

"mode": "NULLABLE",

"name": "age",

"type": "INTEGER"

}

]

Re: Unable to load Json file into Google Bigquery

Community Manager

The above question, and the entire reply below, was originally posted in the Community Help track. On Mon May 20 00:49 UTC 2019, a member of the HCC moderation staff moved it to the Data Ingestion & Streaming track. The Community Help Track is intended for questions about using the HCC site itself.