About Galih

Galih · ‎01-18-2023

I have json file like this and want send it to hive using nifi, how can i change the timestamp type because when i send it to hive, in hive table the column type is string, and I read in hive DDL format for timestamp "yyyy-MM-dd HH:mm:ss.SSS" {"nama": "d", "alamat": "jkt", "_ab_cdc_updated_at": "2023-01-05T05:57:43.499Z", "_ab_cdc_lsn": 1640844128, "_ab_cdc_deleted_at": null} {"nama": "a", "alamat": null, "_ab_cdc_updated_at": "2023-01-05T05:57:43.510Z", "_ab_cdc_lsn": 1640844256, "_ab_cdc_deleted_at": "2023-01-05T05:57:43.510Z"} {"nama": "c", "alamat": "semarang", "_ab_cdc_updated_at": "2023-01-12T03:38:32.136Z", "_ab_cdc_lsn": 1684930552, "_ab_cdc_deleted_at": null} {"nama": "f", "alamat": null, "_ab_cdc_updated_at": "2023-01-12T04:11:53.329Z", "_ab_cdc_lsn": 1685073792, "_ab_cdc_deleted_at": "2023-01-12T04:11:53.329Z"}

Galih · ‎09-21-2022

I want to send my csv file to hive external table, i'm using this processor InferAvroSchema -> UpdateAttribute (with add properties 'inferred.avro.schema') -> ConvertCSVToAvro -> PutHDFS -> UpdateHive3Table but when in UpdateHive3Table the processor just read 8kb and in my table just 1 row. How can i do to fix this?

Galih · ‎10-04-2021

Hello @RyanCicak Im trying. this flow but it doesn't work for me. This is my flow What should I do? thanks

Online	Offline
Last Visited	‎01-20-2023 05:53 AM

Date Registered	‎09-21-2021 07:58 AM
Last Visited	‎01-20-2023 05:53 AM
Total Messages Posted	4

Change timestamp format field in nifi

CSV file to Hive using Nifi

Re: RDBMS to Hive using NiFi (small-medium tables)