Member since
09-21-2021
8
Posts
0
Kudos Received
0
Solutions
01-12-2024
12:33 AM
I try using this custom processor but when I try it in tableName using ${db.table.name} like this the result like this, can you help me? its also when using ${filename} the result get the same ${filename}
... View more
08-03-2023
08:12 PM
I have record from kafka like this {"datetime": "2023-08-03 10:46:50", "long": 106.8451, "lat": -6.2146, "city": "Jakarta", "status": "unknown", "nickname": "unknown"} I use Convertrecord JsonTreeReader with Schema Access Strategy Infer Schema and to change Parquet before I stored in Hive But in my table in Hive the datetime change from 2023-08-03 10:46:50 to 2023-08-03 17:46:50 How to Handle that, I want to stay with same kafka record? I live in GMT+7
... View more
Labels:
- Labels:
-
Apache NiFi
01-18-2023
06:32 AM
I have json file like this and want send it to hive using nifi, how can i change the timestamp type because when i send it to hive, in hive table the column type is string, and I read in hive DDL format for timestamp "yyyy-MM-dd HH:mm:ss.SSS" {"nama": "d", "alamat": "jkt", "_ab_cdc_updated_at": "2023-01-05T05:57:43.499Z", "_ab_cdc_lsn": 1640844128, "_ab_cdc_deleted_at": null} {"nama": "a", "alamat": null, "_ab_cdc_updated_at": "2023-01-05T05:57:43.510Z", "_ab_cdc_lsn": 1640844256, "_ab_cdc_deleted_at": "2023-01-05T05:57:43.510Z"} {"nama": "c", "alamat": "semarang", "_ab_cdc_updated_at": "2023-01-12T03:38:32.136Z", "_ab_cdc_lsn": 1684930552, "_ab_cdc_deleted_at": null} {"nama": "f", "alamat": null, "_ab_cdc_updated_at": "2023-01-12T04:11:53.329Z", "_ab_cdc_lsn": 1685073792, "_ab_cdc_deleted_at": "2023-01-12T04:11:53.329Z"}
... View more
Labels:
- Labels:
-
Apache Hive
-
Apache NiFi
09-21-2022
02:22 AM
I want to send my csv file to hive external table, i'm using this processor InferAvroSchema -> UpdateAttribute (with add properties 'inferred.avro.schema') -> ConvertCSVToAvro -> PutHDFS -> UpdateHive3Table but when in UpdateHive3Table the processor just read 8kb and in my table just 1 row. How can i do to fix this?
... View more
Labels:
- Labels:
-
Apache NiFi
-
Cloudera DataFlow (CDF)
10-04-2021
09:39 PM
Hello @RyanCicak Im trying. this flow but it doesn't work for me. This is my flow What should I do? thanks
... View more