Member since
06-08-2017
1049
Posts
517
Kudos Received
312
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
9891 | 04-15-2020 05:01 PM | |
5929 | 10-15-2019 08:12 PM | |
2413 | 10-12-2019 08:29 PM | |
9568 | 09-21-2019 10:04 AM | |
3505 | 09-19-2019 07:11 AM |
02-11-2021
10:00 PM
@Shu_ashu How to configure the flow if EvaluateJsonPath Processor flow have recipient mail id and FetchFile has the file path. I have configured as below but two mails are getting triggered. Could you help to modify the flow so that only one mail with attachment will trigger ?
... View more
11-08-2020
01:37 PM
great job dude, thanks! 🙂
... View more
10-12-2020
12:22 AM
Why doesn't spark work like hive? Just create a temporary directory to store the final files, and finally rename it.
... View more
10-06-2020
08:47 AM
Do you have this flow available for download? Would be an excellent template
... View more
09-30-2020
12:47 PM
Hi @calonsca! Please have a look at this spec as well! [ { "operation": "shift", "spec": { "@": "data", "ID": "&", "#${date}": "date", "#${dataset:toLower()}": "dataset" } } ]
... View more
09-26-2020
02:37 AM
spark-xml package is a good option too. With all options you are limited to only process simple XMLs which can be interpreted as dataset with rows and columns. However, if we make it a little complex, those options won’t be useful.
... View more
09-16-2020
03:27 PM
I believe this will fail if you stop your job today and run it tomorrow.. now will change to other day and you will miss the data...
... View more
09-08-2020
07:38 PM
is there any resolution to this. I am seeing this issue with one of the acid tables which has around 25 M records. Other tables have 700 M records and are working fine. Facing this issue only for few tables.
... View more
08-04-2020
01:21 AM
@SouperDude Can you tell me the detailed steps?
... View more
07-30-2020
11:51 PM
Hello @DataGeek_Anish ,
Did you find the solution of this? I also stuck into the same problem and could not able to solve it.
I have JSON array data in HIVE tables. The data type of the column is ARRAY.
Could anyone please help me to resolve this issue or let me know the other solution to flatten the JSON array data would be really appreciate.
Data:
[{"ts":1403781896,"id":14,"log":"show"},{"ts":1403781896,"id":14,"log":"start"}]
[{"ts":1403781911,"id":14,"log":"press"},{"ts":1403781911,"id":14,"log":"press"}]
Logic Used:
SELECT
get_json_object(single_json_table.single_json, '$.ts') AS ts,get_json_object(single_json_table.single_json, '$.id') AS id,get_json_object(single_json_table.single_json, '$.log') AS log
FROM(SELECT explode(json_array_col) as single_json FROM jt) single_json_table;
Error:
Error while compiling statement: FAILED: SemanticException [Error 10014]: line 2:0 Wrong arguments ''$.td'': No matching method for class org.apache.hadoop.hive.ql.udf.UDFJson with (map<string,string>, string). Possible choices: FUNC(string, string)
PS: I can unfold the array with the explode function but can't able to flatten the JSON array data into columns.
Thank You.
... View more