Member since
09-27-2021
5
Posts
0
Kudos Received
0
Solutions
10-18-2021
03:19 AM
Hi, I have such a problem that I have a csv file that I put in data frame and everything is okay, where field is empty it puts null in data frame, but when I want to insert that into Hive table nulls are getting changed to "?".
... View more
Labels:
- Labels:
-
Apache Hive
09-28-2021
07:36 AM
Yeah I saw that, but I'm not really sure if it will help me, as I want to first do partition by a yeah then month then day so the path would be like this /year/month/day/file so for example if person that runs query only know year and month it won't go through entire database.
... View more
09-28-2021
12:25 AM
Yeah, i mean my table definition is something like this: fact1,fact2, date eg. (20190213), fact 4. What I want to do, is to create partitioned table based on year, month and day, but without creating three more fields with year, month and day. I worry that in approach of first creating "working" table and then putting it into final table it might get too slow, as everyday it's huge amount of data.
... View more
09-28-2021
12:18 AM
Yeah I think it should work, but correct me if I'm wrong, in the new table, date will be at the end of table? Also, I'm trying to partition it based on year then month then day, and I wonder if I can do it just by substring, and without dividing data field into 3 fields.
... View more
09-27-2021
01:49 AM
I have a huge dataset and I want to split it into partitioned table, but I'm wondering, the second column is date in int and I wonder is it possible to split table based on this, because I don't want to create three more columns with year, month and day.
... View more
Labels:
- Labels:
-
Apache Hive