Member since
10-13-2019
4
Posts
0
Kudos Received
0
Solutions
10-27-2019
12:42 PM
1. The JSON file is stored in a s3 bucket. If I insert data into the internal table and somehow accidentally drop the table, is the json data also dropped? 2. But the problem is even if I try to insert by hour (which is the smallest unit of chunk size), it runs into memory issue. I could only fetch top 900 rows within a one-hour window while there are on average 1B+ rows. I am running it on Tez and 'org.openx.data.jsonserde.JsonSerDe' is the serde I used to create the external table.
... View more