About sushil416

sushil416 · ‎11-02-2017

My Bad, the split calculation works as expected there was a class loading conflict at runtime as I had also named my InputFormat as org.apache.hadoop.hive.ql.io.orc.OrcNewInputFormat which already existed in the hive-exec jar.

sushil416 · ‎10-31-2017

I have an external Hive table which is partitioned by date where new files would be created, however, when I launch a query on this table I want to filter out certain files i.e do not include as part of the InputSplit while launching the job. I tried my own InputFormat and excluded the files matching a certain pattern in the split calculation, but didn't have any effect. Kindly let me know is there a way to achieve this?

sushil416 · ‎10-30-2017

Thanks a lot for your time.

sushil416 · ‎10-29-2017

I have loaded just around 214MB worth of data with the year, month, day and hour wise partitioned Hive ACID table through a merge query, however when I launch a simple count(*) query its taking 3645 mappers, which the same data on a non-transactional table on Hive just takes 12 mappers. Is this an expected behavior? I followed the steps from here.

Online	Offline
Last Visited	‎02-06-2018 08:10 AM

Date Registered	‎10-29-2017 03:18 PM
Last Visited	‎02-06-2018 08:10 AM
Total Messages Posted	4
Total Kudos Received	1

Re: Is it possible to filter files for split calcu...

Is it possible to filter files for split calculati...

Re: Hive ACID Table count query launching too many...

Hive ACID Table count query launching too many map...