Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

How to fix the problem with respect to dynamic partitioning in hive for huge set of data

Highlighted

How to fix the problem with respect to dynamic partitioning in hive for huge set of data

New Contributor

I have been trying to create dynamic partition on the basis of state. The data is huge

Let me list down the steps that I have done

I have created a table named nov_prepost_profile_2 where I have the complete data

Iam desiring to create partion based on the circle_name(state)

Below given is the query that I ran for the above problem statement

insert overwrite table dummy_nov_prepost_profile_1_partition partition(circle_name) select msisdn,gender,activation_date,cell_site_id,handset_tac_code,prepaid_postpaid,age,circle_name from nov_prepost_profile_2;

It is throwing the below given error

Error: java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while processing row {"msisdn":"8e000dc731b4b6cf25f430c54fd9fcbe","gender":"Male","activation_date":"2017-11-11","cell_site_id":"405661250038741","handset_tac_code":"35360908","circle_name":"uttar pradesh-w","prepaid_postpaid":"PREPAID","age":"23-34"}

Could not get block locations. Source file "/user/hive/warehouse/main.db/dummy_nov_prepost_profile_1_partition/.hive-staging_hive_2018-12-21_12-12-40_299_159715303566199354-1/_task_tmp.-ext-10002/circle_name=uttar pradesh-w/_tmp.000044_3" - Aborting..

Kindy help