@thejas I tested with insert script, basically writes. ... View more

Sample hive script: CREATE EXTERNAL TABLE test.temp3 ( cat_0 bigint, cat_1 bigint, cat_2 bigint, cat_3 bigint, cat_4 bigint, cat_5 bigint, cat_6 bigint, cat_7 bigint, cat_8 bigint, cat_9 bigint ) row format delimited fields terminated by ',' stored as ORC location '/test/' tblproperties ("orc.compress"="ZLIB"); ... View more

@subhash parise Here is the link for more information: https://community.hortonworks.com/content/kbentry/49252/performance-comparison-bw-orc-snappy-and-zlib-in-h.html ... View more

@saswati sahu just FYI. ORC has a built-in index and not required to apply index if you are using ORC tables. ... View more

Basically you increased your YARN memory from 32Gb to 64GB, it means you increased all containers memory. Container is a unit for YARN submitting the jobs in-terms of CPU and RAM. you increased YARN container size then what about Tez container size? --> ideally tez container size should be multiple of YARN Memory. --> ideally we can allocate two containers per disk and per CPU. ... View more

@Arunkumar Dhanakumar Here is the link for calculating YARN memory: https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.3.0/bk_installing_manually_book/content/determine-hdp-memory-config.html 1) How many data nodes do you have? 2) How many disks do you have in each data node? 3) Did you install HBase? 4) How many Cores do you have on each data node? 5) RAM size on each data node? ... View more

@ccasano As per HDP doc Hue requires RHEL6. Here is the link https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.4.0/bk_installing_manually_book/content/before_you_begin.html ... View more

Cab you run below command and paste the output. show partitions <table name>; ... View more