About shashwat_dabhol

shashwat_dabhol · ‎12-15-2017

Hi, We are trying to setup a new Hadoop cluster. We have around 4 Linux machines(1 Edge Node, 1 Name Node and 2 Data Nodes). Could someone explain what ports are required to be opened on which nodes before we start the installation? Or does Ambari take care of it? Is there something else that needs to be taken care of as well like SSH, TCP/IP port opening? I have gone through the default ports mentioned in HDP reference guide. But not sure do they need to be opened on Edge Node or Name Node or Data Nodes or on all nodes?

shashwat_dabhol · ‎09-14-2017

Hi Bala, I have read and loaded the same data from a normal HIVE Table using HCatalog in PIG and it works just fine. But with ACID HIVE Tables it does not read/write anything. HIVE DDL: Create Table Table1{ field1 int, field2 char, : } CLUSTERED BY (Bus_Date) INTO 4 BUCKETS STORED AS ORC TBLPROPERTIES('orc.compress'=zlib','transactional'='true');

shashwat_dabhol · ‎09-14-2017

Hi, I was trying to load an ACID Table in HIVE onto a relation in PIG and then just DUMP the output. But while doing so, although PIG does not give any error, it reads 0 records from the table, thus giving no records in the output. Can anyone help in this?

Online	Offline
Last Visited	‎12-15-2017 03:38 PM

Date Registered	‎09-14-2017 06:19 AM
Last Visited	‎12-15-2017 03:38 PM
Total Messages Posted	3

Ports that are required for Hadoop Installation

Re: ACID Tables access in PIG

ACID Tables access in PIG