@Bala Vignesh N V You can use below command to check the number of lines in a HDFS file: [hdfs@ssnode1 root]$ hdfs dfs -cat /tmp/test.txt |wc -l 23 ... View more

@Bala Vignesh N V We don't have support for auto_increment, sequence still in Hive. There is the following UDF but you would have to restrict the number of mappers to 1 to make this work. https://svn.apache.org/repos/asf/hive/trunk/contrib/src/java/org/apache/hadoop/hive/contrib/udf/UDFRowSequence.java ... View more

@saswati sahu Sample hive index creation: 0: jdbc:hive2://ssnode2.openstacklocal:10000/> create index test_index_table on table test_table(col1,col2) AS 'org.apache.hadoop.hive.ql.index.compact.CompactIndexHandler' WITH DEFERRED REBUILD; No rows affected (0.351 seconds) ... View more

@Simran Kaur Hive CSV serde is built on Open CSV which support all basic csv type operations. Basically, to design the serde based on the type of data within the csv file. Refer to below link for details: http://opencsv.sourceforge.net/ ... View more

@Mahipal Ramidi You can have a Hive UDF to achieve the functions. You can alternatively use NTILE which is supported in Hive. Please refer to below link for current list of Analytical functions: https://cwiki.apache.org/confluence/display/Hive/LanguageManual+WindowingAndAnalytics ... View more

@Pugazhvanan parthiban It is not possible to directly load a text file into a ORC table. Steps to load data into ORC file format in hive: 1.Create one normal table using textFile format. 2.Load the data normally into this table. 3.Create one table with the schema of the expected results of your normal hive table using stored as orcfile. 4.Insert overwrite query to copy the data from textFile table to orcfile table. ... View more

@sandrine G Hive 2.0 will be part of HDP 2.5 and expected to be released late this year. There is no abstract date for the release. ... View more