Cloudera Community
dchiguruvad
user rank
user rank
Expert Contributor

Re: sqoop insert into partitioned table​

by Expert Contributor Expert Contributor in Support Questions
‎07-11-2016 06:55 AM
1 Kudo
‎07-11-2016 06:55 AM
1 Kudo
@Parinita Kothari Yes you can do that too.. Create a Hive paritioned table and set hive.exec.dynamic.partition.mode=nonstrict in a case of dynamic -Import table from DB to the partitioned table here you need not specificy partition-keys and partition-values , Just -table <tblname> --hcatalog-table <tblname> is enough.. ... View more

Re: sqoop insert into partitioned table​

by Expert Contributor Expert Contributor in Support Questions
‎07-07-2016 08:44 PM
3 Kudos
‎07-07-2016 08:44 PM
3 Kudos
@Parinita Kothari To import into Multi-key partitioned Hive table , you can make use of --hcatalog-table -table <tblname> --hcatalog-table <tblname> --hcatalog-partition-keys k1,k2 --hcatalog-partition-values 'v1,v2' eg: -table DW_FACT_PUNTER_TEST_TEMP --hcatalog-table DW_FACT_PUNTER_TEST_TEMP --hcatalog-partition-keys TIME_YEAR,TIME_MONTH --hcatalog-partition-values '2014-04-11,2014-APR' ... View more

Re: Setting Hive Auxiliary jars path to HDFS locat...

by Expert Contributor Expert Contributor in Support Questions
‎07-07-2016 02:31 PM
1 Kudo
‎07-07-2016 02:31 PM
1 Kudo
@Dinesh E This depends on the file system we specify in the path(if you dont specify any file system it will take local file system path) generic: hive.aux.jars.path=file:///hdp/apps/2.3.4.0-3485/hive/auxjars/* HDFS specific: hive.aux.jars.path=hdfs:///hdp/apps/2.3.4.0-3485/hive/auxjars/* hope this clears your doubt, if so accept the answer ... View more

Re: Setting Hive Auxiliary jars path to HDFS locat...

by Expert Contributor Expert Contributor in Support Questions
‎07-05-2016 10:18 AM
‎07-05-2016 10:18 AM
@Dinesh E You can set this in hive config - so that every Hive/beeline session takes this path hive.aux.jars.path=hdfs:///hdp/apps/2.3.4.0-3485/hive/auxjars/* Yes you can use HDFS path here.(recommended to to Use HDFS path... if you go for local path it should also be present in the node where HS2 is running) https://cwiki.apache.org/confluence/display/Hive/AdminManual+Configuration Alternate to it you can also set this: added this to the script hive-env.sh HIVE_AUX_JARS_PATH=<path of jar location> ... View more

Re: How does --hive import work

by Expert Contributor Expert Contributor in Support Questions
‎07-01-2016 06:31 AM
3 Kudos
‎07-01-2016 06:31 AM
3 Kudos
@Simran Kaur In sqoop --hive import --warehouse directory is the temporary HDFS directory location which collects the imported data finally it moves the data (metadata of files) to hive.warehouse.dir (generally /apps/hive/warehouse- as we specify in our hive-site.xml) ... View more

Re: import csv data into hive table orc format

by Expert Contributor Expert Contributor in Support Questions
‎06-23-2016 08:47 AM
1 Kudo
‎06-23-2016 08:47 AM
1 Kudo
@alain TSAFACK Ambari Hive Views provide this feature (Upload Table) where you can directly upload CSV file into an ORC Hive table.( It takes care internally the 2 step process to create ORC table) ... View more

Re: How can I automate a process in Hive?

by Expert Contributor Expert Contributor in Support Questions
‎06-19-2016 01:56 AM
1 Kudo
‎06-19-2016 01:56 AM
1 Kudo
@Vijay Parmar If this helps you in solving your problem set .. pls Vote or accept the comment. ... View more

Re: sqoop fails with "Unsupported startup paramete...

by Expert Contributor Expert Contributor in Support Questions
‎06-16-2016 11:53 AM
3 Kudos
‎06-16-2016 11:53 AM
3 Kudos
@Roman Boyko By chance is the pgBouncer (lightweight connection pooler for PostgreSQL) installed along with yout Postgress Install. If so set this param ignore_startup_parameters = extra_float_digits in pgbouncer.ini (/etc/pgbouncer/pgbouncer.ini) http://lists.pgfoundry.org/pipermail/pgbouncer-general/2011-July/000830.html ... View more

Re: Cannot connect 'Streaming Data Ingest' to secu...

by Expert Contributor Expert Contributor in Support Questions
‎06-16-2016 09:26 AM
2 Kudos
‎06-16-2016 09:26 AM
2 Kudos
@Steven Castelein Hiveserver2 in secure environment by default Authentication mode uses plain SASL. You can disable it either by setting in In hive-site.xml: hive.server2.authentication= 'NOSASL' Or To Use SASL: (https://cwiki.apache.org/confluence/display/Hive/Setting+Up+HiveServer2#SettingUpHiveServer2-Integrity/ConfidentialityProtection) Integrity/Confidentiality Protection Integrity protection and confidentiality protection (beyond just the default of authentication) for communication between the Hive JDBC driver and HiveServer2 are enabled (Hive 0.12 onward, see HIVE-4911). You can use the SASL QOP property to configure this. This is only when Kerberos is used for the HS2 client (JDBC/ODBC application) authentication with HiveServer2. hive.server2.thrift.sasl.qop in hive-site.xml has to be set to one of the valid QOP values ('auth', 'auth-int' or 'auth-conf'). You can connect via below url jdbc:hive2://<m/c HS2>:10001/default;principal=<hive princiapl>?transportMode=http;httpPath=cliservice;auth=kerberos;sasl.qop=auth-int (if auth-int is set) ... View more

Re: How to use /u0001 Delimiter

by Expert Contributor Expert Contributor in Support Questions
‎06-15-2016 02:10 PM
2 Kudos
‎06-15-2016 02:10 PM
2 Kudos
@suresh krish Try this alter table <table_name> > set serde 'org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe' WITH SERDEPROPERTIES ('field.delim' = '\001'); I guess hive internally converts '\001' --> \u0001 ... View more
Contact Me
Online
Offline
Last Visited
‎06-26-2023 05:47 PM
Community Statistics
Member Since ‎04-12-2016 10:40 AM
Last Visited ‎06-26-2023 05:47 PM
Posts 46
Kudos received 74