Member since
04-25-2016
579
Posts
609
Kudos Received
111
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
2352 | 02-12-2020 03:17 PM | |
1635 | 08-10-2017 09:42 AM | |
11170 | 07-28-2017 03:57 AM | |
2658 | 07-19-2017 02:43 AM | |
1963 | 07-13-2017 11:42 AM |
12-26-2016
05:12 PM
@vamsi valiveti could you please try this? hive> create table x(yy string);
OK
Time taken: 2.155 seconds
hive> show create table x;
OK
CREATE TABLE `x`(
`yy` string)
ROW FORMAT SERDE
'org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe'
STORED AS INPUTFORMAT
'org.apache.hadoop.mapred.TextInputFormat'
OUTPUTFORMAT
'org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat'
LOCATION
'hdfs://rkk1.hdp.local:8020/apps/hive/warehouse/x'
TBLPROPERTIES (
'COLUMN_STATS_ACCURATE'='{\"BASIC_STATS\":\"true\"}',
'numFiles'='0',
'numRows'='0',
'rawDataSize'='0',
'totalSize'='0',
'transient_lastDdlTime'='1482771845')
Time taken: 0.359 seconds, Fetched: 17 row(s)
hive> alter table x set fileformat inputformat "org.apache.hadoop.hive.ql.io.orc.OrcInputFormat" outputformat "org.apache.hadoop.hive.ql.io.orc.OrcOutputFormat" serde "org.apache.hadoop.hive.ql.io.orc.OrcSerde";
OK
Time taken: 0.429 seconds
hive> show create table x;
OK
CREATE TABLE `x`(
`yy` string)
ROW FORMAT SERDE
'org.apache.hadoop.hive.ql.io.orc.OrcSerde'
STORED AS INPUTFORMAT
'org.apache.hadoop.hive.ql.io.orc.OrcInputFormat'
OUTPUTFORMAT
'org.apache.hadoop.hive.ql.io.orc.OrcOutputFormat'
LOCATION
'hdfs://rkk1.hdp.local:8020/apps/hive/warehouse/x'
TBLPROPERTIES (
'last_modified_by'='hive',
'last_modified_time'='1482772074',
'numFiles'='0',
'numRows'='0',
'rawDataSize'='0',
'totalSize'='0',
'transient_lastDdlTime'='1482772074')
Time taken: 0.087 seconds, Fetched: 18 row(s)
hive>
... View more
12-26-2016
04:48 PM
did you check the availability of Nimbus, is it up?
... View more
12-26-2016
04:42 PM
@Sergey Paramoshkin possibly you are hitting this bug in spark codegen https://issues.apache.org/jira/browse/SPARK-18528
... View more
12-26-2016
04:34 PM
@Mustafa El-badry could you please try the suggestions mentioned in the following post and see if it helps? http://stackoverflow.com/questions/40567454/sqoop-imports-empty-strings-for-oracle-9i-table
... View more
12-26-2016
04:31 PM
@Mon key could please try to submit the job again after setting the following property in you configuration? conf.set("mapreduce.app-submission.cross-platform", "true");
... View more
12-26-2016
04:22 PM
@Viraj Vekaria could you please try setting these properties in conf and see if it helps? dfs.nameservices=HadoopTestHA dfs.ha.namenodes.HadoopTestHA=nn1,nn2 dfs.namenode.rpc-address.HadoopTestHA.namenode1=hadoop4ind.india:8020 dfs.namenode.rpc-address.HadoopTestHA.namenode2=hadoop5ind.india:8020 dfs.client.failover.proxy.provider.HadoopTestHA=org.apache.hadoop.hdfs.server.namenode.ha.ConfiguredFailoverProxyProvider
... View more
12-26-2016
03:55 PM
1 Kudo
@Santhosh B Gowda if you are using hive-cli/hiveserver2 then get the process id and check lsof -p <pid> | grep jets3t it will tell you what jets3t jar available on the classpath
... View more
12-26-2016
01:06 PM
@Santhosh B Gowda I can see hive is picking right jar from these locations, are you seeing different jar version on classpath?
java 25940 hive mem REG 252,1 539735 1180054 /usr/hdp/2.5.0.0-1133/hadoop-mapreduce/jets3t-0.9.0.jar
java 25940 hive mem REG 252,1 539735 1179933 /usr/hdp/2.5.0.0-1133/hadoop-yarn/lib/jets3t-0.9.0.jar
java 25940 hive mem REG 252,1 539735 1053479 /usr/hdp/2.5.0.0-1133/hadoop/lib/jets3t-0.9.0.jar
java 25940 hive 183r REG 252,1 539735 1053479 /usr/hdp/2.5.0.0-1133/hadoop/lib/jets3t-0.9.0.jar
java 25940 hive 297r REG 252,1 539735 1179933 /usr/hdp/2.5.0.0-1133/hadoop-yarn/lib/jets3t-0.9.0.jar
java 25940 hive 415r REG 252,1 539735 1180054 /usr/hdp/2.5.0.0-1133/hadoop-mapreduce/jets3t-0.9.0.jar
... View more
12-26-2016
12:32 PM
how many of this type(#google=google) of property you are going to have in your applicaiton, if these are fews then you can put in your ReadConfiguration while building propertyMap.
... View more
12-26-2016
12:30 PM
what version of jet2st library is on your classpath? Jet3st 0.9.0 has introduced ServiceException, if you have older library then you need to upgrade lib.
... View more