weird, could you please post both the url? ... View more

no need to store the result in RDBMS, these libraries are javascript library, you can pull the result using java jdbc program https://github.com/rajkrrsingh/HiveServer2JDBCSample, set in some variable and plot using these libraries. ... View more

@Hajime did you try setting debug args for executors spark.driver.extraJavaOptions? ... View more

@Ye Jun this is the hortonworks public repo for maven artifects http://nexus-private.hortonworks.com/nexus/content/groups/public/ add this to you pom.xml <repository> <id>public</id> <url>http://nexus-private.hortonworks.com/nexus/content/groups/public</url> </repository> get your dependecy from the repo link and add in your maven dependencies. ... View more

@Maria Khan possibly you are hitting https://issues.apache.org/jira/browse/KAFKA-3042 ... View more

@vamsi valiveti could you please try this? hive> create table x(yy string); OK Time taken: 2.155 seconds hive> show create table x; OK CREATE TABLE `x`( `yy` string) ROW FORMAT SERDE 'org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe' STORED AS INPUTFORMAT 'org.apache.hadoop.mapred.TextInputFormat' OUTPUTFORMAT 'org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat' LOCATION 'hdfs://rkk1.hdp.local:8020/apps/hive/warehouse/x' TBLPROPERTIES ( 'COLUMN_STATS_ACCURATE'='{\"BASIC_STATS\":\"true\"}', 'numFiles'='0', 'numRows'='0', 'rawDataSize'='0', 'totalSize'='0', 'transient_lastDdlTime'='1482771845') Time taken: 0.359 seconds, Fetched: 17 row(s) hive> alter table x set fileformat inputformat "org.apache.hadoop.hive.ql.io.orc.OrcInputFormat" outputformat "org.apache.hadoop.hive.ql.io.orc.OrcOutputFormat" serde "org.apache.hadoop.hive.ql.io.orc.OrcSerde"; OK Time taken: 0.429 seconds hive> show create table x; OK CREATE TABLE `x`( `yy` string) ROW FORMAT SERDE 'org.apache.hadoop.hive.ql.io.orc.OrcSerde' STORED AS INPUTFORMAT 'org.apache.hadoop.hive.ql.io.orc.OrcInputFormat' OUTPUTFORMAT 'org.apache.hadoop.hive.ql.io.orc.OrcOutputFormat' LOCATION 'hdfs://rkk1.hdp.local:8020/apps/hive/warehouse/x' TBLPROPERTIES ( 'last_modified_by'='hive', 'last_modified_time'='1482772074', 'numFiles'='0', 'numRows'='0', 'rawDataSize'='0', 'totalSize'='0', 'transient_lastDdlTime'='1482772074') Time taken: 0.087 seconds, Fetched: 18 row(s) hive> ... View more

did you check the availability of Nimbus, is it up? ... View more

@Sergey Paramoshkin possibly you are hitting this bug in spark codegen https://issues.apache.org/jira/browse/SPARK-18528 ... View more

@Mustafa El-badry could you please try the suggestions mentioned in the following post and see if it helps? http://stackoverflow.com/questions/40567454/sqoop-imports-empty-strings-for-oracle-9i-table ... View more

@Mon key could please try to submit the job again after setting the following property in you configuration? conf.set("mapreduce.app-submission.cross-platform", "true"); ... View more

@Viraj Vekaria could you please try setting these properties in conf and see if it helps? dfs.nameservices=HadoopTestHA dfs.ha.namenodes.HadoopTestHA=nn1,nn2 dfs.namenode.rpc-address.HadoopTestHA.namenode1=hadoop4ind.india:8020 dfs.namenode.rpc-address.HadoopTestHA.namenode2=hadoop5ind.india:8020 dfs.client.failover.proxy.provider.HadoopTestHA=org.apache.hadoop.hdfs.server.namenode.ha.ConfiguredFailoverProxyProvider ... View more

@Santhosh B Gowda if you are using hive-cli/hiveserver2 then get the process id and check lsof -p <pid> | grep jets3t it will tell you what jets3t jar available on the classpath ... View more

@Santhosh B Gowda I can see hive is picking right jar from these locations, are you seeing different jar version on classpath? java 25940 hive mem REG 252,1 539735 1180054 /usr/hdp/2.5.0.0-1133/hadoop-mapreduce/jets3t-0.9.0.jar java 25940 hive mem REG 252,1 539735 1179933 /usr/hdp/2.5.0.0-1133/hadoop-yarn/lib/jets3t-0.9.0.jar java 25940 hive mem REG 252,1 539735 1053479 /usr/hdp/2.5.0.0-1133/hadoop/lib/jets3t-0.9.0.jar java 25940 hive 183r REG 252,1 539735 1053479 /usr/hdp/2.5.0.0-1133/hadoop/lib/jets3t-0.9.0.jar java 25940 hive 297r REG 252,1 539735 1179933 /usr/hdp/2.5.0.0-1133/hadoop-yarn/lib/jets3t-0.9.0.jar java 25940 hive 415r REG 252,1 539735 1180054 /usr/hdp/2.5.0.0-1133/hadoop-mapreduce/jets3t-0.9.0.jar ... View more

how many of this type(#google=google) of property you are going to have in your applicaiton, if these are fews then you can put in your ReadConfiguration while building propertyMap. ... View more

what version of jet2st library is on your classpath? Jet3st 0.9.0 has introduced ServiceException, if you have older library then you need to upgrade lib. ... View more

@radhika mantri instead of reading # keys from properties file why don you put null check in your producer or consumer and set this value there like this if (properties.getProperty("#google") == null) { properties.setProperty("#google", "google"); } ... View more

@Bramantya Anggriawan ideally you should install the kafka broker on the nodes where logs should be collected, topic partition is the unit of parallelism in Kafka. On both the producer and the broker side, writes to different partitions can be done fully in parallel.if you dont have many topics on which you need to produce data to then you can have 1-2 kafka server ... View more