Member since
03-11-2015
10
Posts
0
Kudos Received
0
Solutions
05-01-2015
04:35 PM
hi, Romain, I am having the same issue. I just installed CDH5.4 and use json-serde-1.3-jar-with-dependencies.jar to create external table. CREATE EXTERNAL TABLE IF NOT EXISTS mytable2 (field1 string, field2 int, field3 string, field4 double) ROW FORMAT SERDE 'org.openx.data.jsonserde.JsonSerDe' WITH SERDEPROPERTIES ( "ignore.malformed.json" = "true") LOCATION '/tmp/mytable2'; The testing data is: {"field1":"data1","field2":100,"field3":"more data1","field4":123.001} In Hive CLI I am able to query the table. But when I use beeline or Hue interface, I got the same error: Error: java.lang.ClassCastException: java.lang.String cannot be cast to java.lang.Integer (state=,code=0) I have copied the json-serde-1.3-jar-with-dependencies.jar to the following directory but it still does not work: /var/opt/cloudera/parcels/CDH/lib/hive/lib/ /var/opt/cloudera/parcels/CDH/lib/hadoop/lib/ /var/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/lib/ /var/opt/cloudera/parcels/CDH/lib/hadoop-0.20-mapreduce/lib/ Do you know the reason? thanks Bin
... View more
04-13-2015
04:48 PM
sorry, the link is https://ashokharnal.wordpress.com/2014/01/16/installing-r-rhadoop-and-rstudio-over-cloudera-hadoop-ecosystem-revised/ The rmr2 and rhdfs version I downloaded are: -rw-r--r-- 1 ec2-user ec2-user 28287 Apr 10 18:24 plyrmr_0.6.0.tar.gz -rw-r--r-- 1 ec2-user ec2-user 25105 Apr 10 18:24 rhdfs_1.0.8.tar.gz -rw-r--r-- 1 ec2-user ec2-user 63087 Apr 10 18:24 rmr2_3.3.1.tar.gz And my 5 nodes cluster in EC2: [root@ip-172-30-2-9 ~]# cat /etc/redhat-release Red Hat Enterprise Linux Server release 6.5 (Santiago)
... View more
04-13-2015
04:07 PM
I am working on installing R and RStudio on CDH-5.3.2, but I found one issue when I install rmr2 install.packages("/home/ec2-user/R/rmr2_3.3.1.tar.gz", repos = NULL, type="source") [javac] /tmp/RtmpVvuf0G/R.INSTALL341d4f985503/rmr2/src/hbase-io/src/java/com/dappervision/hbase/mapred/TypedBytesTableInputFormatBase.java:164: error: cannot find symbol [javac] String regionLocation = table.getRegionLocation(startKeys[startPos]). [javac] ^ [javac] symbol: method getServerAddress() [javac] location: class HRegionLocation In the source code, line 164 is like this: String regionLocation = table.getRegionLocation(startKeys[startPos]). getServerAddress().getHostname(); I searched API and could not find method getServerAddress() for HRegionLocation. The problem is that I download rmr2 from this link https://github.com/RevolutionAnalytics/RHadoop/wiki (as in this instruction: https://ashokharnal.wordpress.com/2014/01/16/installing-r-rhadoop-and-rstudio-over-cloudera-hadoop-ecosystem-revised/). So the issue could be this tar.gz file is for CDH-4. Do you know where can I download source code for CDH-5 ? thanks Bin
... View more