Member since
08-21-2013
146
Posts
25
Kudos Received
34
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
3105 | 10-24-2016 10:43 AM | |
6904 | 03-13-2016 02:15 PM | |
3548 | 12-11-2015 01:48 AM | |
3010 | 11-23-2015 12:11 PM | |
2773 | 07-06-2015 10:40 AM |
03-30-2015
06:44 AM
The toAvro command expects a java.util.Map as input on conversion to a nested Avro record, per https://github.com/kite-sdk/kite/blob/master/kite-morphlines/kite-morphlines-avro/src/main/java/org/kitesdk/morphline/avro/AvroConversions.java#L73-L87 However, your input data contains a (nested) Jackson JSON object, not a java.util.Map. Hence the conversion can't succeed. Consider writing a custom morphline command that implements whatever conversion rules you wish, per http://kitesdk.org/docs/current/morphlines/morphlines-reference-guide.html#Implementing_your_own_Custom_Command
... View more
03-25-2015
01:16 PM
An empty morphline record field can't be converted to that avro schema, of course. Make sure your input data always matches the avro schema.
... View more
03-25-2015
09:41 AM
> java.lang.NoSuchMethodError: org.apache.avro.reflect.ReflectData.getDefaultValue(Lorg/apache/avro/Schema$FieldLjava/lang/Object; This means you have a wrong avro jar file version on the classpath.
... View more
12-16-2014
11:27 AM
Check the log files of MapReduce job and Solr server. The issue is probably that you are missing a sanitizeUnknownSolrField morphline command in your morphline.
... View more
12-09-2014
10:06 AM
1 Kudo
FWIW, also see https://github.com/typesafehub/config/blob/master/HOCON.md#includes
... View more
12-09-2014
09:55 AM
1 Kudo
Arrange it such that morphlineA pipe records into morphlineB: Command morphlineB = new Compiler().compile(morphlineFileB, morphlineIdB, morphlineContextB, null); Command morphlineA = new Compiler().compile(morphlineFileA, morphlineIdA, morphlineContextA, morphlineB);
... View more
11-27-2014
02:06 AM
FYI, the tryRules command with the catchExceptions : true parameter handles this kind of scenario more easily. http://kitesdk.org/docs/current/kite-morphlines/morphlinesReferenceGuide.html#/tryRules
... View more
11-25-2014
08:26 AM
That’s the expected behavior per the doc at kitesdk.org/docs/current/kite-morphlines/morphlinesReferenceGuide.html#xquery: "The XPath string value of the attribute or child is filled into the record field”. The “XPath string value” is the concatenation of the *text nodes* and it does not include the element names or attribute names, per www.w3.org/TR/xquery-operators/#func-string Also, Solr/Lucene wouldn’t know that to do with those tag names anyway. A Lucene/Solr field holds primitive type such as a string, it doesn’t work with nested structures. P.S. If you really need this, I believe saxon (and hence the xquery command) has an extension function to emit the serialization of an XML document into a string, but unfortunately that extension function is probably not available in the free "Saxon-HE" version that we ship with kite-morphlines-saxon: www.saxonica.com/documentation9.4-demo/html/extensions/functions/serialize.html Alternatively, you could write your own custom morphline command that implements whatever xquery serialization logic you like, of course. The code would be be a copy n’ paste of the existing xquery command expect for adjusting this part: github.com/kite-sdk/kite/blob/master/kite-morphlines/kite-morphlines-saxon/src/main/java/org/kitesdk/morphline/saxon/XQueryBuilder.java#L196-L198
... View more