Ignoring a morphline error

[#1]

Hi...

Is there any way of ignoring an error in a morphline, which consists of a series of commands, without modiying the offending command to be more tolerant?

For example, if one of the commands is Grok and a large file is processed and somewhere in the file a record does not match the regular expression, the execution of the morphline stops. Is there any configuration option to allow it to continue?

Thanks,

PNS

[#2 · Accepted solution]

See the answer here: https://groups.google.com/a/cloudera.org/forum/#!topic/cdk-dev/4PkFFmG59vk

Wolfgang.

[#3]

Thanks for the prompt answer!

Adding to the Morphlines Reference Guide, the tryRules block has to be placed inside the commands block, e.g.

morphlines : [
    {
        id : morphline1
        importCommands : ["org.kitesdk.**", "org.apache.solr.**"]

        commands : [
            {
                readLine {
                    charset : UTF-8
                }
            }

            {
                tryRules {
                    catchExceptions : false
                    throwExceptionIfAllRulesFailed : true

                    rules : [

                    # next rule of tryRules cmd:
                    {
                        commands : [
                          { ... }
                          { ... }
                        ]
                    }

                    # next rule of tryRules cmd:
                    {
                        commands : [
                          { ... }
                          { ... }
                        ]
                    }
                }
            }
         ]
     }