Support Questions
Find answers, ask questions, and share your expertise

Fails to execute Steller

Fails to execute Steller

Contributor

Hi,

I am using Apache Metron 0.2.BETA with codelab-platform. While following

https://cwiki.apache.org/confluence/display/METRON/Adding+a+New+Telemetry+Data+Source

I am getting java.lang.ClassNotFoundException: STELLAR any help will be appericated. Please see the following details.

Step 5: Validate the Squid Message

3. Dump the configs and validate that were persisted:

/usr/metron/$METRON_VERSION/bin/zk_load_configs.sh -m DUMP -z $ZOOKEEPER_HOST:2181
log4j:WARN No appenders could be found for logger (org.apache.curator.framework.imps.CuratorFrameworkImpl).
log4j:WARN Please initialize the log4j system properly.
log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info.
GLOBAL Config: global
{
  "es.clustername": "metron",
  "es.ip": "node1",
  "es.port": "9300",
  "es.date.format": "yyyy.MM.dd.HH",
  "fieldValidations" : [
   {
      "input" : [ "ip_src_addr", "ip_dst_addr" ],
      "validation" : "IP",
      "config" : {
     	 "type" : "IPV4"
       }
   }
  ]
}


PARSER Config: websphere
{
  "parserClassName":"org.apache.metron.parsers.websphere.GrokWebSphereParser",
  "sensorTopic":"websphere",
  "parserConfig":
  {
    "grokPath":"/patterns/websphere",
    "patternLabel":"WEBSPHERE",
    "timestampField":"timestamp_string",
    "dateFormat":"yyyy MMM dd HH:mm:ss"
  }
}


PARSER Config: bluecoat
{
"parserClassName":"org.apache.metron.parsers.bluecoat.BasicBluecoatParser",
"sensorTopic":"bluecoat",
"parserConfig": {}
}


Exception in thread "main" java.lang.RuntimeException: Unable to load {
 "parserClassName": "org.apache.metron.parsers.GrokParser",
 "sensorTopic": "squid",
 "parserConfig": {
 "grokPath": "/apps/metron/patterns/squid",
 "patternLabel": "SQUID_DELIMITED",
 "timestampField": "timestamp"
 },
 "fieldTransformations" : [
   {
     "transformation" : "STELLAR"
    ,"output" : [ "full_hostname", "domain_without_subdomains" ]
    ,"config" : {
                  "full_hostname" : "URL_TO_HOST(url)"
                 ,"domain_without_subdomains" : "DOMAIN_REMOVE_SUBDOMAINS(full_hostname)"
                }
    }
  ]
 }


	at org.apache.metron.common.configuration.ConfigurationType.lambda$static$7(ConfigurationType.java:47)
	at org.apache.metron.common.configuration.ConfigurationType$$Lambda$9/1684106402.apply(Unknown Source)
	at org.apache.metron.common.configuration.ConfigurationType.deserialize(ConfigurationType.java:78)
	at org.apache.metron.common.configuration.ConfigurationsUtils.lambda$dumpConfigs$43(ConfigurationsUtils.java:272)
	at org.apache.metron.common.configuration.ConfigurationsUtils$$Lambda$7/785992331.visit(Unknown Source)
	at org.apache.metron.common.configuration.ConfigurationsUtils.visitConfigs(ConfigurationsUtils.java:264)
	at org.apache.metron.common.configuration.ConfigurationsUtils.visitConfigs(ConfigurationsUtils.java:251)
	at org.apache.metron.common.configuration.ConfigurationsUtils.dumpConfigs(ConfigurationsUtils.java:271)
	at org.apache.metron.common.cli.ConfigurationManager.dump(ConfigurationManager.java:115)
	at org.apache.metron.common.cli.ConfigurationManager.run(ConfigurationManager.java:177)
	at org.apache.metron.common.cli.ConfigurationManager.run(ConfigurationManager.java:161)
	at org.apache.metron.common.cli.ConfigurationManager.main(ConfigurationManager.java:198)
Caused by: com.fasterxml.jackson.databind.JsonMappingException: STELLAR
 at [Source: {
 "parserClassName": "org.apache.metron.parsers.GrokParser",
 "sensorTopic": "squid",
 "parserConfig": {
 "grokPath": "/apps/metron/patterns/squid",
 "patternLabel": "SQUID_DELIMITED",
 "timestampField": "timestamp"
 },
 "fieldTransformations" : [
   {
     "transformation" : "STELLAR"
    ,"output" : [ "full_hostname", "domain_without_subdomains" ]
    ,"config" : {
                  "full_hostname" : "URL_TO_HOST(url)"
                 ,"domain_without_subdomains" : "DOMAIN_REMOVE_SUBDOMAINS(full_hostname)"
                }
    }
  ]
 }
; line: 11, column: 25] (through reference chain: org.apache.metron.common.configuration.SensorParserConfig["fieldTransformations"]->java.util.ArrayList[0]->org.apache.metron.common.configuration.FieldTransformer["transformation"])
	at com.fasterxml.jackson.databind.JsonMappingException.from(JsonMappingException.java:262)
	at com.fasterxml.jackson.databind.deser.SettableBeanProperty._throwAsIOE(SettableBeanProperty.java:537)
	at com.fasterxml.jackson.databind.deser.SettableBeanProperty._throwAsIOE(SettableBeanProperty.java:518)
	at com.fasterxml.jackson.databind.deser.impl.MethodProperty.deserializeAndSet(MethodProperty.java:99)
	at com.fasterxml.jackson.databind.deser.BeanDeserializer.vanillaDeserialize(BeanDeserializer.java:260)
	at com.fasterxml.jackson.databind.deser.BeanDeserializer.deserialize(BeanDeserializer.java:125)
	at com.fasterxml.jackson.databind.deser.std.CollectionDeserializer.deserialize(CollectionDeserializer.java:277)
	at com.fasterxml.jackson.databind.deser.std.CollectionDeserializer.deserialize(CollectionDeserializer.java:249)
	at com.fasterxml.jackson.databind.deser.std.CollectionDeserializer.deserialize(CollectionDeserializer.java:26)
	at com.fasterxml.jackson.databind.deser.SettableBeanProperty.deserialize(SettableBeanProperty.java:490)
	at com.fasterxml.jackson.databind.deser.impl.MethodProperty.deserializeAndSet(MethodProperty.java:95)
	at com.fasterxml.jackson.databind.deser.BeanDeserializer.vanillaDeserialize(BeanDeserializer.java:260)
	at com.fasterxml.jackson.databind.deser.BeanDeserializer.deserialize(BeanDeserializer.java:125)
	at com.fasterxml.jackson.databind.ObjectMapper._readMapAndClose(ObjectMapper.java:3807)
	at com.fasterxml.jackson.databind.ObjectMapper.readValue(ObjectMapper.java:2797)
	at org.apache.metron.common.utils.JSONUtils.load(JSONUtils.java:79)
	at org.apache.metron.common.configuration.ConfigurationType.lambda$static$7(ConfigurationType.java:45)
	... 11 more
Caused by: java.lang.ClassNotFoundException: STELLAR
	at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
	at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
	at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)
	at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
	at java.lang.Class.forName0(Native Method)
	at java.lang.Class.forName(Class.java:264)
	at org.apache.metron.common.utils.ReflectionUtils.createInstance(ReflectionUtils.java:53)
	at org.apache.metron.common.field.transformation.FieldTransformations.get(FieldTransformations.java:37)
	at org.apache.metron.common.configuration.FieldTransformer.setTransformation(FieldTransformer.java:80)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:497)
	at com.fasterxml.jackson.databind.deser.impl.MethodProperty.deserializeAndSet(MethodProperty.java:97)
	... 24 more