Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Load STIX/Taxii feeds from Opentaxii server into HBASE

Highlighted

Load STIX/Taxii feeds from Opentaxii server into HBASE

Explorer

when I execute this script,I get some information as follows:

[root@node1 ~]# /usr/metron/0.4.0/bin/threatintel_taxii_load.sh -c ~/connection_config.json -e ~/extractor.json -p 10000
17/08/24 05:24:35 WARN extractor.TransformFilterExtractorDecorator: Unable to setup zookeeper client - zk_quorum url not provided. **This will limit some Stellar functionality**
17/08/24 05:24:35 INFO taxii.TaxiiHandler: Loading configuration: TaxiiConnectionConfig{endpoint=http://localhost:9000/services/discovery, port=443, proxy=null, username='guest', password='******', type=DISCOVER, allowedIndicatorTypes=, collection='guest.phishtank_com', subscriptionId='null', beginTime=null, table=threatintel:t}
17/08/24 05:24:35 INFO taxii.TaxiiHandler: Initializing client..
17/08/24 05:24:35 INFO taxii.TaxiiHandler: Discovering endpoint
17/08/24 05:24:36 INFO taxii.TaxiiHandler: Request made : org.mitre.taxii.messages.xml11.DiscoveryRequest => org.mitre.taxii.messages.xml11.DiscoveryResponse (expected org.mitre.taxii.messages.xml11.DiscoveryResponse)
17/08/24 05:24:36 INFO taxii.TaxiiHandler: Discovered endpoint as http://localhost:9000/services/poll
17/08/24 05:24:36 INFO taxii.TaxiiHandler: Configured, starting polling http://localhost:9000/services/poll for guest.phishtank_com
17/08/24 05:24:36 INFO taxii.TaxiiHandler: Polling...8/24/17 5:24 AM
17/08/24 05:24:37 INFO taxii.TaxiiHandler: Request made : org.mitre.taxii.messages.xml11.PollRequest => org.mitre.taxii.messages.xml11.PollResponse (expected org.mitre.taxii.messages.xml11.PollResponse)
17/08/24 05:24:37 INFO taxii.TaxiiHandler: Got Poll Response with 241 blocks
17/08/24 05:25:00 INFO taxii.TaxiiHandler: Processed 99 in 22734 ms, avg time: 7578
17/08/24 05:25:18 INFO taxii.TaxiiHandler: Processed 99 in 18680 ms, avg time: 6226
17/08/24 05:25:36 INFO taxii.TaxiiHandler: Processed 99 in 17794 ms, avg time: 5931
17/08/24 05:25:55 INFO taxii.TaxiiHandler: Processed 99 in 18499 ms, avg time: 6166
17/08/24 05:26:12 INFO taxii.TaxiiHandler: Processed 99 in 17092 ms, avg time: 5697
17/08/24 05:26:30 INFO taxii.TaxiiHandler: Processed 99 in 18078 ms, avg time: 6025
17/08/24 05:26:48 INFO taxii.TaxiiHandler: Processed 99 in 17699 ms, avg time: 5899
17/08/24 05:26:54 INFO taxii.TaxiiHandler: Polling...8/24/17 5:26 AM
17/08/24 05:26:54 INFO taxii.TaxiiHandler: Begin Time: 2017-08-24T09:24:36Z
17/08/24 05:26:54 INFO taxii.TaxiiHandler: Request made : org.mitre.taxii.messages.xml11.PollRequest => org.mitre.taxii.messages.xml11.PollResponse (expected org.mitre.taxii.messages.xml11.PollResponse)
17/08/24 05:26:54 INFO taxii.TaxiiHandler: Got Poll Response with 0 blocks
17/08/24 05:26:54 INFO taxii.TaxiiHandler: Polling...8/24/17 5:26 AM
17/08/24 05:26:54 INFO taxii.TaxiiHandler: Begin Time: 2017-08-24T09:26:54Z
17/08/24 05:26:54 INFO taxii.TaxiiHandler: Request made : org.mitre.taxii.messages.xml11.PollRequest => org.mitre.taxii.messages.xml11.PollResponse (expected org.mitre.taxii.messages.xml11.PollResponse)

It is normal? But I can not find data in hbase table.

2 REPLIES 2
Highlighted

Re: Load STIX/Taxii feeds from Opentaxii server into HBASE

Explorer
Highlighted

Re: Load STIX/Taxii feeds from Opentaxii server into HBASE

Explorer

Looks like you are having connectivity issues to Zookeper per log entry zk_quorum url not provided. Can you check your zookeeper setting and retry?

Don't have an account?
Coming from Hortonworks? Activate your account here