Threat Intelligence Store Refresh

Threat Intelligence Store Refresh

Threat Intelligence Store Refresh

This automation refreshes the SOC’s shared threat intelligence store by collecting recent indicators, removing ineligible or duplicate entries, and merging trusted evidence from multiple feeds. It leaves a searchable, resumable collection and a capped index ready for downstream hunting.

Threat hunting

Collection

Data Quality

Data Pipeline

Trigger

A scheduled collection run or on-demand webhook trigger starts the refresh of recent ThreatFox and selected OTX threat indicators.

Outcome

A deduplicated shared indicator store, hourly hunt index, updated collection cursor, and write-status summary are produced for downstream SOC workflows.

Trigger

A scheduled collection run or on-demand webhook trigger starts the refresh of recent ThreatFox and selected OTX threat indicators.

Outcome

A deduplicated shared indicator store, hourly hunt index, updated collection cursor, and write-status summary are produced for downstream SOC workflows.

Before

Analysts had to reconcile overlapping entries from separate threat feeds, compare formats, remove allowed values, and track which pages or indicators had already been processed. They also had to maintain the collection index and verify that writes and progress records were complete.

How it works

  1. Collect recent ThreatFox entries and the configured recent pages from selected OTX pulses, while isolating failed sources or pages.
  2. Normalize and deduplicate indicators, apply the allowlist, merge source evidence, remove expired entries, and write the results into shared storage.
  3. Update the hunt index and collection progress only after writes are verified; otherwise preserve the cursor for a later retry.

Workflow details

  • Collection: A scheduled or on-demand run retrieves ThreatFox indicators from the previous 24 hours and the configured recent pages from selected OTX pulses. Collection failures are isolated so one source or pulse does not stop the remaining work.
  • Validation and normalization: Indicators are grouped by type and value, normalized, deduplicated, and filtered against the allowlist, including private or reserved addresses and broad trusted domains. Conflicting evidence is consolidated using the highest confidence, combined labels and sources, and expanded validity periods.
  • Storage: Eligible indicators are merged into shared type-based buckets with a 30-day retention window. Expired indicators are removed during rewrites, while source references and confidence information remain available for later investigation.
  • Hunt indexing: Newly collected indicators are added to the hourly hunt index, capped at 500 indicators per run, while the full merged collection remains in storage. The index is updated rather than overwritten when multiple runs occur in the same hour.
  • Reliability and continuity: The workflow verifies bucket, index, cursor, and run-log writes before completing. If a write or collection page fails, progress is preserved so the next run can retry the same indicators instead of silently skipping them.

What changed

Each collection run now performs feed reconciliation, eligibility checks, merging, indexing, and write validation automatically. The SOC receives a resumable shared store with source evidence and a capped hunt index, while failed writes leave progress unchanged for the next run.

Work removed

Comparing indicators across ThreatFox and OTX, reconciling feed formats, filtering private or allowlisted values, removing duplicates and expired entries, maintaining page and cursor progress, updating the hunt index, and checking bucket and state writes.

Expected outcome

A continuously refreshed, deduplicated threat intelligence store is available for hunting, with the hunt index limited to 500 newly collected indicators per run and failed collections safely retryable.

Connected tools

Related flows

Related flows

Explore more workflows with similar topics or tools.

Interactive Identity Incident Remediation

This automation turns Teams security event messages into actionable remediation workflows, allowing authorized users to reset passwords, lock accounts, revoke sessions, investigate session identifiers, or route supported requests to specialized subflows. It updates the original incident message with the selected action, actor, and timestamp so the response remains visible in the incident conversation.

This automation turns Teams security event messages into actionable remediation workflows, allowing authorized users to reset passwords, lock accounts, revoke sessions, investigate session identifiers, or route supported requests to specialized subflows. It updates the original incident message with the selected action, actor, and timestamp so the response remains visible in the incident conversation.

Explore use case

Explore use case

Automated Bulk Record Updates

This automation receives bulk update data, authenticates with Salesforce, and processes Asset record updates through a batched ingest job. It monitors batch progress, marks the job complete, and posts a status message to a Slack channel.

This automation receives bulk update data, authenticates with Salesforce, and processes Asset record updates through a batched ingest job. It monitors batch progress, marks the job complete, and posts a status message to a Slack channel.

Explore use case

Explore use case

Live Host Investigation for Security Alerts

This automation investigates medium-severity security alerts by interrogating affected hosts with read-only endpoint evidence checks. It produces a concise live investigation summary with findings and a recommendation on whether the alert indicates active compromise, benign activity, or requires Tier 3 escalation.

This automation investigates medium-severity security alerts by interrogating affected hosts with read-only endpoint evidence checks. It produces a concise live investigation summary with findings and a recommendation on whether the alert indicates active compromise, benign activity, or requires Tier 3 escalation.

Explore use case

Explore use case

Less busywork. More possibility.

Let your agents handle the routine. Make room for what comes next.

Automation intelligence, delivered monthly.

Product releases, automation playbooks, and security research — straight to your inbox. No spam, unsubscribe anytime.

© 2026 Mindflow — All rights reserved.

SOC 2 Type II
ISO 27001
GDPR
France 2030
Bpifrance
Île-de-France

Less busywork. More possibility.

Let your agents handle the routine. Make room for what comes next.

Automation intelligence, delivered monthly.

Product releases, automation playbooks, and security research — straight to your inbox. No spam, unsubscribe anytime.

© 2026 Mindflow — All rights reserved.

SOC 2 Type II
ISO 27001
GDPR
France 2030
Bpifrance
Île-de-France

Automation intelligence, delivered monthly.

Product releases, automation playbooks, and security research — straight to your inbox. No spam, unsubscribe anytime.

© 2026 Mindflow — All rights reserved.

SOC 2 Type II
ISO 27001
GDPR
France 2030
Bpifrance
Île-de-France
To embed a website or widget, add it to the properties panel.