When an Agent-Security Gate Is Unsure: Block, Ask, or Allow-and-Log?

Superpower Daily

Research investigation R0912 / comparison

When an Agent-Security Gate Is Unsure: Block, Ask, or Allow-and-Log?

“Pre-execution security” is not a standardized product capability. In this bounded public-evidence review, inspection, workflow approval, runtime authorization, and execution environments are distinct controls with different documented defaults and boundaries.

Current public editionv1Sep 18, 2026

Read the original analysis

Verified observations: 15
12 measured fields
Supported claims: 12
12 material findings
Cited sources: 10
10 primary or authoritative
Research score: 87
Automated topic and evidence score

Data status0.6 verified records across 1 period

Snapshot only. There is not enough history to claim a trend yet.

Verified observationHover or focus any mark for exact valuesLast updated Sep 18, 2026

Version ledger

Frozen public editions

Each edition preserves the records, method, sources, and downloads available at publication time.

v1 / latestSep 18, 202615 records / 10 sources
Initial public snapshot with 15 records and 10 cited sources.

Coverage note

The matrix supports product-level comparisons, but the products address different layers: tool-call inspection, coding-workflow governance, hosted MCP authorization, CRM write approval, and agent orchestration with selectable environments. The findings should not be read as equivalent security testing or a measure of real-world effectiveness.

Dataset ID: spd:when-an-agent-security-gate-is-unsure-block-ask-or-allow-and-log-d7323ba8
Stable URL: /research/when-an-agent-security-gate-is-unsure-block-ask-or-allow-and-log-d7323ba8
Version: v1
Coverage: 2026-09-12
Records: 15
Fields: 7
Updated: Sep 18, 2026

Read the data

The records behind the figure

CSV JSON

When an Agent-Security Gate Is Unsure: Block, Ask, or Allow-and-Log? data records
Entity	Metric	Value	Unit	Observed	Source	Transform
Noodle Seed	approval_channel_failure_default	Fail closed with interaction_unavailable when elicitation is unavailable and trusted host fallback is not configured.	—	2026-09-12	https://docs.noodleseed.dev/docs/guides/customer-auth	—
Noodle Seed	approval_default	Direct execution unless confirm:true is explicitly configured.	—	2026-09-12	https://docs.noodleseed.dev/docs/guides/embedded-assistant	—
Mastra Factory	approval_semantics	Recorded task acceptance, plan approval, separate stage-transition approval, and normal repository merge approval.	—	2026-09-12	https://factory.mastra.ai/using/work-and-approvals	—
Noodle Seed	approval_semantics	One exact server-held connector operation, reverified before one execution; accept releases it, decline/cancel stops it.	—	2026-09-12	https://docs.noodleseed.dev/docs/guides/embedded-assistant	—
Mastra Factory	audit_record	Session conversation, decisions, commands, tool output, files, changes, errors, checks, and linked PR output; retention/export unspecified.	—	2026-09-12	https://factory.mastra.ai/using/sessions	—
Noodle Seed	audit_record	Scalar request metadata, per-request stream, chronological session replay, governance-event query, and JSON output; no raw bodies or arguments/results.	—	2026-09-12	https://docs.noodleseed.dev/docs/guides/analytics	—
Mastra Factory	automation_or_bypass_path	Auto-start eligible runs and auto-approve submit_plan requests; custom boards and rules can change workflow.	—	2026-09-12	https://factory.mastra.ai/using/work-and-approvals	—
Noodle Seed	bypass_or_override_path	Explicit confirmationFallback:'host' trusts the MCP host to have collected approval; omitted confirm also permits direct execution.	—	2026-09-12	https://docs.noodleseed.dev/docs/guides/customer-auth	—
Mastra Factory	enforcement_point	Task acceptance, plan requests, board transitions, and repository merge workflow.	—	2026-09-12	https://factory.mastra.ai/using/work-and-approvals	—
Noodle Seed	enforcement_point	Authentication and per-tool authorization occur before arguments or fulfilment; confirmation occurs before the exact connector operation.	—	2026-09-12	https://docs.noodleseed.dev/docs/guides/customer-auth	—
Mastra Factory	execution_boundary	Cloud providers can supply VM isolation; LocalSandbox runs commands on the Factory server machine.	—	2026-09-12	https://factory.mastra.ai/configure/sandboxes	—
Bounded sample	products_documenting_approval_granularity	3 of 5: Mastra Factory, Noodle Seed, Relaticle	share	2026-09-12	https://factory.mastra.ai/using/work-and-approvals	Counted products specifying what exact unit an approval authorizes and divided by the fixed five-product sample.
Bounded sample	products_with_programmatically_retrievable_action_or_request_record	2 of 5: Noodle Seed and OpenAI Agents API	share	2026-09-12	https://docs.noodleseed.dev/docs/guides/analytics	Counted products documenting JSON/API retrieval of action or request records and divided by the fixed five-product sample; this does not assert that either record is a complete compliance audit log.
Noodle Seed	responsibility_boundary	App developer owns authorization server and token issuance; Noodle verifies tokens and runs tools; client owns discovery, sign-in, refresh, and calls.	—	2026-09-12	https://docs.noodleseed.dev/docs/guides/customer-auth	—
Mastra Factory	uncertainty_default	Unspecified; sessions may ask questions when context is missing.	—	2026-09-12	https://factory.mastra.ai/using/sessions	—

Measurement technique

How to read this report

01Evidence matrix plan: normalize each product’s public records into enforcement point, uncertainty default, approval unit, automation or bypass path, audit record, execution or responsibility boundary, and documented action surface.
02Treat non-disclosure as unspecified, not as evidence of an unsafe default.
03Separate policy-judgment uncertainty from approval-channel failure, workflow approval, and ordinary authorization failure.
04Use only the fixed five-product sample and publicly accessible vendor documentation, repositories, launch pages, and vendor-authored launch responses reviewed through September 12, 2026.
05No product execution was performed; recovering saved evidence was not a new collection or experiment.

Sources

Evidence

2 publishers supporting 15 records. Expand a publisher to inspect its cited pages.

docs.noodleseed.devdocs.noodleseed.dev5 sources / 8 records

docs.noodleseed.dev0 supporting records docs.noodleseed.dev4 supporting records docs.noodleseed.dev2 supporting records docs.noodleseed.dev0 supporting records docs.noodleseed.dev2 supporting records

factory.mastra.aifactory.mastra.ai5 sources / 7 records

factory.mastra.ai0 supporting records factory.mastra.ai4 supporting records factory.mastra.ai1 supporting record factory.mastra.ai2 supporting records factory.mastra.ai0 supporting records

Next report / 01AI Model Economics Index All research reports