--- schema_version: 3 rubric_version: "0.3" canonical_url: "https://podium.do/compare/agents/code-layer-vs-qm/" data_url: "https://podium.do/compare/agents/code-layer-vs-qm/data.json" generated_at: 2026-09-30 last_checked_at: 2026-09-23 last_cross_checked_at: 2026-09-23 next_check_at: 2026-10-07 publisher: "Podium" --- # CodeLayer / HumanLayer vs QM from YC > Podium publishes this catalog and sells an agent development environment. Podium chooses the products, criteria, sources and wording, so treat these pages as vendor-authored research. Check important claims against the linked primary sources. The same evidence rules apply to Podium and its competitors, but they do not remove this conflict of interest. This comparison has 6 criteria with sourced findings for both products, including 6 that a second agent cross-checked for both. 23 criteria have a sourced finding for at least one product. "Sourced" findings passed publication validation. "Agent cross-checked" findings also received a separate agent source pass, not necessarily a hands-on test. Humans approve the rubric, templates and prototype; they do not review every finding. It does not declare a winner. A missing sourced finding is not evidence that a capability is absent. - CodeLayer / HumanLayer source checks: 2026-09-23. - QM from YC source checks: 2026-09-23. - Canonical HTML: https://podium.do/compare/agents/code-layer-vs-qm/ - Machine-readable JSON: https://podium.do/compare/agents/code-layer-vs-qm/data.json - Methodology: https://podium.do/compare/agents/methodology/ ## Access and agent choice ### ACC-01: Client access Judgment rule: List desktop OS and minimum versions, iOS, Android, browser, mobile browser, CLI and editor extensions separately. For each client, record start, steer, approve, review and resume actions, notifications and plan restrictions. Test moving the same task from desktop to phone; distinguish an installable mobile app from a mobile website and from status-only monitoring. #### CodeLayer / HumanLayer Verification status: Agent cross-checked (agent-cross-checked) Support: partial Browser/phone controls remote sessions; desktop has extra tools. Availability: unknown Delivery: unknown Scope: surfaces=Current HumanLayer desktop and hosted UI, HumanLayer remote daemon; version=not specified; plan=not specified; os=not specified; execution_modes=not specified; region=not specified; harness=not specified. Limitations: - Browser excludes embedded terminal and workspace configuration; native mobile app status unverified. - desktop_os — Desktop os [unknown]: Desktop os: Initial official-source pass did not resolve this question. No installed-client or authenticated scenario was run; source-only findings do not establish release parity. - mobile_apps — Mobile apps [unknown]: Mobile apps: Initial official-source pass did not resolve this question. No installed-client or authenticated scenario was run; source-only findings do not establish release parity. - browser — Browser [supported]: Create sessions, observe and message. Sources: code-layer:remote. - mobile_browser — Mobile browser [supported]: Same remote session controls. Sources: code-layer:remote. - cli — Cli [unknown]: Cli: Initial official-source pass did not resolve this question. No installed-client or authenticated scenario was run; source-only findings do not establish release parity. - editor_extensions — Editor extensions [unknown]: Editor extensions: Initial official-source pass did not resolve this question. No installed-client or authenticated scenario was run; source-only findings do not establish release parity. - task_actions — Task actions [unknown]: Task actions: Initial official-source pass did not resolve this question. No installed-client or authenticated scenario was run; source-only findings do not establish release parity. - notifications — Notifications [unknown]: Notifications: Initial official-source pass did not resolve this question. No installed-client or authenticated scenario was run; source-only findings do not establish release parity. - cross_device_continuity — Cross device continuity [unknown]: Cross device continuity: Initial official-source pass did not resolve this question. No installed-client or authenticated scenario was run; source-only findings do not establish release parity. Checked 2026-09-23; agent cross-checked 2026-09-23; check again by 2026-10-07. Sources: code-layer:remote #### QM from YC Verification status: Agent cross-checked (agent-cross-checked) Support: partial QM documents web and Slack workspaces; dedicated mobile apps and cross-device task action parity remain unverified. Availability: unknown Delivery: native Scope: surfaces=QM web workspace, QM Slack plugin, QM core and deployment CLI; version=ec86d8b603a6cc07b21aa4d55359b88c425b61ef; plan=not specified; os=not specified; execution_modes=not specified; region=not specified; harness=not specified. Limitations: - This is a source pass; unfilled atomic questions remain unknown and no shared scenario was run. - desktop_os — Desktop os [unknown]: Desktop os: Initial primary-source pass did not establish this question. No installed-product or shared-scenario test was run. - mobile_apps — Mobile apps [unknown]: Mobile apps: Initial primary-source pass did not establish this question. No installed-product or shared-scenario test was run. - browser — Browser [supported]: Web workspace is documented. Sources: qm:readme. - mobile_browser — Mobile browser [unknown]: Mobile browser: Initial primary-source pass did not establish this question. No installed-product or shared-scenario test was run. - cli — Cli [supported]: Deployment CLI is documented; agent-operation coverage is separate. Sources: qm:readme. - editor_extensions — Editor extensions [unknown]: Editor extensions: Initial primary-source pass did not establish this question. No installed-product or shared-scenario test was run. - task_actions — Task actions [unknown]: Task actions: Initial primary-source pass did not establish this question. No installed-product or shared-scenario test was run. - notifications — Notifications [unknown]: Notifications: Initial primary-source pass did not establish this question. No installed-product or shared-scenario test was run. - cross_device_continuity — Cross device continuity [unknown]: Cross device continuity: Initial primary-source pass did not establish this question. No installed-product or shared-scenario test was run. Checked 2026-09-23; agent cross-checked 2026-09-23; check again by 2026-10-23. Sources: qm:readme ### ACC-02: Agent and model choice Judgment rule: List supported harnesses and model providers separately, including custom adapters. Record whether the product embeds a harness, controls its sessions through an API, or only launches its terminal command. Verify at least two different harnesses before describing mixed-harness operation as observed. #### CodeLayer / HumanLayer Verification status: Agent cross-checked (agent-cross-checked) Support: partial Daemon supports Claude Code and Codex. Availability: unknown Delivery: unknown Scope: surfaces=HumanLayer remote daemon; version=not specified; plan=not specified; os=not specified; execution_modes=not specified; region=not specified; harness=not specified. Limitations: - Remaining atomic questions and observed behavior are unverified. - harnesses — Harnesses [supported]: Claude Code and Codex. Sources: code-layer:remote. - model_providers — Model providers [unknown]: Model providers: Initial official-source pass did not resolve this question. No installed-client or authenticated scenario was run; source-only findings do not establish release parity. - custom_adapters — Custom adapters [unknown]: Custom adapters: Initial official-source pass did not resolve this question. No installed-client or authenticated scenario was run; source-only findings do not establish release parity. - session_integration — Session integration [unknown]: Session integration: Initial official-source pass did not resolve this question. No installed-client or authenticated scenario was run; source-only findings do not establish release parity. - mixed_harness_operation — Mixed harness operation [unknown]: Mixed harness operation: Initial official-source pass did not resolve this question. No installed-client or authenticated scenario was run; source-only findings do not establish release parity. Checked 2026-09-23; agent cross-checked 2026-09-23; check again by 2026-10-23. Sources: code-layer:remote #### QM from YC Verification status: Agent cross-checked (agent-cross-checked) Support: partial QM documents selectable Pi, OpenCode, Codex and Claude Code runtimes. Availability: unknown Delivery: native Scope: surfaces=QM web workspace, QM Slack plugin, QM core and deployment CLI; version=ec86d8b603a6cc07b21aa4d55359b88c425b61ef; plan=not specified; os=not specified; execution_modes=not specified; region=not specified; harness=not specified. Limitations: - This is a source pass; unfilled atomic questions remain unknown and no shared scenario was run. - harnesses — Harnesses [supported]: Pi, OpenCode, Codex and Claude Code. Sources: qm:readme. - model_providers — Model providers [unknown]: Model providers: Initial primary-source pass did not establish this question. No installed-product or shared-scenario test was run. - custom_adapters — Custom adapters [unknown]: Custom adapters: Initial primary-source pass did not establish this question. No installed-product or shared-scenario test was run. - session_integration — Session integration [supported]: Selected runtime operates through QM core. Sources: qm:readme. - mixed_harness_operation — Mixed harness operation [unknown]: Mixed harness operation: Initial primary-source pass did not establish this question. No installed-product or shared-scenario test was run. Checked 2026-09-23; agent cross-checked 2026-09-23; check again by 2026-10-23. Sources: qm:readme ### ACC-03: Subscriptions, API keys and vendor credits Judgment rule: Record bring-your-own agent subscription, bring-your-own API account, vendor credits and local models as separate routes. List supported plans, models/modes, multiple-account switching and what works without a vendor account or token purchase. Existing subscription support cannot be inferred from API-key support. Record required extra payments and documented provider restrictions. #### CodeLayer / HumanLayer Verification status: Agent cross-checked (agent-cross-checked) Support: partial Pro advertises BYOK. Availability: unknown Delivery: unknown Scope: surfaces=Current HumanLayer desktop and hosted UI; version=not specified; plan=not specified; os=not specified; execution_modes=not specified; region=not specified; harness=not specified. Limitations: - Subscription-specific support needs provider guides. - agent_subscriptions — Agent subscriptions [unknown]: Agent subscriptions: Initial official-source pass did not resolve this question. No installed-client or authenticated scenario was run; source-only findings do not establish release parity. - api_accounts — Api accounts [supported]: BYOK advertised. Sources: code-layer:home. - vendor_credits — Vendor credits [unknown]: Vendor credits: Initial official-source pass did not resolve this question. No installed-client or authenticated scenario was run; source-only findings do not establish release parity. - local_models — Local models [unknown]: Local models: Initial official-source pass did not resolve this question. No installed-client or authenticated scenario was run; source-only findings do not establish release parity. - account_switching — Account switching [unknown]: Account switching: Initial official-source pass did not resolve this question. No installed-client or authenticated scenario was run; source-only findings do not establish release parity. - vendor_account_requirement — Vendor account requirement [unknown]: Vendor account requirement: Initial official-source pass did not resolve this question. No installed-client or authenticated scenario was run; source-only findings do not establish release parity. - provider_restrictions — Provider restrictions [unknown]: Provider restrictions: Initial official-source pass did not resolve this question. No installed-client or authenticated scenario was run; source-only findings do not establish release parity. Checked 2026-09-23; agent cross-checked 2026-09-23; check again by 2026-10-07. Sources: code-layer:home #### QM from YC Verification status: No sourced public finding (not-published) Support: not-published No publishable sourced finding is available for this criterion. This does not mean the product lacks the capability. ### ACC-04: Onboarding and project prerequisites Judgment rule: Measure fresh install to first successful task, with manual steps and failures. Test a local directory without Git, a local Git repo without a remote, and a GitHub-backed repo separately. Record whether account, project, host, credential and permission prerequisites are explained before accepting an unusable prompt. Evaluate managed-cloud setup and first-class BYO VPS installer/onboarding independently of hidden settings or a DIY shell recipe. #### CodeLayer / HumanLayer Verification status: No sourced public finding (not-published) Support: not-published No publishable sourced finding is available for this criterion. This does not mean the product lacks the capability. #### QM from YC Verification status: Agent cross-checked (agent-cross-checked) Support: partial Deployment instructions describe an agent-guided installer targeting the operator cloud account. Availability: unknown Delivery: native Scope: surfaces=QM core and deployment CLI; version=ec86d8b603a6cc07b21aa4d55359b88c425b61ef; plan=not specified; os=not specified; execution_modes=not specified; region=not specified; harness=not specified. Limitations: - This is a source pass; unfilled atomic questions remain unknown and no shared scenario was run. - first_task_setup — First task setup [unknown]: First task setup: Initial primary-source pass did not establish this question. No installed-product or shared-scenario test was run. - no_git — No git [unknown]: No git: Initial primary-source pass did not establish this question. No installed-product or shared-scenario test was run. - local_git_without_remote — Local git without remote [unknown]: Local git without remote: Initial primary-source pass did not establish this question. No installed-product or shared-scenario test was run. - hosted_git — Hosted git [unknown]: Hosted git: Initial primary-source pass did not establish this question. No installed-product or shared-scenario test was run. - prerequisite_guidance — Prerequisite guidance [supported]: Deployment instructions name infrastructure, sign-in and credentials. Sources: qm:readme. - managed_cloud_setup — Managed cloud setup [unknown]: Managed cloud setup: Initial primary-source pass did not establish this question. No installed-product or shared-scenario test was run. - byo_vps_onboarding — Byo vps onboarding [supported]: qm init materializes deployment guidance for Fly or AWS; installation effort was not measured. Sources: qm:readme. Checked 2026-09-23; agent cross-checked 2026-09-23; check again by 2026-10-23. Sources: qm:readme ### ACC-05: Programmable access Judgment rule: Inventory actual CLI, API, SDK, MCP and webhook operations for create, inspect, steer, stop and review. Record authentication and API stability. Having an MCP client that uses external tools is different from exposing the product to other agents over MCP. #### CodeLayer / HumanLayer Verification status: No sourced public finding (not-published) Support: not-published No publishable sourced finding is available for this criterion. This does not mean the product lacks the capability. #### QM from YC Verification status: Agent cross-checked (agent-cross-checked) Support: partial Authenticated project routes and swarm APIs exist, with narrower purposes than a full issue API. Availability: unknown Delivery: native Scope: surfaces=QM core and deployment CLI; version=ec86d8b603a6cc07b21aa4d55359b88c425b61ef; plan=not specified; os=not specified; execution_modes=not specified; region=not specified; harness=not specified. Limitations: - This is a source pass; unfilled atomic questions remain unknown and no shared scenario was run. - cli — Cli [unknown]: Cli: Initial primary-source pass did not establish this question. No installed-product or shared-scenario test was run. - api — Api [supported]: Projects and swarm HTTP operations are documented or implemented. Sources: qm:project-routes, qm:swarms. - sdk — Sdk [unknown]: Sdk: Initial primary-source pass did not establish this question. No installed-product or shared-scenario test was run. - mcp_server — Mcp server [unknown]: Mcp server: Initial primary-source pass did not establish this question. No installed-product or shared-scenario test was run. - webhooks — Webhooks [unknown]: Webhooks: Initial primary-source pass did not establish this question. No installed-product or shared-scenario test was run. - operations — Operations [unknown]: Operations: Initial primary-source pass did not establish this question. No installed-product or shared-scenario test was run. - authentication — Authentication [supported]: Project routes bind capability principal to actor; swarm calls require scoped agent tokens. Sources: qm:project-routes, qm:swarms. - stability — Stability [unknown]: Stability: Initial primary-source pass did not establish this question. No installed-product or shared-scenario test was run. Checked 2026-09-23; agent cross-checked 2026-09-23; check again by 2026-10-23. Sources: qm:project-routes, qm:swarms ### ACC-06: External tools and extensions Judgment rule: Record MCP client support, plugins, custom tools, skill/instruction import, integration authentication and permission scope. Name which component provides each connection and whether setup is product-managed or inherited from the underlying harness. Verify one external-tool call and its access boundary where available. #### CodeLayer / HumanLayer Verification status: No sourced public finding (not-published) Support: not-published No publishable sourced finding is available for this criterion. This does not mean the product lacks the capability. #### QM from YC Verification status: No sourced public finding (not-published) Support: not-published No publishable sourced finding is available for this criterion. This does not mean the product lacks the capability. ### ACC-07: Client implementation Judgment rule: For each desktop/mobile client, record native platform UI, Electron, Tauri, React Native, web/PWA or unknown, plus hybrids. Require official technical docs or pinned source/build evidence. Tauri is not synonymous with fully native UI. Keep implementation choice separate from measured responsiveness and usability. #### CodeLayer / HumanLayer Verification status: No sourced public finding (not-published) Support: not-published No publishable sourced finding is available for this criterion. This does not mean the product lacks the capability. #### QM from YC Verification status: Agent cross-checked (agent-cross-checked) Support: partial The web workspace uses Lit according to its package manifest. Availability: source-only Delivery: native Scope: surfaces=QM web workspace; version=ec86d8b603a6cc07b21aa4d55359b88c425b61ef; plan=not specified; os=not specified; execution_modes=not specified; region=not specified; harness=not specified. Limitations: - This is a source pass; unfilled atomic questions remain unknown and no shared scenario was run. - desktop_implementation — Desktop implementation [unknown]: Desktop implementation: Initial primary-source pass did not establish this question. No installed-product or shared-scenario test was run. - mobile_implementation — Mobile implementation [unknown]: Mobile implementation: Initial primary-source pass did not establish this question. No installed-product or shared-scenario test was run. - hybrids — Hybrids [supported]: Browser-rendered Lit UI; this does not establish a native mobile application. Sources: qm:web-package. - implementation_evidence — Implementation evidence [supported]: Pinned web UI package declares Lit. Sources: qm:web-package. Checked 2026-09-23; agent cross-checked 2026-09-23; check again by 2026-12-22. Sources: qm:web-package ## Planning and context ### PLAN-01: Intake and external tracker relationship Judgment rule: Record local creation, prompt intake, issue import and chat/Git triggers. Identify the authoritative tracker, stable issue IDs, one-way or two-way sync, supported edits and operations requiring a trip back to Linear/GitHub/Jira. Importing or attaching a ticket is not native issue management. Answer PLAN-06 and PLAN-07 separately. #### CodeLayer / HumanLayer Verification status: Agent cross-checked (agent-cross-checked) Support: partial Official intake guides cover external issues. Availability: unknown Delivery: unknown Scope: surfaces=Current HumanLayer desktop and hosted UI; version=not specified; plan=not specified; os=not specified; execution_modes=not specified; region=not specified; harness=not specified. Limitations: - Sync semantics unverified. - local_creation — Local creation [unknown]: Local creation: Initial official-source pass did not resolve this question. No installed-client or authenticated scenario was run; source-only findings do not establish release parity. - prompt_intake — Prompt intake [unknown]: Prompt intake: Initial official-source pass did not resolve this question. No installed-client or authenticated scenario was run; source-only findings do not establish release parity. - external_import — External import [supported]: GitHub, Linear and Jira guides. Sources: code-layer:index. - chat_git_triggers — Chat git triggers [unknown]: Chat git triggers: Initial official-source pass did not resolve this question. No installed-client or authenticated scenario was run; source-only findings do not establish release parity. - authoritative_tracker — Authoritative tracker [unknown]: Authoritative tracker: Initial official-source pass did not resolve this question. No installed-client or authenticated scenario was run; source-only findings do not establish release parity. - stable_ids — Stable ids [unknown]: Stable ids: Initial official-source pass did not resolve this question. No installed-client or authenticated scenario was run; source-only findings do not establish release parity. - sync — Sync [unknown]: Sync: Initial official-source pass did not resolve this question. No installed-client or authenticated scenario was run; source-only findings do not establish release parity. - supported_edits — Supported edits [unknown]: Supported edits: Initial official-source pass did not resolve this question. No installed-client or authenticated scenario was run; source-only findings do not establish release parity. - external_roundtrips — External roundtrips [unknown]: External roundtrips: Initial official-source pass did not resolve this question. No installed-client or authenticated scenario was run; source-only findings do not establish release parity. Checked 2026-09-23; agent cross-checked 2026-09-23; check again by 2026-10-23. Sources: code-layer:index #### QM from YC Verification status: No sourced public finding (not-published) Support: not-published No publishable sourced finding is available for this criterion. This does not mean the product lacks the capability. ### PLAN-02: Durable task plans Judgment rule: Record task plans and acceptance criteria, editors, revision history and links to implementation. Test amending a task while work is running, restarting and revisiting it later. A task-specific starting brief, reusable memory and a persistent product specification are different objects; product specs are judged in PLAN-08. #### CodeLayer / HumanLayer Verification status: Agent cross-checked (agent-cross-checked) Support: partial Task files preserve plans through multiple sessions. Availability: unknown Delivery: unknown Scope: surfaces=Current HumanLayer desktop and hosted UI; version=not specified; plan=not specified; os=not specified; execution_modes=not specified; region=not specified; harness=not specified. Limitations: - Requirements revision/approval enforcement not established. - plans — Plans [partial]: Synced task files. Sources: code-layer:tasks. - acceptance_criteria — Acceptance criteria [unknown]: Acceptance criteria: Initial official-source pass did not resolve this question. No installed-client or authenticated scenario was run; source-only findings do not establish release parity. - editors — Editors [supported]: Editors update task files; agents use supported file tools. Sources: code-layer:tasks. - revisions — Revisions [unknown]: Revisions: Initial official-source pass did not resolve this question. No installed-client or authenticated scenario was run; source-only findings do not establish release parity. - implementation_links — Implementation links [unknown]: Implementation links: Initial official-source pass did not resolve this question. No installed-client or authenticated scenario was run; source-only findings do not establish release parity. - amendment — Amendment [unknown]: Amendment: Initial official-source pass did not resolve this question. No installed-client or authenticated scenario was run; source-only findings do not establish release parity. - restart_persistence — Restart persistence [unknown]: Restart persistence: Initial official-source pass did not resolve this question. No installed-client or authenticated scenario was run; source-only findings do not establish release parity. Checked 2026-09-23; agent cross-checked 2026-09-23; check again by 2026-10-23. Sources: code-layer:tasks #### QM from YC Verification status: No sourced public finding (not-published) Support: not-published No publishable sourced finding is available for this criterion. This does not mean the product lacks the capability. ### PLAN-03: Hierarchy, dependencies and evolving scope Judgment rule: Record epics, arbitrary parent/child depth, blockers, readiness, dependency enforcement and state propagation. Start with a simple interactive task, grow it into an epic and retain its identity, discussion, history and outputs. Verify blockers actually prevent dispatch. Record whether a rigid preselected workflow is required, and whether changing scope requires recreating work. #### CodeLayer / HumanLayer Verification status: No sourced public finding (not-published) Support: not-published No publishable sourced finding is available for this criterion. This does not mean the product lacks the capability. #### QM from YC Verification status: No sourced public finding (not-published) Support: not-published No publishable sourced finding is available for this criterion. This does not mean the product lacks the capability. ### PLAN-04: Shared context and memory Judgment rule: List repository instructions, skills, project docs and cross-session/cross-harness memory. Record scope, provenance, citation, correction/deletion and stale-context controls. Test what survives a new session or colleague takeover. A notes page or shared file is not automatically a maintained spec or managed memory. #### CodeLayer / HumanLayer Verification status: No sourced public finding (not-published) Support: not-published No publishable sourced finding is available for this criterion. This does not mean the product lacks the capability. #### QM from YC Verification status: Agent cross-checked (agent-cross-checked) Support: partial Memory and skills have personal/shared scope in the documented QM model. Availability: unknown Delivery: native Scope: surfaces=QM web workspace, QM Slack plugin, QM core and deployment CLI; version=ec86d8b603a6cc07b21aa4d55359b88c425b61ef; plan=not specified; os=not specified; execution_modes=not specified; region=not specified; harness=not specified. Limitations: - This is a source pass; unfilled atomic questions remain unknown and no shared scenario was run. - instructions — Instructions [unknown]: Instructions: Initial primary-source pass did not establish this question. No installed-product or shared-scenario test was run. - skills — Skills [supported]: Skills can be shared by grant and promoted by admins. Sources: qm:readme. - project_docs — Project docs [unknown]: Project docs: Initial primary-source pass did not establish this question. No installed-product or shared-scenario test was run. - memory — Memory [supported]: Scoped memory is documented. Sources: qm:readme. - scope — Scope [supported]: Personal and room scopes. Sources: qm:readme. - provenance — Provenance [unknown]: Provenance: Initial primary-source pass did not establish this question. No installed-product or shared-scenario test was run. - correction — Correction [unknown]: Correction: Initial primary-source pass did not establish this question. No installed-product or shared-scenario test was run. - deletion — Deletion [unknown]: Deletion: Initial primary-source pass did not establish this question. No installed-product or shared-scenario test was run. - freshness — Freshness [unknown]: Freshness: Initial primary-source pass did not establish this question. No installed-product or shared-scenario test was run. - takeover_continuity — Takeover continuity [unknown]: Takeover continuity: Initial primary-source pass did not establish this question. No installed-product or shared-scenario test was run. Checked 2026-09-23; agent cross-checked 2026-09-23; check again by 2026-10-23. Sources: qm:readme ### PLAN-05: Architecture and API awareness Judgment rule: Record code search, repository indexing, external knowledge and multimodal inputs, with source freshness and access scope. Ask an agent to use an existing API under a documented architecture rule, then propose a conflicting change. Check retrieval, citation, conflict detection and review-time enforcement separately. A large context window or an instruction file alone does not prove architectural consistency. #### CodeLayer / HumanLayer Verification status: No sourced public finding (not-published) Support: not-published No publishable sourced finding is available for this criterion. This does not mean the product lacks the capability. #### QM from YC Verification status: No sourced public finding (not-published) Support: not-published No publishable sourced finding is available for this criterion. This does not mean the product lacks the capability. ### PLAN-06: Native issue management and idea backlog Judgment rule: Enumerate create, edit, discuss, prioritize, label, assign, search, filter, archive, reopen and project/epic views within the product. Save an idea without creating a running agent, refine it with another person, and explicitly mark it ready or dispatch it later. Record separate task/session entities, metadata depth, multiple sessions per task, durable state transitions and whether an external tracker remains necessary. #### CodeLayer / HumanLayer Verification status: Agent cross-checked (agent-cross-checked) Support: partial Task and session are separate entities. Availability: unknown Delivery: unknown Scope: surfaces=Current HumanLayer desktop and hosted UI; version=not specified; plan=not specified; os=not specified; execution_modes=not specified; region=not specified; harness=not specified. Limitations: - Backlog dispatch, dependencies and rich issue fields unverified. - create — Create [unknown]: Create: Initial official-source pass did not resolve this question. No installed-client or authenticated scenario was run; source-only findings do not establish release parity. - edit — Edit [unknown]: Edit: Initial official-source pass did not resolve this question. No installed-client or authenticated scenario was run; source-only findings do not establish release parity. - discuss — Discuss [supported]: Task document comments. Sources: code-layer:tasks. - prioritize — Prioritize [unknown]: Prioritize: Initial official-source pass did not resolve this question. No installed-client or authenticated scenario was run; source-only findings do not establish release parity. - label — Label [unknown]: Label: Initial official-source pass did not resolve this question. No installed-client or authenticated scenario was run; source-only findings do not establish release parity. - assign — Assign [unknown]: Assign: Initial official-source pass did not resolve this question. No installed-client or authenticated scenario was run; source-only findings do not establish release parity. - search — Search [unknown]: Search: Initial official-source pass did not resolve this question. No installed-client or authenticated scenario was run; source-only findings do not establish release parity. - filter — Filter [unknown]: Filter: Initial official-source pass did not resolve this question. No installed-client or authenticated scenario was run; source-only findings do not establish release parity. - archive — Archive [unknown]: Archive: Initial official-source pass did not resolve this question. No installed-client or authenticated scenario was run; source-only findings do not establish release parity. - reopen — Reopen [unknown]: Reopen: Initial official-source pass did not resolve this question. No installed-client or authenticated scenario was run; source-only findings do not establish release parity. - project_epic_views — Project epic views [unknown]: Project epic views: Initial official-source pass did not resolve this question. No installed-client or authenticated scenario was run; source-only findings do not establish release parity. - idea_parking — Idea parking [unknown]: Idea parking: Initial official-source pass did not resolve this question. No installed-client or authenticated scenario was run; source-only findings do not establish release parity. - explicit_dispatch — Explicit dispatch [unknown]: Explicit dispatch: Initial official-source pass did not resolve this question. No installed-client or authenticated scenario was run; source-only findings do not establish release parity. - task_session_separation — Task session separation [supported]: Multiple sessions in one task. Sources: code-layer:tasks. - metadata — Metadata [partial]: Shared task context. Sources: code-layer:tasks. - durable_states — Durable states [unknown]: Durable states: Initial official-source pass did not resolve this question. No installed-client or authenticated scenario was run; source-only findings do not establish release parity. - external_tracker_requirement — External tracker requirement [unknown]: External tracker requirement: Initial official-source pass did not resolve this question. No installed-client or authenticated scenario was run; source-only findings do not establish release parity. Checked 2026-09-23; agent cross-checked 2026-09-23; check again by 2026-10-23. Sources: code-layer:tasks #### QM from YC Verification status: Agent cross-checked (agent-cross-checked) Support: partial Inspected task storage is session/run-oriented. It is evidence of task metadata, not proof of a human-managed idea backlog. Availability: source-only Delivery: native Scope: surfaces=QM core and deployment CLI; version=ec86d8b603a6cc07b21aa4d55359b88c425b61ef; plan=not specified; os=not specified; execution_modes=not specified; region=not specified; harness=not specified. Limitations: - Session/run task records cannot establish native issue management without human UI and shared-operation evidence. - create — Create [unknown]: Create: Initial primary-source pass did not establish this question. No installed-product or shared-scenario test was run. - edit — Edit [unknown]: Edit: Initial primary-source pass did not establish this question. No installed-product or shared-scenario test was run. - discuss — Discuss [unknown]: Discuss: Initial primary-source pass did not establish this question. No installed-product or shared-scenario test was run. - prioritize — Prioritize [unknown]: Prioritize: Initial primary-source pass did not establish this question. No installed-product or shared-scenario test was run. - label — Label [unknown]: Label: Initial primary-source pass did not establish this question. No installed-product or shared-scenario test was run. - assign — Assign [unknown]: Assign: Initial primary-source pass did not establish this question. No installed-product or shared-scenario test was run. - search — Search [unknown]: Search: Initial primary-source pass did not establish this question. No installed-product or shared-scenario test was run. - filter — Filter [unknown]: Filter: Initial primary-source pass did not establish this question. No installed-product or shared-scenario test was run. - archive — Archive [unknown]: Archive: Initial primary-source pass did not establish this question. No installed-product or shared-scenario test was run. - reopen — Reopen [unknown]: Reopen: Initial primary-source pass did not establish this question. No installed-product or shared-scenario test was run. - project_epic_views — Project epic views [unknown]: Project epic views: Initial primary-source pass did not establish this question. No installed-product or shared-scenario test was run. - idea_parking — Idea parking [unknown]: Idea parking: Initial primary-source pass did not establish this question. No installed-product or shared-scenario test was run. - explicit_dispatch — Explicit dispatch [unknown]: Explicit dispatch: Initial primary-source pass did not establish this question. No installed-product or shared-scenario test was run. - task_session_separation — Task session separation [unknown]: Task session separation: Initial primary-source pass did not establish this question. No installed-product or shared-scenario test was run. - metadata — Metadata [partial]: Task records contain title, sessionId, originRunId and state; issue labels/priorities/backlog are unverified. Sources: qm:task-model. - durable_states — Durable states [partial]: Status/event storage interface exists; production persistence and UI parity were not exercised. Sources: qm:task-model. - external_tracker_requirement — External tracker requirement [unknown]: External tracker requirement: Initial primary-source pass did not establish this question. No installed-product or shared-scenario test was run. Checked 2026-09-23; agent cross-checked 2026-09-23; check again by 2026-10-23. Sources: qm:task-model ### PLAN-07: Agent-native issue operations Judgment rule: Verify an agent can read/create/update the same durable issue IDs and fields humans use, claim/assign work, change state, create dependencies/children and report blockers/results through documented CLI/API/MCP. Check that human views reflect actual writes with attribution, permissions and conflict handling. Distinguish shared authoritative records, synchronized external records, agent-private metadata and prompt-only conventions. #### CodeLayer / HumanLayer Verification status: No sourced public finding (not-published) Support: not-published No publishable sourced finding is available for this criterion. This does not mean the product lacks the capability. #### QM from YC Verification status: No sourced public finding (not-published) Support: not-published No publishable sourced finding is available for this criterion. This does not mean the product lacks the capability. ### PLAN-08: Living product specifications Judgment rule: Record persistent requirements across tasks/releases, editable by humans and agents with attributable revisions and approval rules. Verify requirement-to-task/implementation links, retrieval during later tasks, drift detection and consideration during review/quality control. Amend a requirement after one task ships, then implement another. A one-time spec-to-plan workflow, per-task brief, memory store or unreferenced document does not establish a living product spec. #### CodeLayer / HumanLayer Verification status: No sourced public finding (not-published) Support: not-published No publishable sourced finding is available for this criterion. This does not mean the product lacks the capability. #### QM from YC Verification status: No sourced public finding (not-published) Support: not-published No publishable sourced finding is available for this criterion. This does not mean the product lacks the capability. ## Coordination and automation ### COORD-01: Parallel work Judgment rule: Record independently running sessions and tasks, documented quotas and observed concurrency. Describe how a user sees running, waiting, failed and finished work. Several chat tabs are not proof that runs execute concurrently. #### CodeLayer / HumanLayer Verification status: No sourced public finding (not-published) Support: not-published No publishable sourced finding is available for this criterion. This does not mean the product lacks the capability. #### QM from YC Verification status: No sourced public finding (not-published) Support: not-published No publishable sourced finding is available for this criterion. This does not mean the product lacks the capability. ### COORD-02: Ownership and dispatch Judgment rule: Record assignment to humans or agents, claims, queues, routing and duplicate-work prevention. Test two workers attempting the same task. Distinguish a display label, an advisory lock and enforced exclusive ownership. #### CodeLayer / HumanLayer Verification status: No sourced public finding (not-published) Support: not-published No publishable sourced finding is available for this criterion. This does not mean the product lacks the capability. #### QM from YC Verification status: No sourced public finding (not-published) Support: not-published No publishable sourced finding is available for this criterion. This does not mean the product lacks the capability. ### COORD-03: Inspectable delegation and communication Judgment rule: Record parent/child roles, model/harness/effort choice, messages, result return and cross-harness teams. Distinguish product orchestration, provider-native subagents, installed orchestration skills and scripts. Record activation, auth and experimental flags. Verify actual child identity, live progress, retained results and ability to reopen or follow up after completion. A final sentence claiming two reviewers ran is not proof. Test the documented invocation as well as the shared natural-language request. #### CodeLayer / HumanLayer Verification status: No sourced public finding (not-published) Support: not-published No publishable sourced finding is available for this criterion. This does not mean the product lacks the capability. #### QM from YC Verification status: Agent cross-checked (agent-cross-checked) Support: partial Swarms document inspectable worker identities and messaging; human follow-up is limited in worker web viewers. Availability: unknown Delivery: native Scope: surfaces=QM web workspace, QM core and deployment CLI; version=ec86d8b603a6cc07b21aa4d55359b88c425b61ef; plan=not specified; os=not specified; execution_modes=not specified; region=not specified; harness=not specified. Limitations: - This is a source pass; unfilled atomic questions remain unknown and no shared scenario was run. - roles — Roles [supported]: Arbitrary worker role/context metadata. Sources: qm:swarms. - model_harness_effort — Model harness effort [unknown]: Model harness effort: Initial primary-source pass did not establish this question. No installed-product or shared-scenario test was run. - messages — Messages [supported]: Durable addressed swarm messages. Sources: qm:swarms. - results_return — Results return [unknown]: Results return: Initial primary-source pass did not establish this question. No installed-product or shared-scenario test was run. - cross_harness — Cross harness [unknown]: Cross harness: Initial primary-source pass did not establish this question. No installed-product or shared-scenario test was run. - orchestration_owner — Orchestration owner [supported]: QM swarm API coordinates ordinary QM sessions. Sources: qm:swarms. - activation — Activation [unknown]: Activation: Initial primary-source pass did not establish this question. No installed-product or shared-scenario test was run. - authentication — Authentication [unknown]: Authentication: Initial primary-source pass did not establish this question. No installed-product or shared-scenario test was run. - live_progress — Live progress [unknown]: Live progress: Initial primary-source pass did not establish this question. No installed-product or shared-scenario test was run. - retained_results — Retained results [supported]: Worker transcripts and run records persist when production stores are configured. Sources: qm:swarms. - followup — Followup [partial]: Ordinary web messages to worker transcripts are read-only; pending approvals can be allowed or denied. Sources: qm:swarms. - invocation — Invocation [unknown]: Invocation: Initial primary-source pass did not establish this question. No installed-product or shared-scenario test was run. Checked 2026-09-23; agent cross-checked 2026-09-23; check again by 2026-10-23. Sources: qm:swarms ### COORD-04: Unattended triggers Judgment rule: Record schedules, event triggers, recurring tasks and completion conditions. Name where the scheduler runs, overlap handling, retries and whether closing the client stops it. A desktop cron recipe is a manual integration unless the product owns it. #### CodeLayer / HumanLayer Verification status: No sourced public finding (not-published) Support: not-published No publishable sourced finding is available for this criterion. This does not mean the product lacks the capability. #### QM from YC Verification status: Agent cross-checked (agent-cross-checked) Support: partial QM documents background work through crons, watches and webhooks. Availability: unknown Delivery: native Scope: surfaces=QM core and deployment CLI; version=ec86d8b603a6cc07b21aa4d55359b88c425b61ef; plan=not specified; os=not specified; execution_modes=not specified; region=not specified; harness=not specified. Limitations: - This is a source pass; unfilled atomic questions remain unknown and no shared scenario was run. - schedules — Schedules [supported]: Crons. Sources: qm:readme. - events — Events [supported]: Watches and inbound webhooks. Sources: qm:readme. - recurring_tasks — Recurring tasks [unknown]: Recurring tasks: Initial primary-source pass did not establish this question. No installed-product or shared-scenario test was run. - completion_conditions — Completion conditions [unknown]: Completion conditions: Initial primary-source pass did not establish this question. No installed-product or shared-scenario test was run. - scheduler_location — Scheduler location [unknown]: Scheduler location: Initial primary-source pass did not establish this question. No installed-product or shared-scenario test was run. - overlaps — Overlaps [unknown]: Overlaps: Initial primary-source pass did not establish this question. No installed-product or shared-scenario test was run. - retries — Retries [unknown]: Retries: Initial primary-source pass did not establish this question. No installed-product or shared-scenario test was run. - client_independence — Client independence [unknown]: Client independence: Initial primary-source pass did not establish this question. No installed-product or shared-scenario test was run. Checked 2026-09-23; agent cross-checked 2026-09-23; check again by 2026-10-23. Sources: qm:readme ### COORD-05: Intervention and attention Judgment rule: Record pause, stop, resume, steering, notifications, pending decisions and escalation. Test an in-run amendment and a harmless approval prompt in both chat and terminal modes. Record silent waits, hidden CLI-only questions and whether stop terminates execution while preserving history. Require discoverable errors rather than inferring success from silence. #### CodeLayer / HumanLayer Verification status: No sourced public finding (not-published) Support: not-published No publishable sourced finding is available for this criterion. This does not mean the product lacks the capability. #### QM from YC Verification status: No sourced public finding (not-published) Support: not-published No publishable sourced finding is available for this criterion. This does not mean the product lacks the capability. ### COORD-06: Fleet and epic management UI Judgment rule: Use a disclosed fixture of 12 task/agent states across several epics, including blocked, failed, awaiting input, reviewing and completed work. Locate parent/child relationships, dependencies, attention needs, history and workload without reading every transcript. Record navigation steps and errors. Boards, graphs, waterfalls, timelines or another interface can qualify; no required visual form. State whether the fixture was simulated or used live agents. #### CodeLayer / HumanLayer Verification status: No sourced public finding (not-published) Support: not-published No publishable sourced finding is available for this criterion. This does not mean the product lacks the capability. #### QM from YC Verification status: No sourced public finding (not-published) Support: not-published No publishable sourced finding is available for this criterion. This does not mean the product lacks the capability. ### COORD-07: Workflow flexibility and orchestration visibility Judgment rule: Compare a quick interactive change with a growing epic. Record mandatory workflow/preset selection, natural-language configuration, per-agent model/effort control, changes during execution and whether the UI exposes what actually ran. Test a coordinator with two reviewer children; capture roles, relationships and results during work and after completion. Document discoverability and auth friction without judging an unsupported magic prompt as proof of missing capability. #### CodeLayer / HumanLayer Verification status: No sourced public finding (not-published) Support: not-published No publishable sourced finding is available for this criterion. This does not mean the product lacks the capability. #### QM from YC Verification status: No sourced public finding (not-published) Support: not-published No publishable sourced finding is available for this criterion. This does not mean the product lacks the capability. ## Execution and reliability ### RUN-01: Laptop-independent execution Judgment rule: List local, user-owned VPS/remote host, self-hosted service, vendor cloud and hybrid modes. Record provisioning, payer, compute resources, region, idle/max lifetime and disconnection rules. Close/disconnect the originating client and continue from another device. A hosted UI or keep-awake setting is not evidence of remote execution. Record managed-cloud convenience separately from BYO setup effort in ACC-04. #### CodeLayer / HumanLayer Verification status: Agent cross-checked (agent-cross-checked) Support: partial Remote daemons run on a user-selected host. Availability: unknown Delivery: unknown Scope: surfaces=HumanLayer remote daemon; version=not specified; plan=not specified; os=not specified; execution_modes=not specified; region=not specified; harness=not specified. Limitations: - Managed compute provisioning and prices not established. - local — Local [unknown]: Local: Initial official-source pass did not resolve this question. No installed-client or authenticated scenario was run; source-only findings do not establish release parity. - byo_remote — Byo remote [supported]: VM, workstation or private-network host. Sources: code-layer:remote. - self_hosted — Self hosted [unknown]: Self hosted: Initial official-source pass did not resolve this question. No installed-client or authenticated scenario was run; source-only findings do not establish release parity. - managed_cloud — Managed cloud [unknown]: Managed cloud: Initial official-source pass did not resolve this question. No installed-client or authenticated scenario was run; source-only findings do not establish release parity. - hybrid — Hybrid [unknown]: Hybrid: Initial official-source pass did not resolve this question. No installed-client or authenticated scenario was run; source-only findings do not establish release parity. - provisioning — Provisioning [supported]: Launch daemon; supervise it for SSH disconnect. Sources: code-layer:remote. - payer — Payer [unknown]: Payer: Initial official-source pass did not resolve this question. No installed-client or authenticated scenario was run; source-only findings do not establish release parity. - resources — Resources [unknown]: Resources: Initial official-source pass did not resolve this question. No installed-client or authenticated scenario was run; source-only findings do not establish release parity. - region — Region [unknown]: Region: Initial official-source pass did not resolve this question. No installed-client or authenticated scenario was run; source-only findings do not establish release parity. - expiry — Expiry [unknown]: Expiry: Initial official-source pass did not resolve this question. No installed-client or authenticated scenario was run; source-only findings do not establish release parity. - client_disconnect — Client disconnect [unknown]: Client disconnect: Initial official-source pass did not resolve this question. No installed-client or authenticated scenario was run; source-only findings do not establish release parity. - other_device_continuation — Other device continuation [unknown]: Other device continuation: Initial official-source pass did not resolve this question. No installed-client or authenticated scenario was run; source-only findings do not establish release parity. Checked 2026-09-23; agent cross-checked 2026-09-23; check again by 2026-10-23. Sources: code-layer:remote #### QM from YC Verification status: Agent cross-checked (agent-cross-checked) Support: partial QM is documented for operator-owned cloud deployment; third-party hosting is a separate offering. Availability: unknown Delivery: native Scope: surfaces=QM core and deployment CLI; version=ec86d8b603a6cc07b21aa4d55359b88c425b61ef; plan=not specified; os=not specified; execution_modes=not specified; region=not specified; harness=not specified. Limitations: - This is a source pass; unfilled atomic questions remain unknown and no shared scenario was run. - local — Local [unknown]: Local: Initial primary-source pass did not establish this question. No installed-product or shared-scenario test was run. - byo_remote — Byo remote [unknown]: Byo remote: Initial primary-source pass did not establish this question. No installed-product or shared-scenario test was run. - self_hosted — Self hosted [supported]: Operator-owned deployment. Sources: qm:readme. - managed_cloud — Managed cloud [unknown]: Managed cloud: Initial primary-source pass did not establish this question. No installed-product or shared-scenario test was run. - hybrid — Hybrid [unknown]: Hybrid: Initial primary-source pass did not establish this question. No installed-product or shared-scenario test was run. - provisioning — Provisioning [supported]: Deployment CLI targets Fly or AWS. Sources: qm:readme. - payer — Payer [supported]: Operator supplies its cloud account. Sources: qm:readme. - resources — Resources [unknown]: Resources: Initial primary-source pass did not establish this question. No installed-product or shared-scenario test was run. - region — Region [unknown]: Region: Initial primary-source pass did not establish this question. No installed-product or shared-scenario test was run. - expiry — Expiry [unknown]: Expiry: Initial primary-source pass did not establish this question. No installed-product or shared-scenario test was run. - client_disconnect — Client disconnect [unknown]: Client disconnect: Initial primary-source pass did not establish this question. No installed-product or shared-scenario test was run. - other_device_continuation — Other device continuation [unknown]: Other device continuation: Initial primary-source pass did not establish this question. No installed-product or shared-scenario test was run. Checked 2026-09-23; agent cross-checked 2026-09-23; check again by 2026-10-23. Sources: qm:readme ### RUN-02: Workspace and process isolation Judgment rule: Record shared checkout, branch, worktree, container, VM and OS sandbox separately. Name filesystem, process, network and secret boundaries. Validate code separation with two changes; do not claim hostile-code containment without separate security evidence. #### CodeLayer / HumanLayer Verification status: Agent cross-checked (agent-cross-checked) Support: partial Remote agents inherit daemon-user access. Availability: unknown Delivery: unknown Scope: surfaces=HumanLayer remote daemon; version=not specified; plan=not specified; os=not specified; execution_modes=not specified; region=not specified; harness=not specified. Limitations: - No claimed VM isolation from daemon alone. - checkout — Checkout [unknown]: Checkout: Initial official-source pass did not resolve this question. No installed-client or authenticated scenario was run; source-only findings do not establish release parity. - branch — Branch [unknown]: Branch: Initial official-source pass did not resolve this question. No installed-client or authenticated scenario was run; source-only findings do not establish release parity. - worktree — Worktree [unknown]: Worktree: Initial official-source pass did not resolve this question. No installed-client or authenticated scenario was run; source-only findings do not establish release parity. - container — Container [unknown]: Container: Initial official-source pass did not resolve this question. No installed-client or authenticated scenario was run; source-only findings do not establish release parity. - vm — Vm [unknown]: Vm: Initial official-source pass did not resolve this question. No installed-client or authenticated scenario was run; source-only findings do not establish release parity. - os_sandbox — Os sandbox [unknown]: Os sandbox: Initial official-source pass did not resolve this question. No installed-client or authenticated scenario was run; source-only findings do not establish release parity. - filesystem — Filesystem [unknown]: Filesystem: Initial official-source pass did not resolve this question. No installed-client or authenticated scenario was run; source-only findings do not establish release parity. - process — Process [unknown]: Process: Initial official-source pass did not resolve this question. No installed-client or authenticated scenario was run; source-only findings do not establish release parity. - network — Network [unknown]: Network: Initial official-source pass did not resolve this question. No installed-client or authenticated scenario was run; source-only findings do not establish release parity. - secrets — Secrets [unknown]: Secrets: Initial official-source pass did not resolve this question. No installed-client or authenticated scenario was run; source-only findings do not establish release parity. - code_separation — Code separation [unknown]: Code separation: Initial official-source pass did not resolve this question. No installed-client or authenticated scenario was run; source-only findings do not establish release parity. - security_boundary — Security boundary [partial]: Use least-privileged daemon user. Sources: code-layer:remote. Checked 2026-09-23; agent cross-checked 2026-09-23; check again by 2026-10-23. Sources: code-layer:remote #### QM from YC Verification status: Agent cross-checked (agent-cross-checked) Support: partial Swarm workers receive separate blank computers; optional shared forums do not copy parent files. Availability: unknown Delivery: native Scope: surfaces=QM core and deployment CLI; version=ec86d8b603a6cc07b21aa4d55359b88c425b61ef; plan=not specified; os=not specified; execution_modes=not specified; region=not specified; harness=not specified. Limitations: - This is a source pass; unfilled atomic questions remain unknown and no shared scenario was run. - checkout — Checkout [unknown]: Checkout: Initial primary-source pass did not establish this question. No installed-product or shared-scenario test was run. - branch — Branch [unknown]: Branch: Initial primary-source pass did not establish this question. No installed-product or shared-scenario test was run. - worktree — Worktree [unknown]: Worktree: Initial primary-source pass did not establish this question. No installed-product or shared-scenario test was run. - container — Container [unknown]: Container: Initial primary-source pass did not establish this question. No installed-product or shared-scenario test was run. - vm — Vm [unknown]: Vm: Initial primary-source pass did not establish this question. No installed-product or shared-scenario test was run. - os_sandbox — Os sandbox [unknown]: Os sandbox: Initial primary-source pass did not establish this question. No installed-product or shared-scenario test was run. - filesystem — Filesystem [partial]: Private blank worker computers; an explicit forum can share a disk. Sources: qm:swarms. - process — Process [unknown]: Process: Initial primary-source pass did not establish this question. No installed-product or shared-scenario test was run. - network — Network [unknown]: Network: Initial primary-source pass did not establish this question. No installed-product or shared-scenario test was run. - secrets — Secrets [unknown]: Secrets: Initial primary-source pass did not establish this question. No installed-product or shared-scenario test was run. - code_separation — Code separation [partial]: Parent files are not automatically copied; shared forums require write coordination. Sources: qm:swarms. - security_boundary — Security boundary [unknown]: Security boundary: Initial primary-source pass did not establish this question. No installed-product or shared-scenario test was run. Checked 2026-09-23; agent cross-checked 2026-09-23; check again by 2026-10-23. Sources: qm:swarms ### RUN-03: Recovery, expiry and continuity Judgment rule: Test client disconnect, worker crash, service restart and documented sandbox expiry safely. Separate transcript reload, process reconnection, task resumption and state reconstruction. Record lost context, duplicated actions, manual repair and ability to continue a multi-day epic after compute replacement. Short sandbox lifetimes are reported with their continuity behavior, not automatically treated as failure. #### CodeLayer / HumanLayer Verification status: No sourced public finding (not-published) Support: not-published No publishable sourced finding is available for this criterion. This does not mean the product lacks the capability. #### QM from YC Verification status: Agent cross-checked (agent-cross-checked) Support: partial Production durability requires configured persistence; defaults must not be described as durable automatically. Availability: unknown Delivery: native Scope: surfaces=QM core and deployment CLI; version=ec86d8b603a6cc07b21aa4d55359b88c425b61ef; plan=not specified; os=not specified; execution_modes=not specified; region=not specified; harness=not specified. Limitations: - This is a source pass; unfilled atomic questions remain unknown and no shared scenario was run. - client_disconnect — Client disconnect [unknown]: Client disconnect: Initial primary-source pass did not establish this question. No installed-product or shared-scenario test was run. - worker_crash — Worker crash [unknown]: Worker crash: Initial primary-source pass did not establish this question. No installed-product or shared-scenario test was run. - service_restart — Service restart [partial]: README states in-memory sessions vanish on restart unless Postgres session storage is configured. Sources: qm:readme. - expiry — Expiry [unknown]: Expiry: Initial primary-source pass did not establish this question. No installed-product or shared-scenario test was run. - transcript_reload — Transcript reload [unknown]: Transcript reload: Initial primary-source pass did not establish this question. No installed-product or shared-scenario test was run. - process_reconnect — Process reconnect [unknown]: Process reconnect: Initial primary-source pass did not establish this question. No installed-product or shared-scenario test was run. - task_resume — Task resume [unknown]: Task resume: Initial primary-source pass did not establish this question. No installed-product or shared-scenario test was run. - state_reconstruction — State reconstruction [unknown]: State reconstruction: Initial primary-source pass did not establish this question. No installed-product or shared-scenario test was run. - context_loss — Context loss [unknown]: Context loss: Initial primary-source pass did not establish this question. No installed-product or shared-scenario test was run. - duplicate_actions — Duplicate actions [unknown]: Duplicate actions: Initial primary-source pass did not establish this question. No installed-product or shared-scenario test was run. - manual_repair — Manual repair [unknown]: Manual repair: Initial primary-source pass did not establish this question. No installed-product or shared-scenario test was run. - multi_day_continuity — Multi day continuity [unknown]: Multi day continuity: Initial primary-source pass did not establish this question. No installed-product or shared-scenario test was run. Checked 2026-09-23; agent cross-checked 2026-09-23; check again by 2026-10-07. Sources: qm:readme ### RUN-04: Development environment reliability Judgment rule: Record dependency setup, node_modules/cache handling, snapshots, services, port allocation and secret injection. Start two workspaces with the same service requirements; note installation duplication, port collisions and repair steps. Repeat on a clean remote host. Record which problems the product handles automatically and which the user must diagnose. #### CodeLayer / HumanLayer Verification status: No sourced public finding (not-published) Support: not-published No publishable sourced finding is available for this criterion. This does not mean the product lacks the capability. #### QM from YC Verification status: No sourced public finding (not-published) Support: not-published No publishable sourced finding is available for this criterion. This does not mean the product lacks the capability. ### RUN-05: Limits and failure handling Judgment rule: Record time, turn, token and spend limits; timeout, retry and provider-failure behavior. Test one controlled failure and a small safe budget. Record whether limits are warnings, enforced stops, or external billing controls. #### CodeLayer / HumanLayer Verification status: No sourced public finding (not-published) Support: not-published No publishable sourced finding is available for this criterion. This does not mean the product lacks the capability. #### QM from YC Verification status: No sourced public finding (not-published) Support: not-published No publishable sourced finding is available for this criterion. This does not mean the product lacks the capability. ### RUN-06: Truthful status and operational statistics Judgment rule: Record logs, traces, failure reasons, usage exports and statistics by task, agent, project and time. Induce a worker failure and an approval wait: check agent, task and board state agree and remain correct after reconnect. Distinguish working, blocked, failed, idle, ready for review and delivered. For speed/success claims disclose fixture, model, hardware, attempts and failures. UI responsiveness needs observed interaction timings; never infer a framework from lag. #### CodeLayer / HumanLayer Verification status: No sourced public finding (not-published) Support: not-published No publishable sourced finding is available for this criterion. This does not mean the product lacks the capability. #### QM from YC Verification status: No sourced public finding (not-published) Support: not-published No publishable sourced finding is available for this criterion. This does not mean the product lacks the capability. ### RUN-07: Per-task API and compute cost Judgment rule: Record visible model/API spend per task, session, child and epic, including aggregation across harness changes. Distinguish billed charges, estimates, tokens, subscription allowance and unavailable amounts; never render unknown subscription marginal cost as zero. Reconcile totals with provider evidence where available. Record compute fees separately, refresh delay, budget alerts, export and drill-down from summary statistics. #### CodeLayer / HumanLayer Verification status: No sourced public finding (not-published) Support: not-published No publishable sourced finding is available for this criterion. This does not mean the product lacks the capability. #### QM from YC Verification status: No sourced public finding (not-published) Support: not-published No publishable sourced finding is available for this criterion. This does not mean the product lacks the capability. ### RUN-08: Compute-aware scheduling and verification Judgment rule: Record concurrency limits, queues, CPU/RAM limits, backpressure, per-host resource awareness and reuse/deduplication of checks. Queue multiple browser end-to-end tests under a declared safe capacity; verify excess work queues or throttles rather than overloading the host. Inspect cancellation, fairness, recovery and whether overlapping epics share limits. Do not run an uncontrolled load test. #### CodeLayer / HumanLayer Verification status: No sourced public finding (not-published) Support: not-published No publishable sourced finding is available for this criterion. This does not mean the product lacks the capability. #### QM from YC Verification status: No sourced public finding (not-published) Support: not-published No publishable sourced finding is available for this criterion. This does not mean the product lacks the capability. ## Human collaboration and control ### TEAM-01: Live human collaboration Judgment rule: Record shared visibility, issue discussion, comments, presence and simultaneous co-prompting as independent capabilities. Use two named accounts to steer the same agent and record input ordering/conflict handling, attribution and permission controls. Read-only links and shared issues do not establish co-steering. Record team/free-tier restrictions and whether the original owner must stay online. #### CodeLayer / HumanLayer Verification status: Agent cross-checked (agent-cross-checked) Support: partial Task access permits team review and document comments. Availability: unknown Delivery: unknown Scope: surfaces=Current HumanLayer desktop and hosted UI; version=not specified; plan=not specified; os=not specified; execution_modes=not specified; region=not specified; harness=not specified. Limitations: - Concurrent co-prompting and input conflicts untested. - visibility — Visibility [supported]: Shared task access. Sources: code-layer:tasks. - discussion — Discussion [unknown]: Discussion: Initial official-source pass did not resolve this question. No installed-client or authenticated scenario was run; source-only findings do not establish release parity. - comments — Comments [supported]: Reviewers comment on synced documents. Sources: code-layer:tasks. - presence — Presence [unknown]: Presence: Initial official-source pass did not resolve this question. No installed-client or authenticated scenario was run; source-only findings do not establish release parity. - coprompting — Coprompting [unknown]: Coprompting: Initial official-source pass did not resolve this question. No installed-client or authenticated scenario was run; source-only findings do not establish release parity. - ordering — Ordering [unknown]: Ordering: Initial official-source pass did not resolve this question. No installed-client or authenticated scenario was run; source-only findings do not establish release parity. - conflicts — Conflicts [unknown]: Conflicts: Initial official-source pass did not resolve this question. No installed-client or authenticated scenario was run; source-only findings do not establish release parity. - attribution — Attribution [unknown]: Attribution: Initial official-source pass did not resolve this question. No installed-client or authenticated scenario was run; source-only findings do not establish release parity. - permissions — Permissions [supported]: Edit access controls sessions/files. Sources: code-layer:tasks. - plan_restrictions — Plan restrictions [unknown]: Plan restrictions: Initial official-source pass did not resolve this question. No installed-client or authenticated scenario was run; source-only findings do not establish release parity. - owner_online — Owner online [unknown]: Owner online: Initial official-source pass did not resolve this question. No installed-client or authenticated scenario was run; source-only findings do not establish release parity. Checked 2026-09-23; agent cross-checked 2026-09-23; check again by 2026-10-23. Sources: code-layer:tasks #### QM from YC Verification status: Agent cross-checked (agent-cross-checked) Support: partial QM documents people collaborating with agents in shared rooms; simultaneous prompt ordering remains untested. Availability: unknown Delivery: native Scope: surfaces=QM web workspace, QM Slack plugin; version=ec86d8b603a6cc07b21aa4d55359b88c425b61ef; plan=not specified; os=not specified; execution_modes=not specified; region=not specified; harness=not specified. Limitations: - This is a source pass; unfilled atomic questions remain unknown and no shared scenario was run. - visibility — Visibility [supported]: Personal and shared scopes are documented. Sources: qm:readme. - discussion — Discussion [supported]: Shared channels, group messages and projects. Sources: qm:readme. - comments — Comments [unknown]: Comments: Initial primary-source pass did not establish this question. No installed-product or shared-scenario test was run. - presence — Presence [unknown]: Presence: Initial primary-source pass did not establish this question. No installed-product or shared-scenario test was run. - coprompting — Coprompting [unknown]: Coprompting: Initial primary-source pass did not establish this question. No installed-product or shared-scenario test was run. - ordering — Ordering [unknown]: Ordering: Initial primary-source pass did not establish this question. No installed-product or shared-scenario test was run. - conflicts — Conflicts [unknown]: Conflicts: Initial primary-source pass did not establish this question. No installed-product or shared-scenario test was run. - attribution — Attribution [unknown]: Attribution: Initial primary-source pass did not establish this question. No installed-product or shared-scenario test was run. - permissions — Permissions [unknown]: Permissions: Initial primary-source pass did not establish this question. No installed-product or shared-scenario test was run. - plan_restrictions — Plan restrictions [unknown]: Plan restrictions: Initial primary-source pass did not establish this question. No installed-product or shared-scenario test was run. - owner_online — Owner online [unknown]: Owner online: Initial primary-source pass did not establish this question. No installed-product or shared-scenario test was run. Checked 2026-09-23; agent cross-checked 2026-09-23; check again by 2026-10-23. Sources: qm:readme ### TEAM-02: Roles and access boundaries Judgment rule: Record organization/project/task roles, membership lifecycle, SSO and provisioning where offered. Test unauthorized access and revocation with consenting test accounts. Describe documented versus observed enforcement, including which plan provides it. #### CodeLayer / HumanLayer Verification status: No sourced public finding (not-published) Support: not-published No publishable sourced finding is available for this criterion. This does not mean the product lacks the capability. #### QM from YC Verification status: Agent cross-checked (agent-cross-checked) Support: partial Project membership controls appear in inspected routes. Availability: source-only Delivery: native Scope: surfaces=QM core and deployment CLI; version=ec86d8b603a6cc07b21aa4d55359b88c425b61ef; plan=not specified; os=not specified; execution_modes=not specified; region=not specified; harness=not specified. Limitations: - This is a source pass; unfilled atomic questions remain unknown and no shared scenario was run. - organization_roles — Organization roles [unknown]: Organization roles: Initial primary-source pass did not establish this question. No installed-product or shared-scenario test was run. - project_roles — Project roles [partial]: Mutations can return forbidden; complete role matrix and revocation tests are pending. Sources: qm:project-routes. - task_roles — Task roles [unknown]: Task roles: Initial primary-source pass did not establish this question. No installed-product or shared-scenario test was run. - membership — Membership [supported]: Add/remove project-member routes. Sources: qm:project-routes. - sso — Sso [unknown]: Sso: Initial primary-source pass did not establish this question. No installed-product or shared-scenario test was run. - provisioning — Provisioning [unknown]: Provisioning: Initial primary-source pass did not establish this question. No installed-product or shared-scenario test was run. - unauthorized_access — Unauthorized access [unknown]: Unauthorized access: Initial primary-source pass did not establish this question. No installed-product or shared-scenario test was run. - revocation — Revocation [unknown]: Revocation: Initial primary-source pass did not establish this question. No installed-product or shared-scenario test was run. - plan_scope — Plan scope [unknown]: Plan scope: Initial primary-source pass did not establish this question. No installed-product or shared-scenario test was run. Checked 2026-09-23; agent cross-checked 2026-09-23; check again by 2026-10-23. Sources: qm:project-routes ### TEAM-03: Approvals and temporary access Judgment rule: Record command, tool, network, secret and delivery approvals, approver identity and scope lifetime. Demonstrate allow, deny and revocation, including temporary tunnels or shared access after its thread/session ends. Separate default full access, available safer modes and product-enforced policy from instructions the model is expected to follow. #### CodeLayer / HumanLayer Verification status: No sourced public finding (not-published) Support: not-published No publishable sourced finding is available for this criterion. This does not mean the product lacks the capability. #### QM from YC Verification status: No sourced public finding (not-published) Support: not-published No publishable sourced finding is available for this criterion. This does not mean the product lacks the capability. ### TEAM-04: Decision and activity history Judgment rule: Record attributed actions, approvals, edits, discussion and decision links. Check whether history persists across users and sessions, can be exported, and can be altered. Use the word audit only with a defined retention and integrity model. #### CodeLayer / HumanLayer Verification status: No sourced public finding (not-published) Support: not-published No publishable sourced finding is available for this criterion. This does not mean the product lacks the capability. #### QM from YC Verification status: No sourced public finding (not-published) Support: not-published No publishable sourced finding is available for this criterion. This does not mean the product lacks the capability. ### TEAM-05: Review experience and guidance Judgment rule: Evaluate locating pending reviews, understanding a change, navigating evidence, commenting, requesting changes and finding the next shipping action. Measure steps/time and missed evidence on a shared fixture. Record keyboard/narrow-screen usability, context switching, clarity of agent roles and preservation of review context. Generic diff/PR access and a guided review workflow are different capabilities. Link high-volume review findings to SHIP-06. #### CodeLayer / HumanLayer Verification status: No sourced public finding (not-published) Support: not-published No publishable sourced finding is available for this criterion. This does not mean the product lacks the capability. #### QM from YC Verification status: No sourced public finding (not-published) Support: not-published No publishable sourced finding is available for this criterion. This does not mean the product lacks the capability. ### TEAM-06: Colleague takeover and continuity Judgment rule: Have a second authorized person take over ongoing work with the same task, session history, decisions, artifacts, permissions and runtime context. Test after the first person disconnects. Record ownership transfer, attribution and lost context. Separately record transferring to another model/harness; a forked transcript or shared link alone is not full human takeover. #### CodeLayer / HumanLayer Verification status: Agent cross-checked (agent-cross-checked) Support: partial Related history/files continue across workstations. Availability: unknown Delivery: unknown Scope: surfaces=Current HumanLayer desktop and hosted UI; version=not specified; plan=not specified; os=not specified; execution_modes=not specified; region=not specified; harness=not specified. Limitations: - Runtime process transfer and owner-disconnect behavior untested. - ongoing_takeover — Ongoing takeover [unknown]: Ongoing takeover: Initial official-source pass did not resolve this question. No installed-client or authenticated scenario was run; source-only findings do not establish release parity. - same_task — Same task [supported]: Task groups continuing work. Sources: code-layer:tasks. - session_history — Session history [supported]: Related sessions retained. Sources: code-layer:tasks. - decisions — Decisions [unknown]: Decisions: Initial official-source pass did not resolve this question. No installed-client or authenticated scenario was run; source-only findings do not establish release parity. - artifacts — Artifacts [supported]: Synced task files. Sources: code-layer:tasks. - permissions — Permissions [unknown]: Permissions: Initial official-source pass did not resolve this question. No installed-client or authenticated scenario was run; source-only findings do not establish release parity. - runtime_context — Runtime context [unknown]: Runtime context: Initial official-source pass did not resolve this question. No installed-client or authenticated scenario was run; source-only findings do not establish release parity. - owner_disconnect — Owner disconnect [unknown]: Owner disconnect: Initial official-source pass did not resolve this question. No installed-client or authenticated scenario was run; source-only findings do not establish release parity. - ownership — Ownership [unknown]: Ownership: Initial official-source pass did not resolve this question. No installed-client or authenticated scenario was run; source-only findings do not establish release parity. - attribution — Attribution [unknown]: Attribution: Initial official-source pass did not resolve this question. No installed-client or authenticated scenario was run; source-only findings do not establish release parity. - context_loss — Context loss [unknown]: Context loss: Initial official-source pass did not resolve this question. No installed-client or authenticated scenario was run; source-only findings do not establish release parity. - harness_transfer — Harness transfer [unknown]: Harness transfer: Initial official-source pass did not resolve this question. No installed-client or authenticated scenario was run; source-only findings do not establish release parity. Checked 2026-09-23; agent cross-checked 2026-09-23; check again by 2026-10-23. Sources: code-layer:tasks #### QM from YC Verification status: No sourced public finding (not-published) Support: not-published No publishable sourced finding is available for this criterion. This does not mean the product lacks the capability. ## Verification and delivery ### SHIP-01: Retained artifacts and outputs Judgment rule: Record diffs, documents, screenshots, recordings, previews and test/reviewer outputs. Check for a searchable/browsable artifact gallery or equivalent retrieval, linked to task and exact revision, usable after sessions end. Reopen a completed child reviewer and retrieve its full findings. Check whether internal prompts or tool metadata unintentionally appear in the produced application or other user-facing output. In-chat attachments, persistent review evidence and a cross-task gallery get distinct answers. #### CodeLayer / HumanLayer Verification status: Agent cross-checked (agent-cross-checked) Support: partial Task artifact view includes synced text and object files. Availability: unknown Delivery: unknown Scope: surfaces=Current HumanLayer desktop and hosted UI; version=not specified; plan=not specified; os=not specified; execution_modes=not specified; region=not specified; harness=not specified. Limitations: - Task-file sync is not repository backup; text files capped at 10MB. - diffs — Diffs [unknown]: Diffs: Initial official-source pass did not resolve this question. No installed-client or authenticated scenario was run; source-only findings do not establish release parity. - documents — Documents [supported]: Markdown, text, JSON. Sources: code-layer:tasks. - screenshots — Screenshots [supported]: Images use object storage. Sources: code-layer:tasks. - recordings — Recordings [unknown]: Recordings: Initial official-source pass did not resolve this question. No installed-client or authenticated scenario was run; source-only findings do not establish release parity. - previews — Previews [unknown]: Previews: Initial official-source pass did not resolve this question. No installed-client or authenticated scenario was run; source-only findings do not establish release parity. - test_outputs — Test outputs [unknown]: Test outputs: Initial official-source pass did not resolve this question. No installed-client or authenticated scenario was run; source-only findings do not establish release parity. - reviewer_outputs — Reviewer outputs [unknown]: Reviewer outputs: Initial official-source pass did not resolve this question. No installed-client or authenticated scenario was run; source-only findings do not establish release parity. - gallery — Gallery [unknown]: Gallery: Initial official-source pass did not resolve this question. No installed-client or authenticated scenario was run; source-only findings do not establish release parity. - task_links — Task links [supported]: Artifacts live with task. Sources: code-layer:tasks. - revision_links — Revision links [unknown]: Revision links: Initial official-source pass did not resolve this question. No installed-client or authenticated scenario was run; source-only findings do not establish release parity. - persistence — Persistence [unknown]: Persistence: Initial official-source pass did not resolve this question. No installed-client or authenticated scenario was run; source-only findings do not establish release parity. - child_findings — Child findings [unknown]: Child findings: Initial official-source pass did not resolve this question. No installed-client or authenticated scenario was run; source-only findings do not establish release parity. - prompt_leakage — Prompt leakage [unknown]: Prompt leakage: Initial official-source pass did not resolve this question. No installed-client or authenticated scenario was run; source-only findings do not establish release parity. Checked 2026-09-23; agent cross-checked 2026-09-23; check again by 2026-10-23. Sources: code-layer:tasks #### QM from YC Verification status: No sourced public finding (not-published) Support: not-published No publishable sourced finding is available for this criterion. This does not mean the product lacks the capability. ### SHIP-02: Verification and spec gates Judgment rule: Record tests, lint, types, CI, independent review and persistent-spec conformance checks as required versus optional. Cause a failed test and a conflict with an existing product requirement. Verify review catches the conflict and delivery blocks where claimed. An agent saying checks passed is not a passing gate; record configured and enforced policy separately. #### CodeLayer / HumanLayer Verification status: No sourced public finding (not-published) Support: not-published No publishable sourced finding is available for this criterion. This does not mean the product lacks the capability. #### QM from YC Verification status: No sourced public finding (not-published) Support: not-published No publishable sourced finding is available for this criterion. This does not mean the product lacks the capability. ### SHIP-03: Git and pull request workflow Judgment rule: Record branches/worktrees, commits, PR creation, review comments, CI response, rebase and conflict handling. Complete one fixture change through a draft PR. Distinguish an integrated workflow from the agent running Git commands without product state. #### CodeLayer / HumanLayer Verification status: No sourced public finding (not-published) Support: not-published No publishable sourced finding is available for this criterion. This does not mean the product lacks the capability. #### QM from YC Verification status: No sourced public finding (not-published) Support: not-published No publishable sourced finding is available for this criterion. This does not mean the product lacks the capability. ### SHIP-04: Merge and deployment authority Judgment rule: Record who can approve, merge, release and deploy, plus checks against the exact revision. Verify the documented authority boundary without publishing real changes. PR creation, merge and production deployment are separate capabilities. #### CodeLayer / HumanLayer Verification status: No sourced public finding (not-published) Support: not-published No publishable sourced finding is available for this criterion. This does not mean the product lacks the capability. #### QM from YC Verification status: No sourced public finding (not-published) Support: not-published No publishable sourced finding is available for this criterion. This does not mean the product lacks the capability. ### SHIP-05: Completion evidence and rollback Judgment rule: Record task-to-commit/PR/build/deployment links, delivery status, retained evidence and rollback or revert support. Change the candidate revision after review and examine whether approval/evidence is invalidated. Agent exit alone does not prove delivery. #### CodeLayer / HumanLayer Verification status: No sourced public finding (not-published) Support: not-published No publishable sourced finding is available for this criterion. This does not mean the product lacks the capability. #### QM from YC Verification status: No sourced public finding (not-published) Support: not-published No publishable sourced finding is available for this criterion. This does not mean the product lacks the capability. ### SHIP-06: Batch review and high-volume shipping Judgment rule: Return to a queue of at least six completed fixture tasks and review a subset. Record summaries, grouping, risk/size filters, retained reviewer findings, artifact navigation, request-changes flow, approval of exact revisions, dependency-aware merge/release queues and clear next actions. Check stale approvals invalidate after edits and duplicate checks respect RUN-08. Distinguish basic diff/PR actions from a coordinated review-and-delivery queue; do not require Podium terminology. #### CodeLayer / HumanLayer Verification status: No sourced public finding (not-published) Support: not-published No publishable sourced finding is available for this criterion. This does not mean the product lacks the capability. #### QM from YC Verification status: No sourced public finding (not-published) Support: not-published No publishable sourced finding is available for this criterion. This does not mean the product lacks the capability. ## Ownership, privacy and economics ### OWN-01: Source and license Judgment rule: Record license and revision per component, including client, server and hosted extensions. Distinguish open source, source-available and closed components. Repository visibility is not a license classification or proof of hosted parity. #### CodeLayer / HumanLayer Verification status: No sourced public finding (not-published) Support: not-published No publishable sourced finding is available for this criterion. This does not mean the product lacks the capability. #### QM from YC Verification status: Agent cross-checked (agent-cross-checked) Support: partial Public repository carries MIT; hosted extensions and parity remain unverified. Availability: unknown Delivery: native Scope: surfaces=QM web workspace, QM Slack plugin, QM core and deployment CLI; version=ec86d8b603a6cc07b21aa4d55359b88c425b61ef; plan=not specified; os=not specified; execution_modes=not specified; region=not specified; harness=not specified. Limitations: - This is a source pass; unfilled atomic questions remain unknown and no shared scenario was run. - client_license — Client license [supported]: Root MIT license, subject to component notices. Sources: qm:license. - server_license — Server license [unknown]: Server license: Initial primary-source pass did not establish this question. No installed-product or shared-scenario test was run. - hosted_extensions — Hosted extensions [unknown]: Hosted extensions: Initial primary-source pass did not establish this question. No installed-product or shared-scenario test was run. - source_visibility — Source visibility [supported]: Public repository. Sources: qm:license. - source_revision — Source revision [supported]: ec86d8b603a6cc07b21aa4d55359b88c425b61ef Sources: qm:license. - hosted_parity — Hosted parity [unknown]: Hosted parity: Initial primary-source pass did not establish this question. No installed-product or shared-scenario test was run. Checked 2026-09-23; agent cross-checked 2026-09-23; check again by 2026-12-22. Sources: qm:license ### OWN-02: Hosting and exit Judgment rule: Record self-hosting scope, required vendor services, data export/import, standard formats and account cancellation behavior. Verify what remains usable without the vendor account. Exported code alone does not mean tasks, context and history are portable. #### CodeLayer / HumanLayer Verification status: No sourced public finding (not-published) Support: not-published No publishable sourced finding is available for this criterion. This does not mean the product lacks the capability. #### QM from YC Verification status: Agent cross-checked (agent-cross-checked) Support: partial QM supports organization-owned deployments and forks. Availability: unknown Delivery: native Scope: surfaces=QM core and deployment CLI; version=ec86d8b603a6cc07b21aa4d55359b88c425b61ef; plan=not specified; os=not specified; execution_modes=not specified; region=not specified; harness=not specified. Limitations: - This is a source pass; unfilled atomic questions remain unknown and no shared scenario was run. - self_hosting — Self hosting [supported]: Documented deployment into the operator cloud account. Sources: qm:readme. - vendor_dependencies — Vendor dependencies [unknown]: Vendor dependencies: Initial primary-source pass did not establish this question. No installed-product or shared-scenario test was run. - export — Export [unknown]: Export: Initial primary-source pass did not establish this question. No installed-product or shared-scenario test was run. - import — Import [unknown]: Import: Initial primary-source pass did not establish this question. No installed-product or shared-scenario test was run. - formats — Formats [unknown]: Formats: Initial primary-source pass did not establish this question. No installed-product or shared-scenario test was run. - cancellation — Cancellation [unknown]: Cancellation: Initial primary-source pass did not establish this question. No installed-product or shared-scenario test was run. - account_independence — Account independence [unknown]: Account independence: Initial primary-source pass did not establish this question. No installed-product or shared-scenario test was run. - history_portability — History portability [unknown]: History portability: Initial primary-source pass did not establish this question. No installed-product or shared-scenario test was run. Checked 2026-09-23; agent cross-checked 2026-09-23; check again by 2026-10-23. Sources: qm:readme ### OWN-03: Data handling and telemetry Judgment rule: Record where code, prompts, credentials, logs and artifacts go, retention/deletion, training use, residency and subprocessors. Separately record telemetry disclosure, collection defaults, opt-in/opt-out controls and observed first-run prompts. No consent dialog is an observation, not proof of no telemetry, secret telemetry or unlawful processing. Separate orchestration-vendor and model-provider policies. #### CodeLayer / HumanLayer Verification status: No sourced public finding (not-published) Support: not-published No publishable sourced finding is available for this criterion. This does not mean the product lacks the capability. #### QM from YC Verification status: No sourced public finding (not-published) Support: not-published No publishable sourced finding is available for this criterion. This does not mean the product lacks the capability. ### OWN-04: Price and included usage Judgment rule: Record currency, billing interval, seats/seat minimums, workspace charges, included usage, credits, trial conditions, overages, taxes treatment and separate model/compute costs. Map billing routes to ACC-03. Cite public prices or dated quotes. Per-seat versus pooled billing is a fact, not a universal quality judgment. #### CodeLayer / HumanLayer Verification status: Agent cross-checked (agent-cross-checked) Support: partial Starter free; Pro $100/user/month. Availability: unknown Delivery: unknown Scope: surfaces=Current HumanLayer desktop and hosted UI; version=not specified; plan=not specified; os=not specified; execution_modes=not specified; region=not specified; harness=not specified. Limitations: - Compute and provider costs not fully checked. - currency — Currency [supported]: USD. Sources: code-layer:home. - interval — Interval [unknown]: Interval: Initial official-source pass did not resolve this question. No installed-client or authenticated scenario was run; source-only findings do not establish release parity. - seats — Seats [supported]: Per-user Pro. Sources: code-layer:home. - seat_minimum — Seat minimum [unknown]: Seat minimum: Initial official-source pass did not resolve this question. No installed-client or authenticated scenario was run; source-only findings do not establish release parity. - workspace_fees — Workspace fees [unknown]: Workspace fees: Initial official-source pass did not resolve this question. No installed-client or authenticated scenario was run; source-only findings do not establish release parity. - included_usage — Included usage [supported]: Starter 200 sessions/month, up to 3 members. Sources: code-layer:home. - credits — Credits [unknown]: Credits: Initial official-source pass did not resolve this question. No installed-client or authenticated scenario was run; source-only findings do not establish release parity. - trial — Trial [unknown]: Trial: Initial official-source pass did not resolve this question. No installed-client or authenticated scenario was run; source-only findings do not establish release parity. - overages — Overages [unknown]: Overages: Initial official-source pass did not resolve this question. No installed-client or authenticated scenario was run; source-only findings do not establish release parity. - taxes — Taxes [unknown]: Taxes: Initial official-source pass did not resolve this question. No installed-client or authenticated scenario was run; source-only findings do not establish release parity. - model_cost — Model cost [unknown]: Model cost: Initial official-source pass did not resolve this question. No installed-client or authenticated scenario was run; source-only findings do not establish release parity. - compute_cost — Compute cost [unknown]: Compute cost: Initial official-source pass did not resolve this question. No installed-client or authenticated scenario was run; source-only findings do not establish release parity. Checked 2026-09-23; agent cross-checked 2026-09-23; check again by 2026-10-07. Sources: code-layer:home #### QM from YC Verification status: No sourced public finding (not-published) Support: not-published No publishable sourced finding is available for this criterion. This does not mean the product lacks the capability. ### OWN-05: Scenario cost and controls Judgment rule: Price stated workloads for one, two and five developers, with fixed tasks, concurrency, tokens and compute-hours. The two-person scenario models Till and Michael collaborating. Include subscription, platform, model and compute charges; separate fixed, variable, included and unknown costs. No invented average task cost. Link cost visibility and reconciliation to RUN-07. #### CodeLayer / HumanLayer Verification status: No sourced public finding (not-published) Support: not-published No publishable sourced finding is available for this criterion. This does not mean the product lacks the capability. #### QM from YC Verification status: No sourced public finding (not-published) Support: not-published No publishable sourced finding is available for this criterion. This does not mean the product lacks the capability. ### OWN-06: Availability and support Judgment rule: Record GA/beta/access restrictions, support channels, documented response commitments, release activity, status history and deprecation/export options. Funding, stars and popularity can be context but are not reliability scores. An archived repository does not prove the hosted service is discontinued. #### CodeLayer / HumanLayer Verification status: No sourced public finding (not-published) Support: not-published No publishable sourced finding is available for this criterion. This does not mean the product lacks the capability. #### QM from YC Verification status: No sourced public finding (not-published) Support: not-published No publishable sourced finding is available for this criterion. This does not mean the product lacks the capability. ### OWN-07: Enterprise assurance Judgment rule: Record each claimed assurance separately: ISO standard/certificate scope, issuer and validity; SOC 2 report type, covered service and audit period; report/certificate access and verification date. Distinguish public documentation, vendor assertion, independently accessible evidence and unavailable evidence. A logo, enterprise pricing tier, SSO or a provider certification does not prove this product is certified or audited. Report controls in TEAM-02 separately; no legal-compliance verdict. #### CodeLayer / HumanLayer Verification status: No sourced public finding (not-published) Support: not-published No publishable sourced finding is available for this criterion. This does not mean the product lacks the capability. #### QM from YC Verification status: No sourced public finding (not-published) Support: not-published No publishable sourced finding is available for this criterion. This does not mean the product lacks the capability. ### OWN-08: Useful free tier and evaluation access Judgment rule: Distinguish an ongoing free tier, time-limited trial, credits-only trial, open-source self-hosting costs, paid-only access and gated early access. Map which shared scenarios work for free, especially two-person collaboration, BYO subscriptions, remote compute, mobile, issue management and review. Record card requirement, usage caps and whether meaningful evaluation needs payment or sales approval. #### CodeLayer / HumanLayer Verification status: Agent cross-checked (agent-cross-checked) Support: partial Starter allows small-team evaluation. Availability: unknown Delivery: unknown Scope: surfaces=Current HumanLayer desktop and hosted UI; version=not specified; plan=not specified; os=not specified; execution_modes=not specified; region=not specified; harness=not specified. Limitations: - Card and scenario-specific limits untested. - ongoing_free — Ongoing free [supported]: Up to 3 members and 200 sessions/month. Sources: code-layer:home. - trial — Trial [unknown]: Trial: Initial official-source pass did not resolve this question. No installed-client or authenticated scenario was run; source-only findings do not establish release parity. - credits_trial — Credits trial [unknown]: Credits trial: Initial official-source pass did not resolve this question. No installed-client or authenticated scenario was run; source-only findings do not establish release parity. - self_host_cost — Self host cost [unknown]: Self host cost: Initial official-source pass did not resolve this question. No installed-client or authenticated scenario was run; source-only findings do not establish release parity. - paid_only — Paid only [unknown]: Paid only: Initial official-source pass did not resolve this question. No installed-client or authenticated scenario was run; source-only findings do not establish release parity. - early_access — Early access [unknown]: Early access: Initial official-source pass did not resolve this question. No installed-client or authenticated scenario was run; source-only findings do not establish release parity. - free_scenarios — Free scenarios [unknown]: Free scenarios: Initial official-source pass did not resolve this question. No installed-client or authenticated scenario was run; source-only findings do not establish release parity. - card_required — Card required [unknown]: Card required: Initial official-source pass did not resolve this question. No installed-client or authenticated scenario was run; source-only findings do not establish release parity. - usage_caps — Usage caps [unknown]: Usage caps: Initial official-source pass did not resolve this question. No installed-client or authenticated scenario was run; source-only findings do not establish release parity. - paid_evaluation — Paid evaluation [unknown]: Paid evaluation: Initial official-source pass did not resolve this question. No installed-client or authenticated scenario was run; source-only findings do not establish release parity. Checked 2026-09-23; agent cross-checked 2026-09-23; check again by 2026-10-07. Sources: code-layer:home #### QM from YC Verification status: No sourced public finding (not-published) Support: not-published No publishable sourced finding is available for this criterion. This does not mean the product lacks the capability. ### OWN-09: Pricing transparency Judgment rule: Record publicly stated units, included limits, overage rates, compute/model pass-through or markup, minimum commitment, cancellation and sales-only unknowns. Use transparent, partially specified, quote-only or unknown, with named missing fields. A quote-only enterprise price is a disclosed procurement constraint, not proof of dishonesty. #### CodeLayer / HumanLayer Verification status: No sourced public finding (not-published) Support: not-published No publishable sourced finding is available for this criterion. This does not mean the product lacks the capability. #### QM from YC Verification status: No sourced public finding (not-published) Support: not-published No publishable sourced finding is available for this criterion. This does not mean the product lacks the capability. ## Sources ### code-layer:remote How Remote Daemons Work. User host runs Claude/Codex; web/phone UI can message sessions. Persistent supervision required; browser lacks terminal/workspace configuration. - URL: https://docs.humanlayer.com/explanation/remote-daemons - Locator: Hosts; Process lifecycle; Browser capabilities - Evidence kind: documented - Source date: Not stated - Retrieved: 2026-09-23 ### qm:readme QM from YC: README.md. Documents shared channels/projects, scope-owned memory, web and Slack, selectable agent runtimes, self-host deployment and Postgres configuration. - URL: https://github.com/yc-software/qm/blob/ec86d8b603a6cc07b21aa4d55359b88c425b61ef/README.md - Locator: README.md - Evidence kind: documented - Source date: Not stated - Retrieved: 2026-09-23 ### code-layer:home HumanLayer. Current brand HumanLayer; task-centered workspace and free Starter for up to three members and 200 monthly sessions. Pro $100/user/month. - URL: https://www.humanlayer.com/ - Locator: Platform; Pricing - Evidence kind: vendor-claimed - Source date: Not stated - Retrieved: 2026-09-23 ### qm:project-routes QM from YC: src/api/routes/projects.ts. Project HTTP routes support list/create/rename and membership mutations; capability callers are bound to their actor identity. Project APIs are not issue CRUD. - URL: https://github.com/yc-software/qm/blob/ec86d8b603a6cc07b21aa4d55359b88c425b61ef/src/api/routes/projects.ts - Locator: src/api/routes/projects.ts - Evidence kind: source-inspected - Source date: Not stated - Retrieved: 2026-09-23 - Commit: ec86d8b603a6cc07b21aa4d55359b88c425b61ef - Path: src/api/routes/projects.ts ### qm:swarms QM from YC: docs/swarms.md. Documents durable worker sessions, scoped messaging, human and agent APIs, provisioning retries and finite budgets. Worker web transcripts are read-only for normal messages, with approval controls. - URL: https://github.com/yc-software/qm/blob/ec86d8b603a6cc07b21aa4d55359b88c425b61ef/docs/swarms.md - Locator: docs/swarms.md - Evidence kind: documented - Source date: Not stated - Retrieved: 2026-09-23 ### qm:web-package QM from YC: plugins/web-ui/package.json. Web UI package declares Lit; this supports the browser implementation classification, not mobile-client parity. - URL: https://github.com/yc-software/qm/blob/ec86d8b603a6cc07b21aa4d55359b88c425b61ef/plugins/web-ui/package.json - Locator: plugins/web-ui/package.json - Evidence kind: source-inspected - Source date: Not stated - Retrieved: 2026-09-23 - Commit: ec86d8b603a6cc07b21aa4d55359b88c425b61ef - Path: plugins/web-ui/package.json ### code-layer:index HumanLayer Docs. Official guides cover remote daemons, workflows, Codex, Bedrock, external issue sources and automation. - URL: https://docs.humanlayer.com/ - Locator: Guides and explanations - Evidence kind: documented - Source date: Not stated - Retrieved: 2026-09-23 ### code-layer:tasks How HumanLayer tasks work. One task groups sessions, synced artifacts and review; human permissions control edits/comments; files sync across workstations. - URL: https://docs.humanlayer.com/explanation/tasks - Locator: Task versus session; Share and review; Task files - Evidence kind: documented - Source date: Not stated - Retrieved: 2026-09-23 ### qm:task-model QM from YC: src/tasks/task-store.ts. Task interface ties IDs to sessions and runs, with pending/in_progress/completed/skipped/failed states and status-event APIs. It does not establish an independent human issue backlog. - URL: https://github.com/yc-software/qm/blob/ec86d8b603a6cc07b21aa4d55359b88c425b61ef/src/tasks/task-store.ts - Locator: src/tasks/task-store.ts - Evidence kind: source-inspected - Source date: Not stated - Retrieved: 2026-09-23 - Commit: ec86d8b603a6cc07b21aa4d55359b88c425b61ef - Path: src/tasks/task-store.ts ### qm:license QM from YC: LICENSE. Repository root license is MIT; component-specific exceptions and hosted parity were not audited. - URL: https://github.com/yc-software/qm/blob/ec86d8b603a6cc07b21aa4d55359b88c425b61ef/LICENSE - Locator: LICENSE - Evidence kind: documented - Source date: Not stated - Retrieved: 2026-09-23