Compare commits
3
Commits
| Author | SHA1 | Date | |
|---|---|---|---|
|
|
682311facf | ||
|
|
8ce7f95239 | ||
|
|
825319740c |
@@ -0,0 +1,158 @@
|
||||
# V1R4C5 Baseline Promotion Operator Handoff
|
||||
|
||||
Date: 2026-07-11
|
||||
|
||||
Status: ready for operator promotion; baseline not yet switched
|
||||
|
||||
## Current Verified State
|
||||
|
||||
```text
|
||||
GitOps runtime: active
|
||||
workspace branch: request/promote-V1R4C5-recommended-20260711
|
||||
current active baseline: V1R4C3
|
||||
V1R4C5 tag: exists
|
||||
```
|
||||
|
||||
`V1R4C5` tag is present in GitOps version list.
|
||||
|
||||
Current active baseline remains `V1R4C3`.
|
||||
|
||||
## Owner Decision
|
||||
|
||||
Owner approved final promotion using the recommended scheme:
|
||||
|
||||
```text
|
||||
Do not move existing V1R4C5 tag.
|
||||
Do not force-push.
|
||||
Promote using the metadata-complete release commit.
|
||||
Keep memory search disabled.
|
||||
```
|
||||
|
||||
## Recommended Promotion Source
|
||||
|
||||
Promotion source branch:
|
||||
|
||||
```text
|
||||
release/v1r4c5-final-owner-approval-20260711
|
||||
```
|
||||
|
||||
Metadata-complete promotion commit observed earlier:
|
||||
|
||||
```text
|
||||
c128d6b
|
||||
```
|
||||
|
||||
Existing immutable tag:
|
||||
|
||||
```text
|
||||
V1R4C5
|
||||
```
|
||||
|
||||
Tag object:
|
||||
|
||||
```text
|
||||
ac9bdacb19ff66cba8046d75358866f0f0fffb82
|
||||
```
|
||||
|
||||
Tag target commit:
|
||||
|
||||
```text
|
||||
d457ac396147043ed5d0a3fd8b44bcb10f48bceb
|
||||
```
|
||||
|
||||
The tag must not be moved.
|
||||
|
||||
## Required Pre-Promotion Checks
|
||||
|
||||
Run on the operator host:
|
||||
|
||||
```bash
|
||||
cd /data/aios-gitops/workspace
|
||||
|
||||
git fetch origin --tags
|
||||
|
||||
git checkout release/v1r4c5-final-owner-approval-20260711
|
||||
git pull --ff-only origin release/v1r4c5-final-owner-approval-20260711
|
||||
|
||||
git rev-parse --short HEAD
|
||||
test -f versions/V1R4C5.json
|
||||
git ls-remote --tags origin V1R4C5
|
||||
```
|
||||
|
||||
Expected:
|
||||
|
||||
```text
|
||||
HEAD is c128d6b or a later normal fast-forward commit on the release branch
|
||||
versions/V1R4C5.json exists
|
||||
refs/tags/V1R4C5 exists
|
||||
```
|
||||
|
||||
## Promotion Command
|
||||
|
||||
Use the existing baseline promotion mechanism to set:
|
||||
|
||||
```text
|
||||
current_baseline = V1R4C5
|
||||
previous_baseline = V1R4C3
|
||||
git = <release branch HEAD containing versions/V1R4C5.json>
|
||||
promoted_by = openclaw/admin
|
||||
```
|
||||
|
||||
Promotion reason:
|
||||
|
||||
```text
|
||||
V1R4C5 reliability, watcher cleanup, user data isolation gate, and admin workbench read-only preparation; memory search remains disabled
|
||||
```
|
||||
|
||||
## Hard Constraints
|
||||
|
||||
Do not run:
|
||||
|
||||
```bash
|
||||
git push --force
|
||||
```
|
||||
|
||||
Do not:
|
||||
|
||||
```text
|
||||
move refs/tags/V1R4C5
|
||||
enable memory search
|
||||
modify Gitea DB
|
||||
bulk merge old test/smoke/auth branches
|
||||
deploy full SR-04 portal rollout beyond read-only/admin visibility preparation
|
||||
```
|
||||
|
||||
## Post-Promotion Verification
|
||||
|
||||
After promotion, verify:
|
||||
|
||||
```text
|
||||
getBaseline
|
||||
```
|
||||
|
||||
Expected:
|
||||
|
||||
```json
|
||||
{
|
||||
"current_baseline": "V1R4C5",
|
||||
"previous_baseline": "V1R4C3"
|
||||
}
|
||||
```
|
||||
|
||||
Also verify:
|
||||
|
||||
```text
|
||||
AIOS_MEMORY_ENABLED=false
|
||||
memory search disabled
|
||||
Gitea sentinel healthy
|
||||
```
|
||||
|
||||
## Fallback
|
||||
|
||||
If any promotion check fails:
|
||||
|
||||
1. Stop promotion.
|
||||
2. Keep active baseline at V1R4C3.
|
||||
3. Keep memory search disabled.
|
||||
4. Do not move the existing tag.
|
||||
5. Reconcile release branch normally, without force-push.
|
||||
@@ -1,128 +0,0 @@
|
||||
# Search Gateway Resilience
|
||||
|
||||
## Positioning
|
||||
|
||||
SR-02 is a generic Search Gateway capability improvement. It is not tied to education, exams, geography, policy, product search, or any single content vertical.
|
||||
|
||||
The goal is to convert Search Gateway from single-shot retrieval into an evidence-first retrieval pipeline:
|
||||
|
||||
```text
|
||||
query normalization
|
||||
→ source planning
|
||||
→ official/direct adapters
|
||||
→ provider fallback
|
||||
→ extraction
|
||||
→ evidence cache
|
||||
→ confidence scoring
|
||||
→ failure diagnosis
|
||||
→ human evidence request when needed
|
||||
```
|
||||
|
||||
## Generic capabilities
|
||||
|
||||
### 1. Multi-source fallback
|
||||
|
||||
Search Gateway should not fail just because one provider is blocked, truncated, rate-limited, or dynamically rendered.
|
||||
|
||||
Default fallback chain:
|
||||
|
||||
```text
|
||||
direct_official_adapter
|
||||
→ official_site_search
|
||||
→ structured_api_or_feed
|
||||
→ search_engine_provider
|
||||
→ authoritative_mirror_or_media
|
||||
→ cached_evidence
|
||||
→ user_supplied_evidence_request
|
||||
```
|
||||
|
||||
### 2. Source tiering
|
||||
|
||||
Every source is classified before being trusted:
|
||||
|
||||
```text
|
||||
OFFICIAL_PRIMARY
|
||||
OFFICIAL_SECONDARY
|
||||
AUTHORITATIVE_MEDIA
|
||||
SPECIALIZED_DATABASE
|
||||
GENERAL_WEB
|
||||
USER_SUPPLIED_EVIDENCE
|
||||
```
|
||||
|
||||
The same tiering model works for public policy, software documentation, finance data, product specs, standards, academic sources, sports, travel, and user-supplied documents.
|
||||
|
||||
### 3. Failure diagnosis
|
||||
|
||||
Search failures must be structured, not vague.
|
||||
|
||||
Examples:
|
||||
|
||||
```text
|
||||
SEARCH_PROVIDER_TIMEOUT
|
||||
SEARCH_PROVIDER_CAPTCHA
|
||||
SEARCH_RESULT_TRUNCATED
|
||||
SOURCE_BLOCKED_BY_CDN
|
||||
SOURCE_DYNAMIC_PAGE_UNREADABLE
|
||||
OFFICIAL_SOURCE_FOUND_BUT_EXTRACTION_FAILED
|
||||
SOURCE_CONFLICT_NEEDS_REVIEW
|
||||
EVIDENCE_CACHE_STALE
|
||||
HUMAN_EVIDENCE_REQUIRED
|
||||
```
|
||||
|
||||
### 4. Evidence cache
|
||||
|
||||
A successful retrieval should leave structured evidence behind:
|
||||
|
||||
```yaml
|
||||
evidence_id: ev-...
|
||||
normalized_query: ...
|
||||
source_tier: OFFICIAL_PRIMARY
|
||||
publisher: ...
|
||||
url: ...
|
||||
extracted_at: ...
|
||||
published_at: ...
|
||||
answer_fields: {...}
|
||||
confidence: high
|
||||
```
|
||||
|
||||
Cache entries must carry staleness rules by topic type. Time-sensitive information should expire faster than static references.
|
||||
|
||||
### 5. Confidence scoring
|
||||
|
||||
Search Gateway should return both the answer and confidence metadata:
|
||||
|
||||
```json
|
||||
{
|
||||
"answer": {},
|
||||
"confidence": 0.95,
|
||||
"confidence_level": "high",
|
||||
"sources": [],
|
||||
"fallback_used": true,
|
||||
"failure_codes": [],
|
||||
"evidence_ids": []
|
||||
}
|
||||
```
|
||||
|
||||
### 6. Human evidence intake
|
||||
|
||||
When automated retrieval is blocked, Search Gateway should ask for a screenshot, URL, PDF, or pasted text and ingest it as `USER_SUPPLIED_EVIDENCE`, rather than silently failing.
|
||||
|
||||
## Non-goals
|
||||
|
||||
- No vertical-specific hardcoding.
|
||||
- No CAPTCHA bypass.
|
||||
- No access-control bypass.
|
||||
- No scraping of protected/private content.
|
||||
- No treating search snippets as authoritative without source classification.
|
||||
|
||||
## Acceptance
|
||||
|
||||
SR-02 is accepted when:
|
||||
|
||||
```text
|
||||
AIOS_SEARCH_GATEWAY_MULTI_SOURCE_READY
|
||||
AIOS_SEARCH_GATEWAY_FAILURE_DIAGNOSIS_READY
|
||||
AIOS_SEARCH_GATEWAY_EVIDENCE_CACHE_READY
|
||||
AIOS_SEARCH_GATEWAY_CONFIDENCE_SCORING_READY
|
||||
AIOS_SEARCH_GATEWAY_GENERIC_RESILIENCE_READY
|
||||
```
|
||||
@@ -1,9 +0,0 @@
|
||||
{
|
||||
"type": "branch",
|
||||
"branch": "feature/v1r4c4-sr02-search-gateway-resilience-20260710",
|
||||
"base": "main",
|
||||
"created_by": "chatgpt-gitops-bot",
|
||||
"created_at": "2026-07-10T10:41:20Z",
|
||||
"direct_main_push": false,
|
||||
"owner_approval_required": true
|
||||
}
|
||||
@@ -1,118 +0,0 @@
|
||||
version: 1
|
||||
name: search-gateway-resilience
|
||||
baseline: V1R4C3
|
||||
created_at: "2026-07-10"
|
||||
scope: generic_search_capability
|
||||
status: proposed
|
||||
|
||||
purpose: >
|
||||
Upgrade Search Gateway from single-shot search into a general-purpose,
|
||||
multi-source, evidence-first retrieval system with fallback, diagnostics,
|
||||
source confidence scoring, and reusable evidence cache.
|
||||
|
||||
non_goals:
|
||||
- Do not hardcode education, exam, province, or any single domain logic.
|
||||
- Do not depend on a single search engine.
|
||||
- Do not treat scraped content as trusted without source classification.
|
||||
- Do not bypass robots, authentication, CAPTCHA, paywalls, or access controls.
|
||||
|
||||
source_priority:
|
||||
OFFICIAL_PRIMARY:
|
||||
confidence_base: 0.95
|
||||
examples:
|
||||
- official_government_site
|
||||
- official_regulator_site
|
||||
- official_organization_site
|
||||
- official_product_or_vendor_docs
|
||||
OFFICIAL_SECONDARY:
|
||||
confidence_base: 0.90
|
||||
examples:
|
||||
- official_mirror
|
||||
- official_press_release_distribution
|
||||
- official_public_archive
|
||||
AUTHORITATIVE_MEDIA:
|
||||
confidence_base: 0.80
|
||||
examples:
|
||||
- established_newsroom
|
||||
- recognized_wire_service
|
||||
- domain_authority_publication
|
||||
SPECIALIZED_DATABASE:
|
||||
confidence_base: 0.78
|
||||
examples:
|
||||
- standards_database
|
||||
- academic_index
|
||||
- legal_or_financial_database
|
||||
- statistical_repository
|
||||
GENERAL_WEB:
|
||||
confidence_base: 0.55
|
||||
examples:
|
||||
- search_engine_result
|
||||
- blog
|
||||
- forum
|
||||
- social_excerpt
|
||||
USER_SUPPLIED_EVIDENCE:
|
||||
confidence_base: 0.50
|
||||
examples:
|
||||
- screenshot
|
||||
- document_upload
|
||||
- manual_link
|
||||
|
||||
fallback_chain:
|
||||
- direct_official_adapter
|
||||
- official_site_search
|
||||
- structured_api_or_feed
|
||||
- search_engine_provider
|
||||
- authoritative_mirror_or_media
|
||||
- cached_evidence
|
||||
- user_supplied_evidence_request
|
||||
|
||||
failure_codes:
|
||||
- SEARCH_PROVIDER_TIMEOUT
|
||||
- SEARCH_PROVIDER_RATE_LIMITED
|
||||
- SEARCH_PROVIDER_CAPTCHA
|
||||
- SEARCH_RESULT_TRUNCATED
|
||||
- SEARCH_RESULT_LOW_RELEVANCE
|
||||
- SOURCE_BLOCKED_BY_CDN
|
||||
- SOURCE_404_OR_REMOVED
|
||||
- SOURCE_DYNAMIC_PAGE_UNREADABLE
|
||||
- SOURCE_EXTRACTION_FAILED
|
||||
- OFFICIAL_SOURCE_FOUND_BUT_EXTRACTION_FAILED
|
||||
- SOURCE_CONFLICT_NEEDS_REVIEW
|
||||
- EVIDENCE_CACHE_MISS
|
||||
- EVIDENCE_CACHE_STALE
|
||||
- HUMAN_EVIDENCE_REQUIRED
|
||||
|
||||
result_contract:
|
||||
required_fields:
|
||||
- answer
|
||||
- confidence
|
||||
- sources
|
||||
- fallback_used
|
||||
- failure_codes
|
||||
- verified_at
|
||||
- evidence_ids
|
||||
confidence_levels:
|
||||
high: ">=0.85 with official or multi-source corroboration"
|
||||
medium: ">=0.65 and <0.85 with credible but incomplete evidence"
|
||||
low: "<0.65 or unresolved source/extraction limitations"
|
||||
|
||||
cache_policy:
|
||||
evidence_cache_enabled: true
|
||||
cache_key_fields:
|
||||
- normalized_query
|
||||
- topic_type
|
||||
- jurisdiction_or_scope
|
||||
- effective_date
|
||||
stale_after_days_by_topic:
|
||||
news: 7
|
||||
policy_or_law: 30
|
||||
product_or_price: 3
|
||||
static_reference: 180
|
||||
default: 14
|
||||
|
||||
acceptance_signals:
|
||||
- AIOS_SEARCH_GATEWAY_MULTI_SOURCE_READY
|
||||
- AIOS_SEARCH_GATEWAY_FAILURE_DIAGNOSIS_READY
|
||||
- AIOS_SEARCH_GATEWAY_EVIDENCE_CACHE_READY
|
||||
- AIOS_SEARCH_GATEWAY_CONFIDENCE_SCORING_READY
|
||||
- AIOS_SEARCH_GATEWAY_GENERIC_RESILIENCE_READY
|
||||
@@ -1,147 +0,0 @@
|
||||
"""Generic Search Gateway resilience contract.
|
||||
|
||||
This module is intentionally domain-agnostic. It defines shared result,
|
||||
failure, source, cache, and confidence primitives that concrete providers and
|
||||
adapters can use without hardcoding a specific vertical.
|
||||
"""
|
||||
from __future__ import annotations
|
||||
|
||||
from dataclasses import dataclass, field
|
||||
from datetime import datetime, timezone
|
||||
from enum import Enum
|
||||
from typing import Any
|
||||
|
||||
|
||||
class SourceTier(str, Enum):
|
||||
OFFICIAL_PRIMARY = "OFFICIAL_PRIMARY"
|
||||
OFFICIAL_SECONDARY = "OFFICIAL_SECONDARY"
|
||||
AUTHORITATIVE_MEDIA = "AUTHORITATIVE_MEDIA"
|
||||
SPECIALIZED_DATABASE = "SPECIALIZED_DATABASE"
|
||||
GENERAL_WEB = "GENERAL_WEB"
|
||||
USER_SUPPLIED_EVIDENCE = "USER_SUPPLIED_EVIDENCE"
|
||||
|
||||
|
||||
class FailureCode(str, Enum):
|
||||
SEARCH_PROVIDER_TIMEOUT = "SEARCH_PROVIDER_TIMEOUT"
|
||||
SEARCH_PROVIDER_RATE_LIMITED = "SEARCH_PROVIDER_RATE_LIMITED"
|
||||
SEARCH_PROVIDER_CAPTCHA = "SEARCH_PROVIDER_CAPTCHA"
|
||||
SEARCH_RESULT_TRUNCATED = "SEARCH_RESULT_TRUNCATED"
|
||||
SEARCH_RESULT_LOW_RELEVANCE = "SEARCH_RESULT_LOW_RELEVANCE"
|
||||
SOURCE_BLOCKED_BY_CDN = "SOURCE_BLOCKED_BY_CDN"
|
||||
SOURCE_404_OR_REMOVED = "SOURCE_404_OR_REMOVED"
|
||||
SOURCE_DYNAMIC_PAGE_UNREADABLE = "SOURCE_DYNAMIC_PAGE_UNREADABLE"
|
||||
SOURCE_EXTRACTION_FAILED = "SOURCE_EXTRACTION_FAILED"
|
||||
OFFICIAL_SOURCE_FOUND_BUT_EXTRACTION_FAILED = "OFFICIAL_SOURCE_FOUND_BUT_EXTRACTION_FAILED"
|
||||
SOURCE_CONFLICT_NEEDS_REVIEW = "SOURCE_CONFLICT_NEEDS_REVIEW"
|
||||
EVIDENCE_CACHE_MISS = "EVIDENCE_CACHE_MISS"
|
||||
EVIDENCE_CACHE_STALE = "EVIDENCE_CACHE_STALE"
|
||||
HUMAN_EVIDENCE_REQUIRED = "HUMAN_EVIDENCE_REQUIRED"
|
||||
|
||||
|
||||
SOURCE_CONFIDENCE_BASE: dict[SourceTier, float] = {
|
||||
SourceTier.OFFICIAL_PRIMARY: 0.95,
|
||||
SourceTier.OFFICIAL_SECONDARY: 0.90,
|
||||
SourceTier.AUTHORITATIVE_MEDIA: 0.80,
|
||||
SourceTier.SPECIALIZED_DATABASE: 0.78,
|
||||
SourceTier.GENERAL_WEB: 0.55,
|
||||
SourceTier.USER_SUPPLIED_EVIDENCE: 0.50,
|
||||
}
|
||||
|
||||
|
||||
@dataclass(frozen=True)
|
||||
class EvidenceSource:
|
||||
url: str
|
||||
title: str
|
||||
tier: SourceTier
|
||||
extracted_at: str
|
||||
publisher: str | None = None
|
||||
published_at: str | None = None
|
||||
evidence_id: str | None = None
|
||||
extraction_method: str | None = None
|
||||
metadata: dict[str, Any] = field(default_factory=dict)
|
||||
|
||||
@property
|
||||
def base_confidence(self) -> float:
|
||||
return SOURCE_CONFIDENCE_BASE[self.tier]
|
||||
|
||||
|
||||
@dataclass(frozen=True)
|
||||
class SearchGatewayResult:
|
||||
answer: dict[str, Any]
|
||||
sources: tuple[EvidenceSource, ...]
|
||||
failure_codes: tuple[FailureCode, ...] = ()
|
||||
fallback_used: bool = False
|
||||
evidence_ids: tuple[str, ...] = ()
|
||||
verified_at: str = field(default_factory=lambda: datetime.now(timezone.utc).isoformat())
|
||||
confidence: float = 0.0
|
||||
confidence_level: str = "low"
|
||||
notes: tuple[str, ...] = ()
|
||||
|
||||
|
||||
def confidence_level(score: float) -> str:
|
||||
if score >= 0.85:
|
||||
return "high"
|
||||
if score >= 0.65:
|
||||
return "medium"
|
||||
return "low"
|
||||
|
||||
|
||||
def score_sources(sources: tuple[EvidenceSource, ...], failure_codes: tuple[FailureCode, ...] = ()) -> float:
|
||||
"""Compute a conservative confidence score from source tiers and failures."""
|
||||
if not sources:
|
||||
return 0.0
|
||||
|
||||
best = max(source.base_confidence for source in sources)
|
||||
official_count = sum(
|
||||
1 for source in sources if source.tier in {SourceTier.OFFICIAL_PRIMARY, SourceTier.OFFICIAL_SECONDARY}
|
||||
)
|
||||
corroboration_bonus = min(0.08, max(0, len(sources) - 1) * 0.03)
|
||||
official_bonus = 0.03 if official_count >= 1 and len(sources) >= 2 else 0.0
|
||||
|
||||
penalty = 0.0
|
||||
if FailureCode.SOURCE_CONFLICT_NEEDS_REVIEW in failure_codes:
|
||||
penalty += 0.25
|
||||
if FailureCode.SEARCH_RESULT_TRUNCATED in failure_codes:
|
||||
penalty += 0.05
|
||||
if FailureCode.SOURCE_EXTRACTION_FAILED in failure_codes:
|
||||
penalty += 0.08
|
||||
if FailureCode.EVIDENCE_CACHE_STALE in failure_codes:
|
||||
penalty += 0.10
|
||||
if FailureCode.HUMAN_EVIDENCE_REQUIRED in failure_codes:
|
||||
penalty += 0.15
|
||||
|
||||
score = best + corroboration_bonus + official_bonus - penalty
|
||||
return max(0.0, min(0.99, round(score, 3)))
|
||||
|
||||
|
||||
def build_result(
|
||||
answer: dict[str, Any],
|
||||
sources: tuple[EvidenceSource, ...],
|
||||
failure_codes: tuple[FailureCode, ...] = (),
|
||||
fallback_used: bool = False,
|
||||
notes: tuple[str, ...] = (),
|
||||
) -> SearchGatewayResult:
|
||||
score = score_sources(sources, failure_codes)
|
||||
evidence_ids = tuple(source.evidence_id for source in sources if source.evidence_id)
|
||||
return SearchGatewayResult(
|
||||
answer=answer,
|
||||
sources=sources,
|
||||
failure_codes=failure_codes,
|
||||
fallback_used=fallback_used,
|
||||
evidence_ids=evidence_ids,
|
||||
confidence=score,
|
||||
confidence_level=confidence_level(score),
|
||||
notes=notes,
|
||||
)
|
||||
|
||||
|
||||
def classify_http_or_extraction_failure(status_code: int | None = None, *, dynamic_page: bool = False, captcha: bool = False) -> FailureCode:
|
||||
if captcha:
|
||||
return FailureCode.SEARCH_PROVIDER_CAPTCHA
|
||||
if status_code == 403:
|
||||
return FailureCode.SOURCE_BLOCKED_BY_CDN
|
||||
if status_code == 404:
|
||||
return FailureCode.SOURCE_404_OR_REMOVED
|
||||
if dynamic_page:
|
||||
return FailureCode.SOURCE_DYNAMIC_PAGE_UNREADABLE
|
||||
return FailureCode.SOURCE_EXTRACTION_FAILED
|
||||
@@ -1,93 +0,0 @@
|
||||
from runtime.search_gateway.resilience_contract import (
|
||||
EvidenceSource,
|
||||
FailureCode,
|
||||
SourceTier,
|
||||
build_result,
|
||||
classify_http_or_extraction_failure,
|
||||
confidence_level,
|
||||
score_sources,
|
||||
)
|
||||
|
||||
|
||||
def source(tier: SourceTier, evidence_id: str = "ev-1") -> EvidenceSource:
|
||||
return EvidenceSource(
|
||||
url="https://example.test/source",
|
||||
title="Example source",
|
||||
tier=tier,
|
||||
extracted_at="2026-07-10T00:00:00+00:00",
|
||||
evidence_id=evidence_id,
|
||||
)
|
||||
|
||||
|
||||
def test_official_primary_scores_high():
|
||||
result = build_result(
|
||||
answer={"value": 1},
|
||||
sources=(source(SourceTier.OFFICIAL_PRIMARY),),
|
||||
)
|
||||
assert result.confidence >= 0.85
|
||||
assert result.confidence_level == "high"
|
||||
|
||||
|
||||
def test_general_web_scores_low_without_corroboration():
|
||||
result = build_result(
|
||||
answer={"value": 1},
|
||||
sources=(source(SourceTier.GENERAL_WEB),),
|
||||
)
|
||||
assert result.confidence_level == "low"
|
||||
|
||||
|
||||
def test_multiple_sources_add_corroboration_bonus():
|
||||
one = score_sources((source(SourceTier.AUTHORITATIVE_MEDIA, "ev-1"),))
|
||||
two = score_sources((source(SourceTier.AUTHORITATIVE_MEDIA, "ev-1"), source(SourceTier.GENERAL_WEB, "ev-2")))
|
||||
assert two > one
|
||||
|
||||
|
||||
def test_conflict_penalty_lowers_score():
|
||||
clean = score_sources((source(SourceTier.OFFICIAL_PRIMARY),))
|
||||
conflicted = score_sources((source(SourceTier.OFFICIAL_PRIMARY),), (FailureCode.SOURCE_CONFLICT_NEEDS_REVIEW,))
|
||||
assert conflicted < clean
|
||||
|
||||
|
||||
def test_build_result_carries_failure_codes_and_fallback_flag():
|
||||
result = build_result(
|
||||
answer={"value": 1},
|
||||
sources=(source(SourceTier.OFFICIAL_SECONDARY),),
|
||||
failure_codes=(FailureCode.SEARCH_RESULT_TRUNCATED,),
|
||||
fallback_used=True,
|
||||
)
|
||||
assert result.fallback_used is True
|
||||
assert FailureCode.SEARCH_RESULT_TRUNCATED in result.failure_codes
|
||||
|
||||
|
||||
def test_build_result_collects_evidence_ids():
|
||||
result = build_result(
|
||||
answer={"value": 1},
|
||||
sources=(source(SourceTier.OFFICIAL_PRIMARY, "ev-a"), source(SourceTier.AUTHORITATIVE_MEDIA, "ev-b")),
|
||||
)
|
||||
assert result.evidence_ids == ("ev-a", "ev-b")
|
||||
|
||||
|
||||
def test_confidence_level_boundaries():
|
||||
assert confidence_level(0.85) == "high"
|
||||
assert confidence_level(0.65) == "medium"
|
||||
assert confidence_level(0.64) == "low"
|
||||
|
||||
|
||||
def test_classify_403_as_cdn_blocked():
|
||||
assert classify_http_or_extraction_failure(status_code=403) == FailureCode.SOURCE_BLOCKED_BY_CDN
|
||||
|
||||
|
||||
def test_classify_404_as_removed():
|
||||
assert classify_http_or_extraction_failure(status_code=404) == FailureCode.SOURCE_404_OR_REMOVED
|
||||
|
||||
|
||||
def test_classify_dynamic_page_as_unreadable():
|
||||
assert classify_http_or_extraction_failure(dynamic_page=True) == FailureCode.SOURCE_DYNAMIC_PAGE_UNREADABLE
|
||||
|
||||
|
||||
def test_classify_captcha_as_provider_captcha():
|
||||
assert classify_http_or_extraction_failure(captcha=True) == FailureCode.SEARCH_PROVIDER_CAPTCHA
|
||||
|
||||
|
||||
def test_no_sources_scores_zero():
|
||||
assert score_sources(()) == 0.0
|
||||
@@ -0,0 +1,45 @@
|
||||
{
|
||||
"version": "V1R4C5",
|
||||
"codename": "C5 reliability-security-admin-readonly",
|
||||
"status": "promotion-request-ready",
|
||||
"tag": "V1R4C5",
|
||||
"tag_ref": "refs/tags/V1R4C5",
|
||||
"tag_object": "ac9bdacb19ff66cba8046d75358866f0f0fffb82",
|
||||
"tag_target_commit": "d457ac396147043ed5d0a3fd8b44bcb10f48bceb",
|
||||
"recommended_promotion_branch": "release/v1r4c5-final-owner-approval-20260711",
|
||||
"recommended_promotion_commit": "c128d6b",
|
||||
"base_baseline": "V1R4C3",
|
||||
"previous_baseline": "V1R4C3",
|
||||
"created_at": "2026-07-11",
|
||||
"created_by": "chatgpt-gitops-bot",
|
||||
"release_type": "controlled-integration",
|
||||
"promotion_policy": "owner-gated",
|
||||
"owner_approval": {
|
||||
"final_promotion_approved": true,
|
||||
"memory_search_enabled": false,
|
||||
"force_push_allowed": false,
|
||||
"recommended_scheme_accepted": true
|
||||
},
|
||||
"scope": {
|
||||
"included": [
|
||||
"SR-01 Gitea reliability and branch consistency guardrails",
|
||||
"SR-02 watcher/stuck command cleanup",
|
||||
"User data isolation redline and enforcement gates",
|
||||
"SR-04 admin workbench read-only visibility preparation"
|
||||
],
|
||||
"excluded": [
|
||||
"memory search activation",
|
||||
"full cross-session memory recall",
|
||||
"global vector index",
|
||||
"full SR-04 production portal rollout",
|
||||
"bulk merge of old test/smoke/auth branches",
|
||||
"force-push based reconciliation"
|
||||
]
|
||||
},
|
||||
"deployment_constraints": {
|
||||
"AIOS_MEMORY_ENABLED": false,
|
||||
"memory_search_activation_requires_future_owner_approval": true,
|
||||
"gitea_db_mutation_requires_owner_admin_approval": true,
|
||||
"sr04_full_rollout_deferred": true
|
||||
}
|
||||
}
|
||||
@@ -1,47 +0,0 @@
|
||||
{
|
||||
"sr_id": "V1R4C4-SR02",
|
||||
"title": "Generic Search Gateway Resilience",
|
||||
"baseline": "V1R4C3",
|
||||
"scope": "generic_search_capability",
|
||||
"status": "merge_candidate",
|
||||
"risk": "medium",
|
||||
"owner_gate_required": true,
|
||||
"summary": "Upgrade Search Gateway into a domain-agnostic, evidence-first retrieval pipeline with multi-source fallback, failure diagnosis, evidence cache, and confidence scoring.",
|
||||
"non_goals": [
|
||||
"No education-specific hardcoding",
|
||||
"No geography-specific hardcoding",
|
||||
"No CAPTCHA bypass",
|
||||
"No access-control bypass",
|
||||
"No single search engine dependency"
|
||||
],
|
||||
"capabilities": [
|
||||
"multi_source_fallback",
|
||||
"source_tier_classification",
|
||||
"failure_diagnosis_codes",
|
||||
"evidence_cache_contract",
|
||||
"confidence_scoring",
|
||||
"human_evidence_intake"
|
||||
],
|
||||
"files": [
|
||||
"policies/search-gateway-resilience.yaml",
|
||||
"runtime/search_gateway/resilience_contract.py",
|
||||
"tests/test_search_gateway_resilience_contract.py",
|
||||
"docs/search-gateway-resilience.md"
|
||||
],
|
||||
"acceptance_tests": [
|
||||
"tests/test_search_gateway_resilience_contract.py"
|
||||
],
|
||||
"acceptance_signals": [
|
||||
"AIOS_SEARCH_GATEWAY_MULTI_SOURCE_READY",
|
||||
"AIOS_SEARCH_GATEWAY_FAILURE_DIAGNOSIS_READY",
|
||||
"AIOS_SEARCH_GATEWAY_EVIDENCE_CACHE_READY",
|
||||
"AIOS_SEARCH_GATEWAY_CONFIDENCE_SCORING_READY",
|
||||
"AIOS_SEARCH_GATEWAY_GENERIC_RESILIENCE_READY"
|
||||
],
|
||||
"next_steps_after_merge": [
|
||||
"Bind concrete providers to the generic contract",
|
||||
"Implement evidence cache storage adapter",
|
||||
"Add provider-level fallback orchestration",
|
||||
"Run existing Task Center and Search Gateway regression suite"
|
||||
]
|
||||
}
|
||||
@@ -0,0 +1,39 @@
|
||||
{
|
||||
"version": "V1R4C5",
|
||||
"request_type": "baseline_promotion",
|
||||
"status": "owner_approved_ready_for_operator_promotion",
|
||||
"decision": "use_recommended_scheme_do_not_move_existing_tag",
|
||||
"current_active_baseline": "V1R4C3",
|
||||
"target_baseline": "V1R4C5",
|
||||
"promotion_source_branch": "release/v1r4c5-final-owner-approval-20260711",
|
||||
"promotion_commit": "c128d6b",
|
||||
"existing_tag": {
|
||||
"name": "V1R4C5",
|
||||
"tag_object": "ac9bdacb19ff66cba8046d75358866f0f0fffb82",
|
||||
"target_commit": "d457ac396147043ed5d0a3fd8b44bcb10f48bceb",
|
||||
"policy": "immutable_do_not_move"
|
||||
},
|
||||
"reason": "V1R4C5 metadata was completed after tag creation. Recommended scheme preserves tag immutability and promotes the metadata-complete release commit through normal baseline promotion.",
|
||||
"owner_approval": {
|
||||
"final_promotion_allowed": true,
|
||||
"recommended_scheme_accepted": true,
|
||||
"force_push_allowed": false,
|
||||
"memory_search_enabled": false
|
||||
},
|
||||
"constraints": [
|
||||
"Do not move or recreate refs/tags/V1R4C5",
|
||||
"Do not force-push",
|
||||
"Keep AIOS_MEMORY_ENABLED=false",
|
||||
"Do not activate memory search",
|
||||
"Do not bulk merge old test/smoke/auth branches",
|
||||
"Do not mutate Gitea DB without separate owner/admin approval"
|
||||
],
|
||||
"operator_action": [
|
||||
"Verify release/v1r4c5-final-owner-approval-20260711 contains versions/V1R4C5.json",
|
||||
"Promote baseline to V1R4C5 using promotion commit c128d6b or the resolved full commit for that release HEAD",
|
||||
"Record previous_baseline=V1R4C3",
|
||||
"Record promoted_by=openclaw/admin",
|
||||
"Record promotion reason: V1R4C5 reliability, watcher cleanup, user data isolation gate, and admin workbench read-only preparation; memory search remains disabled",
|
||||
"Run post-promotion getBaseline verification"
|
||||
]
|
||||
}
|
||||
Reference in New Issue
Block a user