itdove/lore#16: Ingester framework: LoreIngester ABC + adapters

[itdove]

Got full context. Here's the filled template:

Description

Implements the ingester framework (#16): LoreIngester ABC with ETL pipeline (extract → transform → dedup → load), a plugin registry with auto-detection, and two concrete adapters (OpenWolf, ReasonsForge).

Key changes:

• LoreIngester ABC (ingest/base.py) — defines detect(), extract_delta(), transform(), load(), and a run() orchestrator with cosine-distance dedup at ingest time
• Ingester registry (ingest/registry.py) — @register decorator, detect_ingesters() for auto-detection, get_ingester() for named lookup
• OpenWolf adapter (ingest/openwolf.py) — ingests .wolf/cerebrum.md and .wolf/buglog.json, hook-triggered
• ReasonsForge adapter (ingest/reasonsforge.py) — ingests reasons.db SQLite entries, hook+manual triggered
• CLI expanded: lore ingest --source <name> [--since], --list, --detect
• Session-end hook (lore hook capture) auto-detects and runs hook-triggered ingesters
• Config model gains IngestConfig with enabled toggle and disabled_sources list
• Provenance tracking via ingested_from metadata on every entry

Assisted-by: Claude

Testing

Steps to test

1. Pull down the PR
2. Run unit tests: python -m pytest tests/unit/test_ingest_*.py -v
3. List available ingesters: lore ingest --list
4. In a project with .wolf/ directory: lore ingest --detect (should show openwolf)
5. Ingest from a specific source: lore ingest --source openwolf
6. Ingest with date filter: lore ingest --source reasonsforge --since 2026-01-01
7. Run session-end hook in a project with .wolf/: lore hook capture (should auto-detect and ingest)

Scenarios tested

• Registry lists all registered ingesters and detects only those present in project directory
• OpenWolf adapter parses cerebrum.md sections and buglog.json entries into KnowledgeEntry objects
• ReasonsForge adapter reads from reasons.db with optional --since filtering
• Dedup skips entries with cosine distance below threshold at same knowledge level
• Dedup gracefully degrades when no embedding provider configured
• Disabled sources in config are excluded from auto-detection
• CLI error cases: unknown source name, source not detected in directory, missing args

Deployment considerations

• This code change is ready for deployment on its own
• This code change requires the following considerations before being deployed: