sgeboers
3a240fd907
docs(blog): update political compass post with correct EVR, GL-PvdA evidence, scree plot, HTML table
...
- Fix EVR numbers: PC1~29%, PC2~11.5% (~41%) single-window; PC1~14.6%, PC2~13.1% multi-window
- Fix window count: 38 -> 41 time windows
- Add scree plot (docs/research/scree_multiwindow.png) embedded in EVR callout
- Add party agreement heatmap (docs/research/party_agreement_2023Q3.png) with GL-PvdA 99.8% figure
- Convert markdown pipe-table to HTML table
- Remove text-embedding/fused pipeline references (not in production)
- Simplify pipeline diagram and reproducibility block
- Update DB size to ~18 GB
2026-04-16 18:47:43 +02:00
sgeboers
025617a7b8
Add GL-PvdA merger SVD analysis design with findings
...
Investigation of GroenLinks-PvdA merger dynamics in SVD space:
- Finding 1: GL-PvdA were 2.8-10.5% of avg inter-party distance apart pre-merger
- Finding 2: Merged party started most cohesive (#1 in 2023) but now 55% above avg spread
- Finding 3: Converged to 4.5% by Q3 2023, essentially indistinguishable
- Finding 4: GL/PvdA were most stable parties (10-25% drift) while VVD/D66 moved 70-177%
2026-04-16 16:49:00 +02:00
sgeboers
54489b6a30
docs: add SVD axis label alignment fix design
2026-04-12 20:13:49 +02:00
sgeboers
9f98dbae60
Add debug st.info before st.plotly_chart to diagnose invisible chart
2026-03-31 01:49:38 +02:00
sgeboers
525cd157c0
docs: add diagnose-no-plot-trajectories design (2026-03-30)
2026-03-30 23:57:18 +02:00
sgeboers
ce1fc86bcb
docs(design): add fix-missing-trajectories design
2026-03-30 22:24:05 +02:00
sgeboers
ff4ce0f9b2
Add design spec for bootstrap CIs and data enrichment
2026-03-29 22:57:36 +02:00
sgeboers
c5b39ced5f
Add design doc for compass UI improvements (axes 3-5, Y-axis arrows, discipline section)
2026-03-28 23:30:32 +01:00
sgeboers
445f0bfb24
feat(ansible-example): add @ansible/example package, tests, CI, publish & deploy workflows, docs and changelog
2026-03-28 20:00:31 +01:00
sgeboers
2efd7ba3a0
feat(mindmodel): add manifest loader and tests
2026-03-24 21:24:58 +01:00
sgeboers
eb73275f32
feat(mp-quiz): add MP quiz tab and DB helpers; add design and plan docs
2026-03-24 19:59:25 +01:00
sgeboers
b09e580f65
feat: motion content enrichment pipeline hardening
...
- ai_provider_wrapper: retry/fallback with exponential backoff, None sentinel for failed items
- text_pipeline: use wrapper, return 5-tuple (stored, skipped_existing, skipped_no_text, errors, failed_ids)
- similarity/compute: filter trivial 1.0 matches on identical short titles (<12 chars)
- rerun_embeddings: --retry-missing mode, calls ensure_text_embeddings_for_ids on failed ids
- sync_motion_content: per-ext_id retries, HTTPAdapter pool, --max-body-workers CLI flag, audit on failure
- qa_similarity script: samples motions, writes JSON ledger to thoughts/ledgers/
- All tests green: 61 passed, 2 skipped
2026-03-23 21:31:39 +01:00
sgeboers
07a89a207c
docs: add test refactor design - replace monkeypatching with DI + in-memory DuckDB
2026-03-23 20:15:29 +01:00
sgeboers
ce27dc6ac5
chore(ledgers): record fusion+similarity run summary and JSON details
2026-03-23 17:48:39 +01:00
sgeboers
2891e9ee70
feat: add StemAtlas Streamlit app, explorer, Docker deployment, blog charts
2026-03-22 22:38:17 +01:00
sgeboers
a248807e03
Add design: embedding-based motion similarity cache
...
Precomputed top-K similarity cache replacing the naive Python-scan
search_similar(). Also covers fixes for: embeddings table missing from
_init_database, fusion N+1 query, and ai_provider 429 retry.
2026-03-22 02:39:20 +01:00
sgeboers
a36e6cba4e
feat(pipeline): implement parliamentary embedding pipeline MVP
...
- Add 4 migration files: mp_votes, mp_metadata, svd_vectors, fused_embeddings
- Extend database.py with 5 new helper methods and table init
- Add pipeline/ package: extract_mp_votes, fetch_mp_metadata, text_pipeline,
svd_pipeline (with Procrustes alignment), fusion
- Add full test suite (17 tests) covering all pipeline modules and migrations
- Fix Procrustes alignment bug: scipy scale is a norm value, not a multiplier
- Fix DuckDB date type handling in test assertions (datetime.date vs string)
- Remove duckdb.py shim; tests now run against real duckdb + scipy via uv
Ref: thoughts/shared/plans/2026-03-21-parliamentary-embedding-pipeline-plan.md
2026-03-21 22:31:22 +01:00
sgeboers
fd73da3752
design: parliamentary embedding pipeline (late fusion SVD + text)
2026-03-21 21:54:32 +01:00
sgeboers