Sven Geboers
3a240fd907
docs(blog): update political compass post with correct EVR, GL-PvdA evidence, scree plot, HTML table
...
- Fix EVR numbers: PC1~29%, PC2~11.5% (~41%) single-window; PC1~14.6%, PC2~13.1% multi-window
- Fix window count: 38 -> 41 time windows
- Add scree plot (docs/research/scree_multiwindow.png) embedded in EVR callout
- Add party agreement heatmap (docs/research/party_agreement_2023Q3.png) with GL-PvdA 99.8% figure
- Convert markdown pipe-table to HTML table
- Remove text-embedding/fused pipeline references (not in production)
- Simplify pipeline diagram and reproducibility block
- Update DB size to ~18 GB
2 weeks ago
Sven Geboers
025617a7b8
Add GL-PvdA merger SVD analysis design with findings
...
Investigation of GroenLinks-PvdA merger dynamics in SVD space:
- Finding 1: GL-PvdA were 2.8-10.5% of avg inter-party distance apart pre-merger
- Finding 2: Merged party started most cohesive (#1 in 2023) but now 55% above avg spread
- Finding 3: Converged to 4.5% by Q3 2023, essentially indistinguishable
- Finding 4: GL/PvdA were most stable parties (10-25% drift) while VVD/D66 moved 70-177%
2 weeks ago
Sven Geboers
54489b6a30
docs: add SVD axis label alignment fix design
3 weeks ago
Sven Geboers
eb71328967
chore: commit remaining modified files from refactoring
4 weeks ago
Sven Geboers
1a83f0f319
docs: add trajectory plots debugging plan
1 month ago
Sven Geboers
9f98dbae60
Add debug st.info before st.plotly_chart to diagnose invisible chart
1 month ago
Sven Geboers
525cd157c0
docs: add diagnose-no-plot-trajectories design (2026-03-30)
1 month ago
Sven Geboers
ce1fc86bcb
docs(design): add fix-missing-trajectories design
1 month ago
Sven Geboers
ff4ce0f9b2
Add design spec for bootstrap CIs and data enrichment
1 month ago
Sven Geboers
c5b39ced5f
Add design doc for compass UI improvements (axes 3-5, Y-axis arrows, discipline section)
1 month ago
Sven Geboers
c0d1c59bd7
chore(deploy): rewrite ansible for motief on motief.sgeboers.nl, remove drone
...
- Replace gtfs/bokeh deploy with motief/streamlit (port 8501)
- Update inventory to motief.sgeboers.nl
- Remove stale .drone.yml
- Add CI guard to forbid .env in repo
- Add env removal report and secrets rotation checklist
1 month ago
Sven Geboers
445f0bfb24
feat(ansible-example): add @ansible/example package, tests, CI, publish & deploy workflows, docs and changelog
1 month ago
Sven Geboers
b5c14d0c65
deploy to server
1 month ago
Sven Geboers
ed289ff582
chore(mindmodel): add sanitized read-only manifest and reviewer README
1 month ago
Sven Geboers
2efd7ba3a0
feat(mindmodel): add manifest loader and tests
1 month ago
Sven Geboers
eb73275f32
feat(mp-quiz): add MP quiz tab and DB helpers; add design and plan docs
1 month ago
Sven Geboers
b09e580f65
feat: motion content enrichment pipeline hardening
...
- ai_provider_wrapper: retry/fallback with exponential backoff, None sentinel for failed items
- text_pipeline: use wrapper, return 5-tuple (stored, skipped_existing, skipped_no_text, errors, failed_ids)
- similarity/compute: filter trivial 1.0 matches on identical short titles (<12 chars)
- rerun_embeddings: --retry-missing mode, calls ensure_text_embeddings_for_ids on failed ids
- sync_motion_content: per-ext_id retries, HTTPAdapter pool, --max-body-workers CLI flag, audit on failure
- qa_similarity script: samples motions, writes JSON ledger to thoughts/ledgers/
- All tests green: 61 passed, 2 skipped
1 month ago
Sven Geboers
ebb663aa8f
docs: add test refactor implementation plan
1 month ago
Sven Geboers
07a89a207c
docs: add test refactor design - replace monkeypatching with DI + in-memory DuckDB
1 month ago
Sven Geboers
ce27dc6ac5
chore(ledgers): record fusion+similarity run summary and JSON details
1 month ago
Sven Geboers
2891e9ee70
feat: add StemAtlas Streamlit app, explorer, Docker deployment, blog charts
1 month ago
Sven Geboers
a248807e03
Add design: embedding-based motion similarity cache
...
Precomputed top-K similarity cache replacing the naive Python-scan
search_similar(). Also covers fixes for: embeddings table missing from
_init_database, fusion N+1 query, and ai_provider 429 retry.
1 month ago
Sven Geboers
a36e6cba4e
feat(pipeline): implement parliamentary embedding pipeline MVP
...
- Add 4 migration files: mp_votes, mp_metadata, svd_vectors, fused_embeddings
- Extend database.py with 5 new helper methods and table init
- Add pipeline/ package: extract_mp_votes, fetch_mp_metadata, text_pipeline,
svd_pipeline (with Procrustes alignment), fusion
- Add full test suite (17 tests) covering all pipeline modules and migrations
- Fix Procrustes alignment bug: scipy scale is a norm value, not a multiplier
- Fix DuckDB date type handling in test assertions (datetime.date vs string)
- Remove duckdb.py shim; tests now run against real duckdb + scipy via uv
Ref: thoughts/shared/plans/2026-03-21-parliamentary-embedding-pipeline-plan.md
1 month ago
Sven Geboers
c498c3467e
update plan: replace spike with confirmed FractieZetelPersoon fetch task
1 month ago
Sven Geboers
0bbda408fb
plan: parliamentary embedding pipeline MVP implementation plan
1 month ago
Sven Geboers
fd73da3752
design: parliamentary embedding pipeline (late fusion SVD + text)
1 month ago
Sven Geboers