7 Commits (b5c14d0c65603fb7fa1227cf34f960ea699ed647)

Author	SHA1	Message	Date
Sven Geboers	b5c14d0c65	deploy to server	1 month ago
Sven Geboers	daa22c5e2b	feat: complete parliamentary embedding pipeline with full historical coverage ... - Add fused (SVD + text) embedding pipeline for annual windows 2016-2026 - Fix store_fused_embedding duplicate bug: DELETE before INSERT (idempotent) - Add --text-batch-size CLI flag to run_pipeline.py (default 200) - Add explicit --start-date/--end-date to download_past_year.py - Backfill mp_votes for all motions (party-level votes, 111k new rows) - Add similarity cache recompute: 212k rows across 9 annual windows - Improve ai_provider retry logic, text_pipeline batching - Improve analysis/political_axis PCA handling and visualizations - Add diagnostic/utility scripts: compare_svd, generate_compass, inspect_axis, etc. - Untrack data/motions.db (3.6GB binary), add to .gitignore with outputs/ - Update continuity ledger with full session state	1 month ago
Sven Geboers	bf68e48460	fix(analysis): improve PCA handling when PC1 dominates, add pca_residual option and plot autoscaling/variance annotation	1 month ago
Sven Geboers	23a1234314	feat(analysis): add 2D political compass (PCA/anchor) and 2D trajectories + visualizations ... - compute_2d_axes (pca, anchor) with optional L2-normalisation pre-projection - compute_2d_trajectories: per-MP coords, step vectors, magnitudes, totals - plot_political_compass and plot_2d_trajectories (Plotly HTML) - tests/test_political_compass.py (synthetic unit test)	1 month ago
Sven Geboers	3551a82f83	feat(analysis): add 2D political compass and 2D trajectories ... - compute_2d_axes (PCA + anchor) - compute_2d_trajectories - plot_political_compass, plot_2d_trajectories - unit test: tests/test_political_compass.py	1 month ago
Sven Geboers	aa2f66ac9f	feat(analysis): fetch real MP metadata, fix anchor axis for party-level actors ... - fetch_mp_metadata: use real OData URL with pagination (1200 records, 5 pages) uses Fractie.Afkorting not NaamNL for abbreviation matching skips Verwijderd=true records - upsert_mp_metadata: keep most recent membership (prefer active over ended, then higher Van date) so current party affiliations are not overwritten by historical - compute_anchor_axis: anchor directly on party-level SVD entities (GroenLinks-PvdA etc) before falling back to mp_metadata individual MP lookup - test_fetch_mp_metadata: fix mock for timeout kwarg + pagination + Afkorting field - Generated anchor axis HTML for 2025-Q2 through 2026-Q1 in outputs/	1 month ago
Sven Geboers	f2a831dfcf	feat(pipeline): add orchestrator CLI, analysis modules, and ActorFractie ingestion ... - pipeline/run_pipeline.py: CLI orchestrator for all 5 pipeline phases with --dry-run, --skip-*, --window-size, --svd-k, --start/end-date flags - analysis/{political_axis,trajectory,clustering,visualize}.py: PCA/anchor ideological axis, MP drift trajectories, UMAP + KMeans clustering, Plotly HTML output - api_client.py: capture ActorFractie per individual MP vote (comma in ActorNaam) into mp_vote_parties dict on each motion - database.insert_motion: auto-insert mp_votes rows with party affiliation for newly ingested motions when mp_vote_parties is present - Add scikit-learn to pyproject.toml for KMeans clustering - tests/test_run_pipeline.py: window generation, dry-run, skip-all paths - tests/test_analysis.py: PCA axis, anchor axis, trajectory drift, KMeans Ref: thoughts/shared/plans/2026-03-21-parliamentary-embedding-pipeline-plan.md	1 month ago