sgeboers 6e36fa2604 feat: persist and load explained variance for scree plots ...

- compute_svd_for_window now computes explained variance ratio (s²/sum(s²))
  and appends it as a metadata row (entity_type='metadata',
  entity_id='explained_variance') to motion_rows
- load_scree_data reads this metadata row from svd_vectors instead of
  querying the non-existent sv_metadata column
- run_svd_for_window counts only entity_type='motion' rows in stored_motion
  so metadata rows don't inflate the count
- Added 5 TDD tests covering load, compute, store, and round-trip

All 227 tests pass.

2026-05-01 10:34:31 +02:00

..

benchmark

feat: add benchmark suite for pipeline operations

2026-05-01 00:05:08 +02:00

ci

ci(mindmodel): add scheduled validation workflow

2026-03-24 22:41:43 +01:00

config

chore(format): add pre-commit and formatter configs

2026-03-24 22:41:40 +01:00

fixtures

feat(pipeline): implement parliamentary embedding pipeline MVP

2026-03-21 22:31:22 +01:00

integration

fix: update integration test to unpack 5-tuple from ensure_text_embeddings

2026-03-23 20:30:35 +01:00

migrations

feat(pipeline): implement parliamentary embedding pipeline MVP

2026-03-21 22:31:22 +01:00

scripts

feat: add pipeline health checks module and CLI runner

2026-05-01 00:02:45 +02:00

types

feat(pipeline): implement parliamentary embedding pipeline MVP

2026-03-21 22:31:22 +01:00

utils

feat(pipeline): implement parliamentary embedding pipeline MVP

2026-03-21 22:31:22 +01:00

validators

feat(mindmodel): add CLI wrapper, edge-case tests, and manifest schema tests

2026-03-24 22:41:28 +01:00

__init__.py

feat(pipeline): implement parliamentary embedding pipeline MVP

2026-03-21 22:31:22 +01:00

conftest.py

Refactor tests: replace sys.modules hacks with real DI + in-memory DB

2026-03-23 21:21:10 +01:00

test_ai_provider_retry.py

feat(similarity): add precomputed similarity cache, fix fusion N+1, add 429 retry

2026-03-22 03:02:25 +01:00

test_ai_provider_wrapper.py

Refactor tests: replace sys.modules hacks with real DI + in-memory DB

2026-03-23 21:21:10 +01:00

test_ai_provider.py

feat(pipeline): implement parliamentary embedding pipeline MVP

2026-03-21 22:31:22 +01:00

test_analysis.py

feat(pipeline): add orchestrator CLI, analysis modules, and ActorFractie ingestion

2026-03-21 22:40:28 +01:00

test_api_client.py

refactor: migrate api_client.py prints to structured logging

2026-04-30 23:49:23 +02:00

test_axis_label_fallback.py

feat(svd): update 8 of 10 axis labels derived from motion content

2026-04-13 23:59:50 +02:00

test_axis_political_orientation.py

feat: add right-wing party axis validation

2026-04-05 00:42:46 +02:00

test_compute_party_centroids.py

Add debug st.info before st.plotly_chart to diagnose invisible chart

2026-03-31 01:49:38 +02:00

test_config.py

test: add SVD axis alignment and label consistency tests

2026-04-12 21:02:47 +02:00

test_database_audit.py

test: rewrite test_database_audit using mem_db fixture, no disk writes required

2026-03-23 21:01:09 +01:00

test_database_exceptions.py

refactor: tighten exception handling in database.py and add BLE lint rule

2026-04-30 23:59:02 +02:00

test_debug_flag.py

chore(explorer): add get_debug_trajectories_enabled helper

2026-03-31 00:22:26 +02:00

test_download_script.py

Add --skip-details, --update-existing flags to download_past_year.py with tests

2026-03-29 23:25:04 +02:00

test_explorer_decomposition.py

refactor: decompose explorer.py into analysis/tabs/ and add scheduler

2026-05-01 01:05:55 +02:00

test_explorer_helpers_diagnostics.py

feat(explorer): extend diagnostic inspector to surface mp samples/counts

2026-03-31 00:28:14 +02:00

test_explorer_helpers.py

Add debug st.info before st.plotly_chart to diagnose invisible chart

2026-03-31 01:49:38 +02:00

test_explorer_import.py

feat: add StemAtlas Streamlit app, explorer, Docker deployment, blog charts

2026-03-22 22:38:17 +01:00

test_explorer_labels.py

fix: SVD tab now uses raw SVD values for ALL components 1-10

2026-04-13 21:51:21 +02:00

test_explorer_quiz.py

test: add full quiz tab test suite and fix Geen stem normalization

2026-03-24 20:18:20 +01:00

test_extract_mp_votes.py

fix(tests): update test_extract_mp_votes for party-level actor inclusion

2026-03-21 23:25:27 +01:00

test_fetch_mp_metadata.py

feat(analysis): fetch real MP metadata, fix anchor axis for party-level actors

2026-03-21 23:33:47 +01:00

test_fusion.py

feat(similarity): add precomputed similarity cache, fix fusion N+1, add 429 retry

2026-03-22 03:02:25 +01:00

test_health_checks.py

feat: add pipeline health checks module and CLI runner

2026-05-01 00:02:45 +02:00

test_health_core.py

feat: add pipeline health checks module and CLI runner

2026-05-01 00:02:45 +02:00

test_home_import.py

feat: add StemAtlas Streamlit app, explorer, Docker deployment, blog charts

2026-03-22 22:38:17 +01:00

test_inspect_positions_for_issues.py

Add debug st.info before st.plotly_chart to diagnose invisible chart

2026-03-31 01:49:38 +02:00

test_logging_config.py

test(logging): fix null formatter pyright error in setup test

2026-05-01 00:07:56 +02:00

test_match_mps.py

test: add full quiz tab test suite and fix Geen stem normalization

2026-03-24 20:18:20 +01:00

test_migration_embeddings.py

feat(pipeline): implement parliamentary embedding pipeline MVP

2026-03-21 22:31:22 +01:00

test_migration_pipeline_tables.py

feat(pipeline): implement parliamentary embedding pipeline MVP

2026-03-21 22:31:22 +01:00

test_political_axis.py

Add compute_party_bootstrap_cis() to political_axis.py with tests

2026-03-29 23:13:30 +02:00

test_political_compass.py

test: update tests for unified SVD label system (Task 7)

2026-04-02 21:08:50 +02:00

test_pyproject_deps.py

feat(pipeline): implement parliamentary embedding pipeline MVP

2026-03-21 22:31:22 +01:00

test_qa_similarity.py

feat: motion content enrichment pipeline hardening

2026-03-23 21:31:39 +01:00

test_rerun_embeddings_retry.py

Refactor tests: replace sys.modules hacks with real DI + in-memory DB

2026-03-23 21:21:10 +01:00

test_rerun_embeddings.py

feat: motion content enrichment pipeline hardening

2026-03-23 21:31:39 +01:00

test_run_pipeline.py

test: update tests for unified SVD label system (Task 7)

2026-04-02 21:08:50 +02:00

test_scheduler.py

refactor: decompose explorer.py into analysis/tabs/ and add scheduler

2026-05-01 01:05:55 +02:00

test_scree_data.py

feat: persist and load explained variance for scree plots

2026-05-01 10:34:31 +02:00

test_similarity_compute_filter.py

Refactor tests: replace sys.modules hacks with real DI + in-memory DB

2026-03-23 21:21:10 +01:00

test_similarity_compute.py

feat(similarity): add precomputed similarity cache, fix fusion N+1, add 429 retry

2026-03-22 03:02:25 +01:00

test_similarity_db_helpers.py

feat(similarity): add precomputed similarity cache, fix fusion N+1, add 429 retry

2026-03-22 03:02:25 +01:00

test_svd_axis_alignment.py

fix: SVD tab now uses raw SVD values for ALL components 1-10

2026-04-13 21:51:21 +02:00

test_svd_comp1_matches_compass.py

docs: add improvement roadmap, research notes, and solution docs

2026-04-30 23:55:24 +02:00

test_svd_labels.py

feat(svd): update 8 of 10 axis labels derived from motion content

2026-04-13 23:59:50 +02:00

test_svd_pipeline.py

feat(pipeline): implement parliamentary embedding pipeline MVP

2026-03-21 22:31:22 +01:00

test_sync_motion_content.py

feat: motion content enrichment pipeline hardening

2026-03-23 21:31:39 +01:00

test_syncfeed_parsers.py

feat(mp-quiz): add MP quiz tab and DB helpers; add design and plan docs

2026-03-24 19:59:25 +01:00

test_text_pipeline_retry.py

feat: motion content enrichment pipeline hardening

2026-03-23 21:31:39 +01:00

test_text_pipeline.py

feat: motion content enrichment pipeline hardening

2026-03-23 21:31:39 +01:00

test_ui_no_raw_as_labels.py

Add debug st.info before st.plotly_chart to diagnose invisible chart

2026-03-31 01:49:38 +02:00

test_validate_svd_themes.py

test: add SVD axis alignment and label consistency tests

2026-04-12 21:02:47 +02:00