Skip to content
Closed
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
231 commits
Select commit Hold shift + click to select a range
9e0fb69
Fix/experiment studio empty datasets and cv metrics (#2)
KFilippopolitis Mar 3, 2026
67f69e3
Bump jspdf in the npm_and_yarn group across 1 directory (#1)
dependabot[bot] Mar 5, 2026
b9beeef
feat: migrate UI toward zoneless and signals-first architecture (#3)
KFilippopolitis Mar 5, 2026
d9d6244
ebrains ci jobs (#5)
KFilippopolitis Mar 6, 2026
06c72cf
fix(terms): resolve markdown rendering and Proceed button race condit…
KFilippopolitis Mar 10, 2026
73484ee
fix(docker): generate env.js at runtime with escaping (#7)
KFilippopolitis Mar 17, 2026
7439b29
Dev/guide (#8)
KFilippopolitis Apr 21, 2026
da06ae7
docs(experiments-dashboard): refine onboarding copy and remove redund…
KFilippopolitis Apr 21, 2026
d287d1e
feat: update footer with interactive funding acknowledgements and upd…
KFilippopolitis Apr 24, 2026
10c130d
feat: implement data preprocessing pipeline in Experiment Studio
KFilippopolitis May 4, 2026
6736886
refactor: overhaul descriptive statistics pipeline by renaming payloa…
KFilippopolitis May 9, 2026
9ab6921
feat: enhance algorithm configuration schema to support dynamic enum …
KFilippopolitis May 9, 2026
66dc18d
refactor: remove dark mode support and hardcode light theme globally
KFilippopolitis May 9, 2026
dbbaac1
feat: implement custom recursive filter builder and migrate to data r…
KFilippopolitis May 9, 2026
83920ee
feat: enhance algorithm configuration schema and visualisations
KFilippopolitis May 9, 2026
59c683a
fix: correct data-model selector identity check and dataset selector …
KFilippopolitis May 9, 2026
1253a8a
feat: enhance experiment detail with preprocessing summaries and robu…
KFilippopolitis May 9, 2026
da10f25
style: homogenize Experiment Studio UI with unified headers and skele…
KFilippopolitis May 9, 2026
ae84666
Improve experiment studio navigation and config UX
KFilippopolitis May 12, 2026
1e3b3b5
Polish experiment filter layout
KFilippopolitis May 12, 2026
927e465
chore: remove unused platform-ui code
KFilippopolitis May 12, 2026
9f47121
fix: align experiment studio summaries and anchors
KFilippopolitis May 12, 2026
d6273ff
feat: add metadata browser visualizations
KFilippopolitis May 13, 2026
3007374
feat: add metadata info panel component
KFilippopolitis May 13, 2026
da36200
refactor: adopt colorblind palette as default and remove color settings
KFilippopolitis May 13, 2026
c263f19
refactor: integrate metadata browsers and info tab into variables panel
KFilippopolitis May 13, 2026
f212a5e
fix: rename summary export buttons to PDF for consistency
KFilippopolitis May 13, 2026
914a832
style: adjust histogram graph overflow and padding
KFilippopolitis May 13, 2026
23f9b3f
fix(experiment-studio): improve layout padding and scroll-to-section …
KFilippopolitis May 13, 2026
16c69e2
refactor(variables-panel): remove bin selector logic and related func…
KFilippopolitis May 13, 2026
38baf4a
refactor(algorithm-rules): remove algorithm requirement overrides and…
KFilippopolitis May 14, 2026
6372233
style(algorithm-panel): update badge styles for variable and covariat…
KFilippopolitis May 14, 2026
9ca23ea
feat(outlier-report): implement outlier report generation and handling
KFilippopolitis May 14, 2026
cf4b180
feat: add algorithm documentation support and update outlier report p…
KFilippopolitis May 15, 2026
a9ba250
refactor: update algorithm input validation to use min/max count cons…
KFilippopolitis May 15, 2026
f65b35c
feat: improve algorithm documentation readability and introduce read-…
KFilippopolitis May 15, 2026
95021ef
refactor: enhance algorithm validation logic and update experiment st…
KFilippopolitis May 15, 2026
7b091a0
feat: implement formatting for algorithm availability constraint mess…
KFilippopolitis May 15, 2026
45d6406
refactor: migrate all component state management to Angular signals a…
KFilippopolitis May 19, 2026
f3ae3eb
build/ci: upgrade Angular dependencies and switch Dockerfile to alpin…
KFilippopolitis May 21, 2026
ed85e43
feat: add support for linear SVM and refactor outlier report input pa…
KFilippopolitis May 21, 2026
0129254
fix(metadata-browser): support path-based node resolution to avoid du…
KFilippopolitis May 21, 2026
84ff200
refactor(search-bar): rewrite search to use normalized metadata index…
KFilippopolitis May 21, 2026
0a50fe7
feat(metadata-info-panel): improve enumeration label resolution and h…
KFilippopolitis May 21, 2026
fff2d70
feat(statistic-analysis-panel): replace preview impact with interacti…
KFilippopolitis May 21, 2026
b658887
fix(histogram): calculate dynamic height dynamically based on labels …
KFilippopolitis May 21, 2026
31c95ee
style: refine CSS styles and layout for studio components and details…
KFilippopolitis May 21, 2026
bc36de5
docs: add repository context system
KFilippopolitis May 22, 2026
cc2188f
docs: add token budget guardrails
KFilippopolitis May 22, 2026
73fe52e
feat(experiment-studio): add contextual navigation helpers
KFilippopolitis May 22, 2026
f43ad4e
refactor(statistics): streamline preprocessing workflow
KFilippopolitis May 22, 2026
d65a1c5
style(variables): refine metadata toolbar layout
KFilippopolitis May 22, 2026
08cc8cc
feat(algorithm-panel): add preprocessing steps to experiment summary
KFilippopolitis May 22, 2026
84a3324
style(experiment-studio): add content max width token
KFilippopolitis May 22, 2026
eba95d2
style(auto-renderer): polish result table cards for MIP palette
KFilippopolitis May 22, 2026
2771388
style(algorithm-result): tighten padding in result workspace
KFilippopolitis May 22, 2026
13bd62c
feat(algorithm-panel): add docked summary workspace and polish result…
KFilippopolitis May 22, 2026
66744dc
fix(deps): remediate dev transitive SCA findings with npm overrides
KFilippopolitis May 26, 2026
473c85a
feat(histogram): use histogram_sql and improve chart readability
KFilippopolitis May 28, 2026
a519c93
fix(histogram): preserve nominal bins and improve tooltip clarity
KFilippopolitis May 28, 2026
9de1861
fix(collapsible-tree): sync one-click toggle and centering behavior
KFilippopolitis May 28, 2026
6e436ce
fix(algorithm): align input count labels with Exaflow fallbacks
KFilippopolitis May 30, 2026
fe9bd26
fix(stats): improve preprocessing workflow and raw histograms
KFilippopolitis May 30, 2026
a6ff81f
style(variables-panel): remove identity icon from details header
KFilippopolitis May 30, 2026
bf29348
style(algorithm-panel): remove config field metadata hints
KFilippopolitis May 30, 2026
6b5dfec
refactor(variables-panel): move filter modal to shared and rename bro…
KFilippopolitis Jun 2, 2026
9ce76c1
fix(algorithm-panel): match filters summary with dashboard preview
KFilippopolitis Jun 2, 2026
c88b5c5
fix(stats): scope histogram preprocessing and show dataset labels
KFilippopolitis Jun 3, 2026
8b1e6be
feat(lmm): show Exaflow p-value display and full-width fixed effects …
KFilippopolitis Jun 3, 2026
b5b296f
chore(deps): patch dependencies and fix tmp/zrender audit issues
KFilippopolitis Jun 3, 2026
409d778
feat(experiment-studio): Cox regression UI and clinician-focused results
KFilippopolitis Jun 4, 2026
f6ffed1
feat(experiment-studio): polish guide flow, parameters panels, and al…
KFilippopolitis Jun 5, 2026
f5f5769
docs: add agent context wiki
KFilippopolitis Jun 9, 2026
30bde3f
fix(algorithms): group LMM and GLMM under Mixed Models in the picker.
KFilippopolitis Jun 9, 2026
045f5df
fix(cox): require positive_class for Cox regression configuration.
KFilippopolitis Jun 9, 2026
c5f404a
feat(experiments): support analysis specification API
KFilippopolitis Jun 30, 2026
00f9c1d
feat(notebook): manage Hub session startup
KFilippopolitis Jun 30, 2026
e72f564
deploy(notebook): route JupyterHub through nginx
KFilippopolitis Jun 30, 2026
b647291
feat(notebook): add header entry point
KFilippopolitis Jun 30, 2026
f8cdc61
docs: document notebook auth flow
KFilippopolitis Jun 30, 2026
a458293
chore: ignore codegraph cache
KFilippopolitis Jun 30, 2026
90b218f
chore: resolve npm audit findings
KFilippopolitis Jun 30, 2026
d7da630
add: create files
moghit-eou Jul 3, 2026
6b7461f
Introduce updated CI workflow setup
moghit-eou Jul 3, 2026
fb83788
Introduce updated CI workflow setup
moghit-eou Jul 3, 2026
55d2445
refactor: simplify SARIF gate evaluation, drop unused package parsing
moghit-eou Jul 3, 2026
513fc77
refactor: simplify SARIF gate evaluation, drop unused package parsing
moghit-eou Jul 3, 2026
e8a4036
refactor: simplify SARIF gate evaluation, drop unused package parsing
moghit-eou Jul 3, 2026
e8b425d
feat(sca): introduce container image scanning
moghit-eou Jul 5, 2026
f152e59
Add npm install and npm ci to dependency step
moghit-eou Jul 7, 2026
ac21122
Stop tracking .gitignore
moghit-eou Jul 8, 2026
5bedf15
Improve Log output for better visibility
moghit-eou Jul 8, 2026
16aa6f8
add explicit categories to prevent from overwriting each other
moghit-eou Jul 8, 2026
1e4173c
ci: Apply copilote review suggestion
moghit-eou Jul 8, 2026
d594cc6
ci: fix npm ci lockfile mismatch
moghit-eou Jul 8, 2026
55b0f8c
fix(scripts): add -S to curl flags in setup-tools.sh
moghit-eou Jul 8, 2026
40c2193
feat(ci): pin and verify SHA256 of downloaded scanner binaries
jdaln Jul 10, 2026
a9b05df
build(ci): automate github action updates with dependabot so it ddoes…
jdaln Jul 10, 2026
2307859
build(ci): cyclone dx auto update
jdaln Jul 10, 2026
4774ac3
docs: Add pipeline documentation
moghit-eou Jul 10, 2026
5da10f5
Merge pull request #20 from moghit-eou/ci/sca-pipeline
jdaln Jul 10, 2026
0182955
build(deps): bump the github-actions group with 7 updates
dependabot[bot] Jul 10, 2026
7eecc60
ci(sca): add weekly scheduled scan and manual trigger
moghit-eou Jul 15, 2026
e16d5c7
feat(algorithms): add quartiles and binned Mann-Whitney support
KFilippopolitis Jul 17, 2026
35e82ba
chore(deps): upgrade to Angular 22 and latest compatible libraries
KFilippopolitis Jul 17, 2026
fde0261
chore(deps): upgrade echarts 6 with compatible echarts-gl loading
KFilippopolitis Jul 17, 2026
7f8579a
Merge pull request #23 from moghit-eou/ci/sca-pipeline
jdaln Jul 20, 2026
1110c0c
feat(sec-pipeline): implement unified container scanning architecture
moghit-eou Jul 25, 2026
f40485f
feat(sec-pipeline): implement unified container scanning architecture
moghit-eou Jul 25, 2026
292ea8e
feat(sec-pipeline): implement unified container scanning architecture
moghit-eou Jul 25, 2026
3e69ebb
ci: add app-layer SAST scanning with Semgrep community ruleset
moghit-eou Jul 27, 2026
fb1db63
fix(deps): patch npm audit vulnerabilities
moghit-eou Jul 27, 2026
eac4907
Merge pull request #1 from moghit-eou/ci/sca-pipeline-improve
moghit-eou Jul 27, 2026
f6bdd87
chore(deps): resolve merge conflict
moghit-eou Jul 27, 2026
a078907
fix: patch known npm CVEs via package.json overrides
moghit-eou Jul 28, 2026
e0a9c34
fix: patch known npm CVEs via package.json overrides
moghit-eou Jul 28, 2026
ae83442
Merge branch 'master' into ci/sca-pipeline
moghit-eou Jul 28, 2026
6ea1009
chore: align CI scripts and workflows for consistency
moghit-eou Jul 29, 2026
0448a34
Merge pull request #2 from moghit-eou/ci/sca-sast-pipeline-improve
moghit-eou Jul 29, 2026
8633405
refactor: remove comment
moghit-eou Jul 31, 2026
bd2be74
Merge pull request #22 from Medical-Informatics-Platform/dependabot/g…
jdaln Jul 31, 2026
6e4d0f4
Apply suggested fixes from Copilot's automated review across
moghit-eou Jul 31, 2026
254c359
Add MIT LICENSE
KFilippopolitis Aug 1, 2026
2f7fb0a
chore(deps): patch transitive dev deps for GitHub security alerts
KFilippopolitis Aug 1, 2026
a842f44
Resolve merge conflicts and merge branch
moghit-eou Aug 2, 2026
6161e70
Resolve merge conflicts and merge branch
moghit-eou Aug 2, 2026
38a6094
Expand SAST rule coverage
moghit-eou Aug 3, 2026
fc7d42a
fix(deps): enforce 7-day cooldown on Renovate and Dependabot updates
moghit-eou Aug 3, 2026
7cc41a1
chore: trigger CI rerun
moghit-eou Aug 3, 2026
dbb343c
Merge pull request #27 from moghit-eou/ci/sca-pipeline
jdaln Aug 3, 2026
89652e8
docs: restructure README for container scan, SCA, and SAST pipelines …
moghit-eou Aug 6, 2026
96fde41
chore: setup pre-commit, CI secret scanning, and initial lint fixes …
moghit-eou Sep 10, 2026
33ee3af
fix(ci): encrypt SARIF artifacts (#38)
moghit-eou Sep 15, 2026
80f30d5
chore(deps): upgrade Angular to 22.1 and Node toolchain
KFilippopolitis Sep 15, 2026
58c1b99
feat(studio): rebuild experiment domain models and services
KFilippopolitis Sep 15, 2026
47d303f
feat(studio): rebuild Data Exploration panels
KFilippopolitis Sep 15, 2026
5ef2a8c
feat(studio): rebuild Data Handling pipeline
KFilippopolitis Sep 15, 2026
5843bd0
feat(studio): rebuild Algorithm panel and role assignment
KFilippopolitis Sep 15, 2026
e8d7d89
feat(studio): add Experiment Execution and result rendering
KFilippopolitis Sep 15, 2026
6cca0ef
feat(studio): wire stepper, shell and guided tour
KFilippopolitis Sep 15, 2026
a0da6b3
feat(dashboard): add folders and rebuild list, search, compare and de…
KFilippopolitis Sep 15, 2026
09f7c06
feat(shell): update app shell, header and shared chrome
KFilippopolitis Sep 15, 2026
904db46
docs: update context system, agent guidance and design docs
KFilippopolitis Sep 15, 2026
ac70a48
chore(ci): add static dead-code verification
KFilippopolitis Sep 15, 2026
7251fe5
fix(security): address GitHub Advanced Security code-scanning alerts
KFilippopolitis Sep 15, 2026
4964edf
feat(guide): hand off to dashboard tour and harden target spotlight
KFilippopolitis Sep 27, 2026
35512d1
fix(studio): scroll long predictor stacks inside the role-assignment …
KFilippopolitis Sep 27, 2026
11e952e
build(deps): apply the open dependabot and renovate bumps
KFilippopolitis Sep 27, 2026
0302a54
refactor: dedupe escapeHtml and cut duplicated guide specs
KFilippopolitis Sep 27, 2026
7a714d2
feat(studio): render the new K-Means result and reuse a run as a clus…
KFilippopolitis Sep 27, 2026
39a2a08
refactor(core): share pluralize, formula line and operator phrases
KFilippopolitis Sep 28, 2026
7eb6667
feat(studio): run the K-means report from the cluster-source picker
KFilippopolitis Sep 28, 2026
ebb5db1
feat(studio): rework the data review and preprocessing step
KFilippopolitis Sep 28, 2026
b6335d0
feat(studio): rework the algorithm and result steps
KFilippopolitis Sep 28, 2026
28ee96b
feat(dashboard): rework the experiment list, detail and compare views
KFilippopolitis Sep 28, 2026
a9fba53
style(studio): restore the algorithm panel review styles
KFilippopolitis Sep 28, 2026
2426f16
docs(design): add chart palette, contrast rules and component recipes
KFilippopolitis Sep 29, 2026
ab38469
feat: group the experiment list by day and expose K-means report sett…
KFilippopolitis Sep 29, 2026
4a4af50
feat(studio): apply preprocessing per card in the data review pipeline
KFilippopolitis Sep 29, 2026
2eab17b
refactor: drop unused status-dot chrome and duplicate K-means helpers
KFilippopolitis Sep 29, 2026
54806ab
feat(studio): use the single applied preprocessing config and live cr…
KFilippopolitis Oct 2, 2026
7752c59
feat(dashboard): foldable run setup, default parameters and nested ob…
KFilippopolitis Oct 2, 2026
42c9562
feat(studio): chart category counts per card on Done
KFilippopolitis Oct 2, 2026
f87e700
feat(studio): zoom and ring the tutorial target in the bubble chart
KFilippopolitis Oct 2, 2026
abf90f8
fix(studio): keep step numbers on completed stepper nodes
KFilippopolitis Oct 2, 2026
b689424
fix(studio): keep the drop missing-values default next to created col…
KFilippopolitis Oct 2, 2026
87fbefa
fix(studio): open a fresh studio when a saved experiment's pathology …
KFilippopolitis Oct 2, 2026
e296149
feat(studio): call derived columns nominal and add them above K-means
KFilippopolitis Oct 2, 2026
e5a63de
feat(studio): set cross-validation folds under the cross-validation s…
KFilippopolitis Oct 2, 2026
6d42569
feat(export): one PDF report layout and a CSV ZIP result export
KFilippopolitis Oct 2, 2026
eb59eb0
fix(results): follow Exaflow's linear_regression_cv RMSE rename and n…
KFilippopolitis Oct 2, 2026
3f3156c
fix(deps): override webpack-dev-middleware to 8.3.0
KFilippopolitis Oct 2, 2026
1619035
fix(studio): show enumeration labels in nominal column rules
KFilippopolitis Oct 2, 2026
9b94361
fix(studio): list parameter values instead of "Default parameters"
KFilippopolitis Oct 2, 2026
a1d9493
feat(studio): show the variables a K-means cluster column was built from
KFilippopolitis Oct 2, 2026
ca7f930
feat: add push trigger for vulnerability scanning workflows
jdaln Sep 29, 2026
57713c1
fix(sca): bump Angular to 22.2.1 and ignore unpatched braces
KFilippopolitis Oct 4, 2026
41d9e03
test(studio): run experiment studio Playwright flows in CI (#45)
KFilippopolitis Oct 14, 2026
415ef1b
fix(studio): send dataset as a source variable when it is used
KFilippopolitis Oct 14, 2026
d266fe9
feat(studio): toggle pipeline steps from their header
KFilippopolitis Oct 14, 2026
67fb83f
feat(studio): save the reviewed run instead of running it again
KFilippopolitis Oct 14, 2026
be97637
fix(dashboard): hide the cohort Filters fold when no filters were app…
KFilippopolitis Oct 15, 2026
c3e3767
chore(deps): bump Angular to 22.2.3 and Playwright to 1.64.1
KFilippopolitis Oct 15, 2026
0790790
refactor(experiments): use the consolidated experiment API
KFilippopolitis Oct 15, 2026
da5a7b4
feat(histogram): draw stacked bars per group with a residual segment
KFilippopolitis Oct 19, 2026
1b61eb4
feat(api): send histogram grouping as algorithm.x
KFilippopolitis Oct 19, 2026
edddf80
feat(export): add per-group columns to the histogram CSV
KFilippopolitis Oct 19, 2026
98912ba
feat(variables-panel): split the variable histogram by a category
KFilippopolitis Oct 19, 2026
5c90eb8
feat(data-handling): split summary histograms by a category
KFilippopolitis Oct 19, 2026
60469ea
feat(charts): redraw the describe box plot with median, mean ± SD and…
KFilippopolitis Oct 19, 2026
e8a83c0
style(data-handling): restyle the statistics table, info notes and ex…
KFilippopolitis Oct 19, 2026
f2c404e
fix(data-handling): describe Raw data as a read-only preview
KFilippopolitis Oct 19, 2026
526672e
Account page: use MIP from your own computer (#51)
KFilippopolitis Oct 19, 2026
cc962ae
feat(studio): gray out variables unavailable in the selected datasets…
KFilippopolitis Oct 23, 2026
d555d82
chore(deps): upgrade dependencies and CI to latest (#54)
KFilippopolitis Oct 23, 2026
1bd6fc2
chore(deps): update dependency python to v3.15.0 (#48)
renovate[bot] Oct 23, 2026
7f6913e
chore(deps): update dependency opengrep/opengrep to v1.31.0 (#47)
renovate[bot] Oct 23, 2026
92813e6
fix(results): stop swapping Cox follow-up time and event indicator
KFilippopolitis Oct 23, 2026
5792cf1
refactor(results): add shared number formatting for result views
KFilippopolitis Oct 23, 2026
f8133de
feat(charts): one series palette and house style for every chart
KFilippopolitis Oct 23, 2026
83f2c56
fix(charts): escape labels in chart tooltips
KFilippopolitis Oct 23, 2026
34a2112
feat(charts): redraw the heatmaps and k-means centres for compare col…
KFilippopolitis Oct 23, 2026
baea2af
feat(charts): t-test interval, ANOVA ±1 SD whiskers, naive Bayes prof…
KFilippopolitis Oct 23, 2026
a78fb7c
feat(results): label k-means, outlier, SMD and mixed-model results
KFilippopolitis Oct 23, 2026
47c571a
feat(results): readable result tables
KFilippopolitis Oct 23, 2026
0ce922b
feat(results): leave out tables the figures or charts above already show
KFilippopolitis Oct 23, 2026
7000546
feat(results): headline figures for hypothesis tests and cross-valida…
KFilippopolitis Oct 23, 2026
7b46057
feat(results): coefficient view for regression, mixed and Cox models
KFilippopolitis Oct 23, 2026
bb7fb69
feat(results): lead each result with its coefficient view, figures or…
KFilippopolitis Oct 23, 2026
04b4a84
refactor(charts): remove the renderers the result views replaced
KFilippopolitis Oct 23, 2026
2a3c262
docs: chart house style and the result view layout
KFilippopolitis Oct 23, 2026
6ef3fee
fix(results): address review findings on result views
KFilippopolitis Oct 23, 2026
6e4a70e
feat(account): sign in as the platform's public Keycloak client for a…
KFilippopolitis Oct 27, 2026
bd1d7d1
feat(account): create a token for the mip client with a Keycloak sign-in
KFilippopolitis Oct 27, 2026
93118e6
docs(auth): describe remote use with a Keycloak token for the mip client
KFilippopolitis Oct 27, 2026
1d6c633
chore(deps): update dependency python to v3.15.1
renovate[bot] Oct 28, 2026
f8c1f5c
feat(transformations): ordered creators and preprocessing outputs
KFilippopolitis Oct 27, 2026
41f1f01
feat(transformations): repeated creator cards and K-means fit modes
KFilippopolitis Oct 27, 2026
35535ce
feat(transformations): PCA component columns
KFilippopolitis Oct 27, 2026
db8635c
feat(results): PCA view and remove pca_with_transformation
KFilippopolitis Oct 27, 2026
32d8d7b
docs: ordered transformations and PCA columns
KFilippopolitis Oct 27, 2026
023b692
fix(transformations): PCA columns without a prior PCA run, like K-means
KFilippopolitis Oct 27, 2026
d81ba51
fix(transformations): address PR 58 review findings
KFilippopolitis Oct 28, 2026
fb35744
feat(results): one-sided CI, run level and paired order in t-test fig…
KFilippopolitis Oct 28, 2026
90d321d
chore(deps): update dependency opengrep/opengrep to v1.32.0 (#62)
renovate[bot] Oct 30, 2026
65a98b0
build(deps): bump the github-actions group with 3 updates (#65)
dependabot[bot] Nov 2, 2026
5333bf1
chore(deps): update dependency python to v3.15.2 (#64)
renovate[bot] Nov 2, 2026
46eee15
Add publish_staging_images workflow (#66)
KFilippopolitis Nov 2, 2026
1898dc3
ci(staging): build staging-b/staging-c images and compute the short-s…
KFilippopolitis Nov 3, 2026
652c026
refactor(data-model): Classify variables by the single CDE type
KFilippopolitis Oct 26, 2026
3d87f47
fix(data-model): Keep free-text CDEs out of Exaflow inputs
KFilippopolitis Oct 27, 2026
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
The table of contents is too big for display.
Diff view
Diff view
  •  
  •  
  •  
121 changes: 99 additions & 22 deletions .agent/workflows/experiment-studio-flow.md
Original file line number Diff line number Diff line change
Expand Up @@ -4,53 +4,130 @@ description: How the Experiment Studio frontend flow works

# Experiment Studio Frontend Flow

This guide describes the core user journey and technical implementation of the Experiment Studio.
This guide describes the current Experiment Studio user journey and the frontend pieces that coordinate dataset selection, descriptive review, preprocessing, and algorithm execution.

## 1. Core User Journey

1. **Select Pathology (Data Model)**: Choosing the domain of study (e.g., Stroke).
2. **Select Datasets**: Enabling specific data sources to explore.
3. **Explore Variables**: Using the zoomable bubble chart to browse the data hierarchy.
4. **Select Parameters**:
* **Variables (Y)**: Target variables for analysis.
* **Covariates (X)**: Predictor variables.
* **Filters**: Subset the data based on variable values.
5. **View Distributions**: Reviewing histograms of selected variables across datasets.
6. **Run Algorithms**: Selecting and configuring a statistical algorithm based on selected parameters.
1. **Select Pathology (Data Model)**: Choose the domain of study, for example Stroke.
2. **Select Datasets**: Enable the datasets that should participate in exploration and analysis.
3. **Explore Variables**: Use the zoomable bubble chart to browse the data hierarchy and inspect variable metadata.
4. **Select Parameters**:
- **Variables (Y)**: Target variables for analysis.
- **Covariates (X)**: Predictor or grouping variables.
- **Filters**: Optional dataset subset rules based on variable values.
5. **Review Data & Configure Preprocessing**: Use the existing **Descriptive statistics** sidebar item. The internal panel is now **DATA REVIEW & PREPROCESSING** and contains:
- **Raw Data Summary**: Before view, based on the selected raw dataset and variables.
- **Preprocessing Setup**: Configure supported preprocessing rules. Currently only **Missing Values** is executable.
- **Processed Data Summary**: After view, recalculated only after preprocessing is applied.
6. **Run Algorithms**: Select and configure a compatible algorithm. If preprocessing was applied, the Algorithm step receives the applied preprocessing configuration. Pending preprocessing changes do not affect algorithm requests.

## 2. Technical Architecture
## 2. Simple End-to-End Flow

This is the recommended smoke-test flow for the current setup:

1. Open **Experiment Studio**.
2. Keep or select the Stroke data model and the desired datasets.
3. Add **Age** as a **Variable**.
4. Add **Sex** as a **Covariate**.
5. Open **Descriptive statistics** in the left sidebar.
6. In **DATA REVIEW & PREPROCESSING**, review **Raw Data Summary**.
7. Open **Preprocessing Setup**.
8. In **Missing Values**, set **Age** to **Remove rows**.
9. Click **Apply Preprocessing**.
10. Confirm **Processed Data Summary** expands and shows recalculated statistics.
11. Open **Algorithm**.
12. Select **One-way ANOVA**.
13. Run the experiment.

Expected behavior:
- The raw summary uses the original selected data.
- The preprocessing table shows only supported preprocessing capabilities. At the moment, that is **Missing Values**.
- **Remove rows** maps to the Exaflow missing-values strategy `drop`.
- The processed summary is recalculated only after clicking **Apply Preprocessing**.
- The algorithm request uses the applied preprocessing configuration.

## 3. Technical Architecture

### Component Hierarchy
- `ExperimentStudioComponent`: Main orchestrator and route handler.
- `VariablesPanelComponent`: Manages data/dataset selection and variable exploration.
- `BubbleChartComponent`: D3-based visualization of the data model.
- `VariableFilterSelectionComponent`: Manages selected variables, covariates, and filters.
- `DistributionGraphComponent`: Renders histograms for selected nodes.
- `StatisticAnalysisPanelComponent`: Owns the **DATA REVIEW & PREPROCESSING** UI inside the existing **Descriptive statistics** section.
- `AlgorithmPanelComponent`: Manages algorithm selection, configuration, and execution.

### State Management
- **Service**: [ExperimentStudioService](file:///home/kfilippopolitis/Desktop/platform-ui/src/app/services/experiment-studio.service.ts)
- **Service**: [`ExperimentStudioService`](../../src/app/services/experiment-studio.service.ts)
- **Signals**: Used extensively for reactive state (e.g., `selectedDataModel()`, `selectedVariables()`).
- **Communication**: Components inject the service to read/write state.
- **Communication**: Components inject the service to read/write state and to build descriptive-statistics and algorithm requests.
- **Applied preprocessing**: Stored in the experiment studio service only after the user clicks **Apply Preprocessing**.
- **Pending preprocessing**: Local to the statistic panel and never used by the Algorithm step.

### Important Logic
- **D3 Interaction**: Leaf node clicks in the bubble chart update the `selectedNode` in the parent panel, which then triggers a histogram fetch via the service.
- **Double-Click Shortcut**: Double-clicking a leaf node in the bubble chart automatically adds it to the **Variables** list.
- **Onboarding Hints**: Selection buttons (+Variables, etc.) pulse when a variable is selected but not yet added.
- **Algorithm Rules**: [AlgorithmRulesService](file:///home/kfilippopolitis/Desktop/platform-ui/src/app/services/algorithm-rules.service.ts) contains the logic for enabling/disabling algorithms based on selected variable types and counts.
- **Algorithm Rules**: [`AlgorithmRulesService`](../../src/app/services/algorithm-rules.service.ts) contains the logic for enabling/disabling algorithms based on selected variable types and counts.
- **Auto-Expansion**: Algorithm categories automatically expand in the sidebar when compatible variables are selected and algorithms become available.
- **Requirement Key**: A legend at the bottom of the algorithm panel clarifies the meaning of requirement icons (Database = Variable, Sliders = Covariate).
- **Descriptive Statistics Request**: Raw summary calls the descriptive overview with `preprocessing: null`.
- **Processed Summary Request**: Processed summary calls the descriptive overview with explicit applied preprocessing.
- **Missing Values Preprocessing**:
- `No action`: omitted from Exaflow `strategies`.
- `Remove rows`: `drop`.
- `Mean imputation`: `mean`, numeric only.
- `Median imputation`: `median`, numeric only.
- `Constant value`: `constant` plus `fill_values[var]`.
- **Unsupported Preprocessing Categories**: Outliers, numeric transformations, category handling, scaling, and encoding are not shown as active choices in the current UI because the current Exaflow preprocessing API does not execute them.

## 4. Data Review & Preprocessing Details

The sidebar navigation remains unchanged:

## 3. Common Pitfalls & Tips
1. **Datasets & Variables**
2. **Descriptive statistics**
3. **Algorithm**

The old descriptive-statistics panel has been expanded internally, but it is still reached through **Descriptive statistics**. Do not add a new sidebar item for preprocessing.

### Raw Data Summary
- Open by default.
- Shows statistics for the original selected dataset.
- Has only **Variables** and **Distributions** tabs.
- Does not show a **Model** tab.

### Preprocessing Setup
- Contains the supported preprocessing controls for the selected variables and covariates.
- Current executable scope is **Missing Values** only.
- Search filters visible variable rows by variable label or code.
- Changing a rule creates a pending state.
- **Reset Changes**, **Preview Impact**, and **Apply Preprocessing** are disabled until there are pending changes.
- Applying validates the rules, sends a processed descriptive overview request, stores the applied preprocessing configuration, clears pending changes, and expands the processed summary.

### Processed Data Summary
- Collapsed/empty until preprocessing has been applied.
- After apply, it mirrors Raw Data Summary layout and shows only **Variables** and **Distributions**.
- Displays statistics recalculated from the processed descriptive overview response.
- Shows the note: **Based on applied preprocessing rules**.

## 5. Common Pitfalls & Tips

- **Change Detection**: The project uses `ChangeDetectionStrategy.OnPush`. When integrating with D3 or other non-Angular events, you MUST manually trigger `ChangeDetectorRef.detectChanges()` to ensure updates propagate to child components.
- **Signal Writes**: Reactive effects that update state (like the auto-expansion logic) must use `{ allowSignalWrites: true }`.
- **D3 Hierarchy**: The bubble chart uses [zoomable-circle-packing.ts](file:///home/kfilippopolitis/Desktop/platform-ui/src/app/pages/experiment-studio/visualisations/bubble-chart/zoomable-circle-packing.ts). Ensure any changes to interaction logic are applied here and emitted via `@Output` in the wrapper component.
- **D3 Hierarchy**: The bubble chart uses [`zoomable-circle-packing.ts`](../../src/app/pages/experiment-studio/visualisations/bubble-chart/zoomable-circle-packing.ts). Ensure any changes to interaction logic are applied here and emitted via `@Output` in the wrapper component.
- **Dataset Enrichment**: Adding a variable usually requires "enriching" it (fetching enumerations or metadata) before it can be used in algorithms. This is handled by `addVariableAndEnrich()`.
- **Pending vs Applied Preprocessing**: Pending preprocessing rules must not update processed summaries or algorithm requests. Only applied preprocessing should be used downstream.
- **Describe Calls**: Do not rely on saved descriptive results. Raw and processed summaries are recalculated through descriptive overview calls.
- **Unsupported Preprocessing**: Do not add UI controls for transformations that Exaflow cannot execute unless the backend/API support is added first.

## 6. Key Files

## 4. Key Files
- [experiment-studio.component.ts](file:///home/kfilippopolitis/Desktop/platform-ui/src/app/pages/experiment-studio/experiment-studio.component.ts)
- [experiment-studio.service.ts](file:///home/kfilippopolitis/Desktop/platform-ui/src/app/services/experiment-studio.service.ts)
- [algorithm-panel.component.ts](file:///home/kfilippopolitis/Desktop/platform-ui/src/app/pages/experiment-studio/algorithm-panel/algorithm-panel.component.ts)
- [algorithm-rules.service.ts](file:///home/kfilippopolitis/Desktop/platform-ui/src/app/services/algorithm-rules.service.ts)
- [zoomable-circle-packing.ts](file:///home/kfilippopolitis/Desktop/platform-ui/src/app/pages/experiment-studio/visualisations/bubble-chart/zoomable-circle-packing.ts)
- [`experiment-studio.component.ts`](../../src/app/pages/experiment-studio/experiment-studio.component.ts)
- [`experiment-studio.service.ts`](../../src/app/services/experiment-studio.service.ts)
- [`statistic-analysis-panel.component.ts`](../../src/app/pages/experiment-studio/statistic-analysis-panel/statistic-analysis-panel.component.ts)
- [`statistic-analysis-panel.component.html`](../../src/app/pages/experiment-studio/statistic-analysis-panel/statistic-analysis-panel.component.html)
- [`statistic-analysis-panel.component.css`](../../src/app/pages/experiment-studio/statistic-analysis-panel/statistic-analysis-panel.component.css)
- [`algorithm-panel.component.ts`](../../src/app/pages/experiment-studio/algorithm-panel/algorithm-panel.component.ts)
- [`algorithm-rules.service.ts`](../../src/app/services/algorithm-rules.service.ts)
- [`zoomable-circle-packing.ts`](../../src/app/pages/experiment-studio/visualisations/bubble-chart/zoomable-circle-packing.ts)
12 changes: 12 additions & 0 deletions .cursor/rules/browser.mdc
Original file line number Diff line number Diff line change
@@ -0,0 +1,12 @@
---
description: Use Cursor IDE browser MCP for UI checks; never Playwright unless asked
alwaysApply: true
---

# Browser for UI verification

Use the Cursor IDE browser MCP only (`browser_navigate`, `browser_lock`, `browser_snapshot`, `browser_take_screenshot`, `browser_click`).

Do not use Playwright, playwright-cli, `npx playwright`, Puppeteer, or a headed Chromium from the shell unless the user explicitly asks.

If the MCP browser is missing, stop and say so. Do not install or run Playwright as a substitute.
23 changes: 23 additions & 0 deletions .cursor/rules/llm-wiki.mdc
Original file line number Diff line number Diff line change
@@ -0,0 +1,23 @@
---
description: Use the platform-ui LLM wiki to load minimal repository context.
alwaysApply: true
---

# LLM Wiki Context Rule

Before answering project questions or editing code, start with
`docs/llm-wiki/00-agent-entrypoint.md`.

Use the wiki as an index, not as bulk context:

- Read the entrypoint first.
- Pick only one topic page for the task.
- Use `docs/llm-wiki/indexes/files-by-feature.md` or
`docs/llm-wiki/indexes/symbols-by-feature.md` to identify exact source files.
- Search by route, endpoint, symbol, selector, CSS class, algorithm name, or
result key before opening files.
- Open broad folders, large mapper files, templates, or styles only when the
task is complex or a targeted lookup is inconclusive.

Do not duplicate the wiki in Cursor rules. Keep this rule short so it stays cheap
to include in every Cursor chat.
13 changes: 13 additions & 0 deletions .cursor/rules/ui-design.mdc
Original file line number Diff line number Diff line change
@@ -0,0 +1,13 @@
---
description: MIP UI must match DESIGN.md tokens and existing studio chrome
globs: "**/*.{css,html,scss},**/experiment-studio/**"
alwaysApply: false
---

# MIP UI

Read [DESIGN.md](DESIGN.md) before changing visuals. Reuse existing CSS variables and Angular Material chrome. Do not invent palettes, display type, or animation libraries.

Conflict rule: live tokens in `src/styles.css` `:root` win for app chrome; charter rules in DESIGN.md still win for logo geometry and logo colorways.

After any visual change, follow the `ui-review` skill: render the affected page, compare to an unchanged sibling panel, fix mismatches, do not restyle the whole app. Cursor: IDE browser MCP. Pi: `.pi/skills/ui-review` (CDP + `read` PNG). Do not use Playwright unless explicitly asked.
10 changes: 10 additions & 0 deletions .cursor/skills/ui-review/SKILL.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,10 @@
---
name: ui-review
description: After frontend changes in MIP, render the affected page in the Cursor IDE browser MCP (not Playwright), compare it to adjacent existing UI, and fix homogeneity gaps before stopping. Use when CSS, templates, or visual layout changed.
---

Canonical instructions: [`.pi/skills/ui-review/SKILL.md`](../../../.pi/skills/ui-review/SKILL.md).

Cursor: IDE browser MCP (`browser_navigate` / `browser_lock` / `browser_snapshot` / `browser_take_screenshot` / `browser_click`). Unlock when done. Do not use Playwright unless asked.

Pi: follow that file (CDP + `read` PNG). Do not use Cursor `browser_*`.
2 changes: 1 addition & 1 deletion .dockerignore
Original file line number Diff line number Diff line change
Expand Up @@ -11,4 +11,4 @@ Dockerfile
npm-debug.log
README.md
AGENTS.md
DESIGN_SYSTEM.yaml
DESIGN.md
20 changes: 20 additions & 0 deletions .github/dependabot.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,20 @@
version: 2
updates:
# Keep SHA-pinned actions in workflows up to date (updates the pin and its
# version comment). Renovate is scoped to the setup scripts only, so the two
# bots don't overlap (see renovate.json).
- package-ecosystem: "github-actions"
directory: "/"
schedule:
interval: "monthly"
# One combined PR for all action bumps instead of one PR per action
groups:
github-actions:
patterns:
- "*"
# 7-day cooldown, matching the scanners: never propose a release younger
# than 7 days, so yanked or compromised releases never reach a PRR
cooldown:
default-days: 7
labels:
- "dependencies"
29 changes: 29 additions & 0 deletions .github/workflows/checks.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,29 @@
name: Static checks

# Typecheck, dead-code scan and a production build — the three checks that need no
# backend, browser or secrets. The Vitest unit tests run in unit-tests.yml.
on:
pull_request:
workflow_dispatch:

jobs:
static:
name: Typecheck, dead code, build
runs-on: ubuntu-latest
permissions:
contents: read
steps:
- name: Check out repository
uses: actions/checkout@3d3c42e5aac5ba805825da76410c181273ba90b1 # v7.0.1

- name: Set up Node
uses: actions/setup-node@949feb2413d6458794dcd2491c4babbbce0c15c1 # v7.1.0
with:
node-version-file: .nvmrc
cache: npm

- name: Install dependencies
run: npm ci

- name: Verify (typecheck + dead code + build)
run: npm run verify
Loading
Loading