Граф коммитов

77 Коммитов

Автор SHA1 Сообщение Дата
Ilya Matiach 6026326d23
upgrade nx to 12.10.0 (#2561) 2024-05-01 13:09:35 -04:00
Ilya Matiach 7b7054fbb6
add text feature importance e2e unit tests for covid jupyter notebook (#2323) 2023-09-07 23:06:54 -04:00
Ilya Matiach ff48382c1e
add text feature importance e2e unit tests for dbpedia jupyter notebook (#2313) 2023-09-06 10:48:03 -04:00
Ilya Matiach efbc451628
move individual feature importance tests for text dashboard to common e2e package folder to re-use for unit and notebook tests (#2299) 2023-08-31 14:12:37 -04:00
Roman Lutz 4bdf3bca91
Model overview: add box plot in the regression case (#1532)
* add regression distribution box chart

* test updates to reflect box plot

* lintfix

* update with latest main changes, add proper test case and fix minor issues

* fix update on target label change

* lintfix
2022-12-03 04:34:53 +00:00
xuke444 2bd09f98fd
clean up fairnes by breaking 300+ line files
* update wizard report

Signed-off-by: Ke Xu <xuke@microsoft.com>

* update perf plot

Signed-off-by: Ke Xu <xuke@microsoft.com>

* update comparison chart

Signed-off-by: Ke Xu <xuke@microsoft.com>

* update fairness wizard

Signed-off-by: Ke Xu <xuke@microsoft.com>

* split ut

Signed-off-by: Ke Xu <xuke@microsoft.com>

Signed-off-by: Ke Xu <xuke@microsoft.com>
2022-09-16 19:56:15 +00:00
xuke444 f6870ab6db
fix lint rules (#1714)
* fix lint

Signed-off-by: Ke Xu <xuke@microsoft.com>

* fix build

Signed-off-by: Ke Xu <xuke@microsoft.com>

* fix chart

Signed-off-by: Ke Xu <xuke@microsoft.com>

Signed-off-by: Ke Xu <xuke@microsoft.com>
2022-09-14 19:41:56 -07:00
Ruby Zhu cb46dc305b
[Accessibility] Data analysis scatter chart - use symbol and color to differentiate data series (#1667)
* error analysis screen reader

Signed-off-by: Ruby Zhu <zhenzhu@microsoft.com>

* fix lint

Signed-off-by: Ruby Zhu <zhenzhu@microsoft.com>

* scatter chart

Signed-off-by: Ruby Zhu <zhenzhu@microsoft.com>

* lint fix

Signed-off-by: Ruby Zhu <zhenzhu@microsoft.com>

* add unit test

Signed-off-by: Ruby Zhu <zhenzhu@microsoft.com>

* update test file name

Signed-off-by: Ruby Zhu <zhenzhu@microsoft.com>

* fix unit test lint and switch case

Signed-off-by: Ruby Zhu <zhenzhu@microsoft.com>

* update color

Signed-off-by: Ruby Zhu <zhenzhu@microsoft.com>

* lint

Signed-off-by: Ruby Zhu <zhenzhu@microsoft.com>

* fix e2e

Signed-off-by: Ruby Zhu <zhenzhu@microsoft.com>

* fix lint

Signed-off-by: Ruby Zhu <zhenzhu@microsoft.com>

Signed-off-by: Ruby Zhu <zhenzhu@microsoft.com>
2022-08-29 18:49:24 +00:00
Ilya Matiach 22c68a11b6
enable new Model Overview experience in OSS RAI Dashboard by default (#1647) 2022-08-18 15:36:27 -04:00
Ilya Matiach 323055795a
add radio button tests for RAI text dashboard (#1648) 2022-08-18 15:33:12 -04:00
Ilya Matiach 7930cc468b
add tests to RAI text dashboard importances part 2 (#1642) 2022-08-17 15:06:56 -04:00
Ilya Matiach 0a4c5dc504
add UI tests for RAI text dashboard (#1636) 2022-08-15 16:14:48 -04:00
tongy-msft 94dd072355
Panel buttons should be uniform: change all buttons to "Apply"; all buttons should be at bottom (#1524)
* update feature list apply button

* update axis config dialog apply button

* fix lint

* update apply button for model overview

* fix lint

* address comment and update localization for shiftCohort

* fix lint

* fix e2e

* fix e2e failures
2022-06-29 21:07:44 +00:00
Roman Lutz 80eefe7177
Add charts for new model overview experience (#1348)
* rename OverallTable to DisaggregatedMetricsTable and move to core-ui

* Copy the ModelPerformanceTab into model-assessment and rename to ModelOverview

* reference OverallTable again in fairness widget

* refactor core chart component out into core-ui

* refactor out core chart component into core-ui

* lintfix

* undo tsconfig.lib.json change

* fix chartAndConfigsId in tests

* lintfix

* add table for cohort metrics and add dropdown metric selector, add new metrics

* add new metrics

* undo unwanted changes

* fix casing

* add superscript 2 for r-squared

* update tests to reflect new metrics

* lintfix

* add feature flag

* fix mae

* fix mae calculation

* first version of new model overview table

* get probability distribution box plot to work

* add feature flag for new model overview experience and turn it off by default

* add highchart heatmap helper class

* remove custom styling

* add erroneously deleted line back

* remove useless constructor

* modularize model overview

* show outliers in box plot, fix positioning

* remove showmetricsummary

* refactor heatmap code into a common class

* add featureDropdownRef to allow focusing

* add only dataset cohort table, update wrapping code

* lintfix

* lintfix

* build error fix

* add chart config flyout (in progress)

* add chart config flyout (in progress)

* address feedback, use finalized color

* adjust feature selection to disable options if limit is reached, add axis config buttons

* select all via dropdown

* lintfix

* refactor box plot calculations and rendering

* add style file

* textured NaN cells, grid labels on y axis

* standardize box plots to use fences

* fix merge issues

* unify box plot tooltip formatting code, fix bar chart sizing issue

* small fixes

* rearrange feature dropdown

* lintfix

* remove commented out code

* remove box plot tooltip customization

* lintfix

* add a few unit tests

* unit tests for smaller utilities, localization fixes, consistent flyout flow with confirm/cancel buttons

* lintfix

* fix chart config flyout update

* fix test case

* rename files for lint

* file rename for lint
2022-04-19 11:48:11 -04:00
Ilya Matiach f7d75d322f
block empty cohort creation in RAI Dashboard (#1335) 2022-04-12 16:27:31 -04:00
Bo Zhang ba79a750bd
update string when no datapoint selected (#1331) 2022-04-09 09:56:14 -07:00
Bo Zhang 6ebd75a8a7
Add highchart for Dataset Explorer (#1286)
* test

* style

* click

* fix test

* fix test

* test

* test

* test

* test
2022-03-29 10:00:09 -07:00
Bo Zhang db3cd4c570
Add ICE chart (#1283)
* Fix

* ice chart

* ic

* test

* test
2022-03-19 11:24:55 -07:00
Bo Zhang 829eca7f2d
Add feature importance box & bar chart (#1241)
* refactor

* build

* build

* temp

* temp

* temp

* temp

* box

* cache

* e2e

* e2e

* fix

* e2e fix

* e2e

* fix e2e

* widget

* widget

* fix

* widget

* e2e

* e2e

* e2e

* test

* test
2022-03-01 21:19:38 -08:00
Bo Zhang 8292afe66b
scatter e2e (#1226) 2022-02-17 01:07:59 +08:00
Bo Zhang 17c81054c9
Replace dependence plot with highchart lib (#1208)
* temp

* test

* temp

* refactor

* tooltip

* cache

* tooltip template

* remove dup

* e2e

* test

* test

* e2e

* test

* remove animation

* test

* fix
2022-02-11 07:14:52 +08:00
Roman Lutz f0f9c7f7b4
Add multiclass classification dataset & set up basic model-assessment tests (#1191)
* add wine dataset for multiclass classification

* add basic tests for model overview section for binary and multiclass classification as well as regression

* lintfix

* undo changes to notebook

* update tests to reflect changes on main (addition of new metrics and string changes), simplify test setup

* lintfix
2022-02-04 16:33:28 +00:00
Roman Lutz 775eb9cdb1
Add metrics to StatisticsUtils - F1 score, selection rate, mean absolute error (#1174)
* add new metrics

* undo unwanted changes

* fix casing

* add superscript 2 for r-squared

* update tests to reflect new metrics

* lintfix

* fix mae calculation
2022-02-01 20:22:31 +00:00
Roman Lutz ae87f4340e
Move performance metric chart, disaggregated metric table, and StatisticsUtils into core-ui (#1115)
* rename OverallTable to DisaggregatedMetricsTable and move to core-ui

* Copy the ModelPerformanceTab into model-assessment and rename to ModelOverview

* reference OverallTable again in fairness widget

* refactor core chart component out into core-ui

* refactor out core chart component into core-ui

* lintfix

* undo tsconfig.lib.json change

* fix chartAndConfigsId in tests

* lintfix
2022-01-06 22:24:50 -05:00
Bo 49092cf691
Add "Save and switch" button to cohort creation (#952)
* save switch

* fix e2e
2021-10-16 06:44:35 +08:00
xuke444 66ecdb7959
rollback fairness (#855)
* rollback fairness

Signed-off-by: Ke Xu <xuke@microsoft.com>

* disable test

Signed-off-by: Ke Xu <xuke@microsoft.com>

* disable test

Signed-off-by: Ke Xu <xuke@microsoft.com>
2021-09-10 01:36:10 +00:00
Alex Quach 621dd10fb5
Incorporate Uncertainty Quantification in Fairness widget v2 (#750)
Enabled calculation and visualisation of confidence intervals in fairness dashboard

Co-authored-by: Ke Xu <xuke@microsoft.com>
2021-08-20 16:32:27 -04:00
xuke444 cc50e02db0
update cohort (#812)
move cohort info and buttons to sticky menu
replace error stats with filters
2021-08-20 11:35:46 -07:00
Bo bb0d33e947
Interpretability Info and guidelines missing (#802)
* intepret

* e2e

* e2e

* fix e2e

Co-authored-by: zhb000 <zhb@microsoft.com>
2021-08-19 06:04:31 -07:00
Bo 4738c74dc9
String update (#781)
Co-authored-by: zhb000 <zhb@microsoft.com>
2021-08-12 10:05:35 +08:00
xuke444 878659ef64
add lint rule (#752)
add user string template and dot object property access lint rule
2021-08-03 17:12:25 -07:00
xuke444 e373c1e5e6
upgrade nx (#725)
* upgrade nx

Signed-off-by: Ke Xu <xuke@microsoft.com>

* fix lint

Signed-off-by: Ke Xu <xuke@microsoft.com>

* remove unused pkg

Signed-off-by: Ke Xu <xuke@microsoft.com>

* remove migration

Signed-off-by: Ke Xu <xuke@microsoft.com>

* update style

Signed-off-by: Ke Xu <xuke@microsoft.com>

* fix lint

Signed-off-by: Ke Xu <xuke@microsoft.com>

* handle undefined

Signed-off-by: Ke Xu <xuke@microsoft.com>

* fix style

Signed-off-by: Ke Xu <xuke@microsoft.com>
2021-07-29 11:32:40 -07:00
Roman Lutz d7fdc26197
Fix aggregate feature importance chart for multiclass classification (#734)
* remove activeSeries and calculate on the fly when needed

Signed-off-by: Roman Lutz <rolutz@microsoft.com>

* add check for explicit feature importance values to irisData

Signed-off-by: Roman Lutz <rolutz@microsoft.com>
2021-07-29 08:11:13 -07:00
Richard Edgar d9cca59160
Extra assertions for fairness tests (#585)
Add some extra checks into the Fairness widget

Signed-off-by: Richard Edgar <riedgar@microsoft.com>
2021-06-14 08:45:46 -04:00
xuke444 af1dc99173
fix individual chart when no data available (#579)
* fix individual chart when no data available
And updated e2e test

Signed-off-by: Ke Xu <xuke@microsoft.com>

* fix ebm test

Signed-off-by: Ke Xu <xuke@microsoft.com>

* update test

Signed-off-by: Ke Xu <xuke@microsoft.com>

* update cohort

Signed-off-by: Ke Xu <xuke@microsoft.com>

* update no-dataset

Signed-off-by: Ke Xu <xuke@microsoft.com>

* fix test

Signed-off-by: Ke Xu <xuke@microsoft.com>
2021-06-07 21:27:31 -07:00
xuke444 e7785e5fb3
disable zoom in error analysis tree (#469)
* disable zoom

Signed-off-by: Ke Xu <xuke@microsoft.com>

* fix label

Signed-off-by: Ke Xu <xuke@microsoft.com>

* remove transition group

Signed-off-by: Ke Xu <xuke@microsoft.com>

* reformat tree

Signed-off-by: Ke Xu <xuke@microsoft.com>

* fix lint

Signed-off-by: Ke Xu <xuke@microsoft.com>

* add width

Signed-off-by: Ke Xu <xuke@microsoft.com>

* adjust size

Signed-off-by: Ke Xu <xuke@microsoft.com>

* fix lint

Signed-off-by: Ke Xu <xuke@microsoft.com>

* adjust tree

Signed-off-by: Ke Xu <xuke@microsoft.com>

* adjust width & hright

Signed-off-by: Ke Xu <xuke@microsoft.com>

* adjust min width

Signed-off-by: Ke Xu <xuke@microsoft.com>

* update snapshot

Signed-off-by: Ke Xu <xuke@microsoft.com>

* fix lint

Signed-off-by: Ke Xu <xuke@microsoft.com>
2021-05-10 22:01:30 -07:00
xuke444 e201bb2694
split test (#419)
* move file

Signed-off-by: Ke Xu <xuke@microsoft.com>

* split test

Signed-off-by: Ke Xu <xuke@microsoft.com>

* add copy test script

Signed-off-by: Ke Xu <xuke@microsoft.com>

* copy test file

Signed-off-by: Ke Xu <xuke@microsoft.com>
2021-03-26 09:37:19 -07:00
xuke444 8119ac774c
fix global feature importance validation (#384)
* fix global feature importance validation
by using global feature name if available

Signed-off-by: Ke Xu <xuke@microsoft.com>

* fix test

Signed-off-by: Ke Xu <xuke@microsoft.com>
2021-03-11 17:56:04 -08:00
xuke444 5e0e594950
fix categorical feature in what if (#369)
* fix what if

Signed-off-by: Ke Xu <xuke@microsoft.com>

* fix test

Signed-off-by: Ke Xu <xuke@microsoft.com>

* add test

Signed-off-by: Ke Xu <xuke@microsoft.com>

* fix lint

Signed-off-by: Ke Xu <xuke@microsoft.com>

* fix test

Signed-off-by: Ke Xu <xuke@microsoft.com>

* fix test

Signed-off-by: Ke Xu <xuke@microsoft.com>
2021-03-04 18:00:31 -08:00
xuke444 0b3de1cedc
Xuke/fixglobalimportance (#368)
* fix global importance name

Signed-off-by: Ke Xu <xuke@microsoft.com>

* add feature name

Signed-off-by: Ke Xu <xuke@microsoft.com>

* update name

Signed-off-by: Ke Xu <xuke@microsoft.com>

* fix test

Signed-off-by: Ke Xu <xuke@microsoft.com>

* update test

Signed-off-by: Ke Xu <xuke@microsoft.com>
2021-03-03 10:32:26 -08:00
Ilya Matiach 2591582dd2
add model performance tab tests (#364) 2021-03-01 15:11:23 -05:00
Bo 9088b00937
skip flaky test (#302) 2021-02-03 10:55:09 +08:00
Bo 240d2c39ca
Add e2e test for what if panel (#275)
* what if panel e2e

* add datapoint from dropdown

* Fix build

* build

Signed-off-by: Bo Zhang <boz2@uci.edu>

* test

* TEST

* Update describeWhatIf.ts
2021-02-02 17:21:15 +08:00
Roman Lutz c87f89451a
Fairness: make charts compatible with dark mode and remove custom tick labeling of single model view charts (#163)
* choicegroup

Signed-off-by: Roman Lutz <rolutz@microsoft.com>

* Restructure configuration for sensitive feature selection, performance metric selection, and fairness metric selection in Fairness Dashboard

Signed-off-by: Roman Lutz <rolutz@microsoft.com>

* remove custom styling

Signed-off-by: Roman Lutz <rolutz@microsoft.com>

* handle custom metrics

Signed-off-by: Roman Lutz <rolutz@microsoft.com>

* update tests

Signed-off-by: Roman Lutz <rolutz@microsoft.com>

* adjust tests

Signed-off-by: Roman Lutz <rolutz@microsoft.com>

* put shared tokens in a shared location

Signed-off-by: Roman Lutz <rolutz@microsoft.com>

* lint

Signed-off-by: Roman Lutz <rolutz@microsoft.com>

* lint

Signed-off-by: Roman Lutz <rolutz@microsoft.com>

* remove shared tokens and use l1 instead of custom pixel number

Signed-off-by: Roman Lutz <rolutz@microsoft.com>

* lint

Signed-off-by: Roman Lutz <rolutz@microsoft.com>

* remove custom dropdown styling

Signed-off-by: Roman Lutz <rolutz@microsoft.com>

* remove unnecessary styling

Signed-off-by: Roman Lutz <rolutz@microsoft.com>

* lint

Signed-off-by: Roman Lutz <rolutz@microsoft.com>

* fix theme for text in configuration pages

Signed-off-by: Roman Lutz <rolutz@microsoft.com>

* remove theme as param for plot classes since they can retrieve it with getTheme

Signed-off-by: Roman Lutz <rolutz@microsoft.com>

* adjust bar plot (in progress) and model comparison style

Signed-off-by: Roman Lutz <rolutz@microsoft.com>

* label on the left without SummaryTable

Signed-off-by: Roman Lutz <rolutz@microsoft.com>

* consolidate duplications into BarPlotlyProps

Signed-off-by: Roman Lutz <rolutz@microsoft.com>

* lintfix

Signed-off-by: Roman Lutz <rolutz@microsoft.com>

* bump flake, remove comment

Signed-off-by: Roman Lutz <rolutz@microsoft.com>

* fix test

Signed-off-by: Roman Lutz <rolutz@microsoft.com>
2020-12-03 22:42:33 -08:00
Roman Lutz 4588c17436
Restructure configuration for sensitive feature selection, performance metric selection, and fairness metric selection in Fairness Dashboard (#160)
* choicegroup

Signed-off-by: Roman Lutz <rolutz@microsoft.com>

* Restructure configuration for sensitive feature selection, performance metric selection, and fairness metric selection in Fairness Dashboard

Signed-off-by: Roman Lutz <rolutz@microsoft.com>

* remove custom styling

Signed-off-by: Roman Lutz <rolutz@microsoft.com>

* handle custom metrics

Signed-off-by: Roman Lutz <rolutz@microsoft.com>

* update tests

Signed-off-by: Roman Lutz <rolutz@microsoft.com>

* adjust tests

Signed-off-by: Roman Lutz <rolutz@microsoft.com>

* put shared tokens in a shared location

Signed-off-by: Roman Lutz <rolutz@microsoft.com>

* lint

Signed-off-by: Roman Lutz <rolutz@microsoft.com>

* lint

Signed-off-by: Roman Lutz <rolutz@microsoft.com>

* remove shared tokens and use l1 instead of custom pixel number

Signed-off-by: Roman Lutz <rolutz@microsoft.com>

* lint

Signed-off-by: Roman Lutz <rolutz@microsoft.com>
2020-11-25 17:13:12 -08:00
Roman Lutz 093920de31
Expand fairness tests to a full walkthrough including binary classification, probability, and regression (#147)
* Merge branch 'main' of https://github.com/microsoft/responsible-ai-widgets into rolutz/check_for_metrics_before_showing_charts;
add simple fairness walkthrough test, rename ts files to spec.ts

Signed-off-by: Roman Lutz <rolutz@microsoft.com>

* expand tests to all tasks, fix a couple of strings

Signed-off-by: Roman Lutz <rolutz@microsoft.com>

* fixes & test run instructions

Signed-off-by: Roman Lutz <rolutz@microsoft.com>

* convert contains to get since it otherwise doesn't execute

Signed-off-by: Roman Lutz <rolutz@microsoft.com>

* rename IFairnessData to IFairnessMetadata to avoid naming conflict, create "before" steps for tests, add IDs to certain elements, separate logic into files

Signed-off-by: Roman Lutz <rolutz@microsoft.com>

* fix first few test cases, single model view still can't be reached

Signed-off-by: Roman Lutz <rolutz@microsoft.com>

* fix tests and add additional functionality

Signed-off-by: Roman Lutz <rolutz@microsoft.com>

* lintfix

Signed-off-by: Roman Lutz <rolutz@microsoft.com>

* fix regression case by avoiding second dropdown option

Signed-off-by: Roman Lutz <rolutz@microsoft.com>

* remover debugger

Signed-off-by: Roman Lutz <rolutz@microsoft.com>

* minor fixes from feedback

Signed-off-by: Roman Lutz <rolutz@microsoft.com>

* lintfix & constants file

Signed-off-by: Roman Lutz <rolutz@microsoft.com>

* lintfix

Signed-off-by: Roman Lutz <rolutz@microsoft.com>

* remove dependency of e2e tests on fairness to fix e2e tests

Signed-off-by: Roman Lutz <rolutz@microsoft.com>
2020-11-16 12:28:05 -08:00
Roman Lutz e46918ee56
Merge branch 'main' of https://github.com/microsoft/responsible-ai-widgets into rolutz/check_for_metrics_before_showing_charts; (#137)
add simple fairness walkthrough test, rename ts files to spec.ts

Signed-off-by: Roman Lutz <rolutz@microsoft.com>
2020-11-06 23:51:59 -08:00
xuke444 a2e67b9a91
move edit cohort to side panel (#116)
* move edit cohort to side panel

Signed-off-by: Ke Xu <xuke@microsoft.com>

* remove unsed style

Signed-off-by: Ke Xu <xuke@microsoft.com>

* change to default button

Signed-off-by: Ke Xu <xuke@microsoft.com>
2020-10-23 19:21:40 -07:00
xuke444 c07c592c3e
break down small components (#111)
break new explanation into small component
change few caption to sentence capital
2020-10-17 13:05:07 -07:00
Bo e00b2a8855
sign (#102) 2020-10-13 13:20:31 +08:00