Граф коммитов

39 Коммитов

Автор SHA1 Сообщение Дата
Ilya Matiach 49906bb3a4
upgrade plotly to latest version 2.27.1 (#2484) 2024-01-10 14:42:14 -05:00
Roman Lutz 13d7a0f999
pin responsibleai text and vision packages to 0.30.0 (#2387)
* pin responsibleai text and vision packages to 0.30.0

Signed-off-by: Roman Lutz <romanlutz13@gmail.com>

* add notebook-text pytorch restrictions similar to vision notebooks

Signed-off-by: Roman Lutz <romanlutz13@gmail.com>

* add restrictions to ci e2e notebooks text vision

Signed-off-by: Roman Lutz <romanlutz13@gmail.com>

* remove special case for non-macos by python versions for pytorch installation

Signed-off-by: Roman Lutz <romanlutz13@gmail.com>

* add --no-cache-dir to solve hash issue with tensorflow

Signed-off-by: Roman Lutz <romanlutz13@gmail.com>

* double e2e notebooks timeout

Signed-off-by: Roman Lutz <romanlutz13@gmail.com>

* try setting pins like in the last successful run of notebook e2e text vision

Signed-off-by: Roman Lutz <romanlutz13@gmail.com>

* remove double timeout

Signed-off-by: Roman Lutz <romanlutz13@gmail.com>

* help dependency resolver by restricting mlflow version

Signed-off-by: Roman Lutz <romanlutz13@gmail.com>

* special case for mlflow in py37

Signed-off-by: Roman Lutz <romanlutz13@gmail.com>

* some more attempts at fixing the resolution issues

Signed-off-by: Roman Lutz <romanlutz13@gmail.com>

* remove pins

Signed-off-by: Roman Lutz <romanlutz13@gmail.com>

* add 20 minutes to the timeout since tests hit the timeout frequently

Signed-off-by: Roman Lutz <romanlutz13@gmail.com>

* downgrade gevent to 22.10.2

Signed-off-by: Roman Lutz <romanlutz13@gmail.com>

* adjust ci e2e notebooks text vision pytorch version

Signed-off-by: Roman Lutz <romanlutz13@gmail.com>

* remove gevent downgrade

Signed-off-by: Roman Lutz <romanlutz13@gmail.com>

---------

Signed-off-by: Roman Lutz <romanlutz13@gmail.com>
2023-10-16 18:53:54 -04:00
Ilya Matiach c36c09bdd6
add RAITextInsights openai notebook example and tests (#2345) 2023-09-20 13:12:23 -04:00
Ilya Matiach f7bb1e8fd6
add e2e UI notebook tests to covid19 event multilabel text classification notebook (#2282) 2023-08-29 17:12:16 -04:00
Ilya Matiach 4721d352c7
add RAITextInsights question answering notebook example and tests (#2279) 2023-08-28 10:35:41 -04:00
Ilya Matiach bc4744ed2d
add e2e UI notebook tests to blbooksgenre text classification notebook (#2273) 2023-08-25 11:38:18 -04:00
Ilya Matiach e5af55817d
add e2e UI notebook tests to DBPedia text classification notebook (#2265) 2023-08-23 15:53:13 -04:00
Roman Lutz ef215504c2
Add forecasting to raiwidgets and add a forecasting notebook (#2252)
* Add postga build trigger (#1755) (#1756)

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Add model wrapper for wrapping predictions and test data (#1762)

* Add model wrapper for wrapping predictions and test data

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Fix failing tests

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Change description of cohort selection panel in Aggregate Feature Importance (#1770)

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Support cohort filtering of string target in rai_insights (#1771)

* Port tests

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Fix rai_insights

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Simplify tests in test_cohort_filter.py (#1772)

* Simply tests in test_cohort_filter.py

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Change test name

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Forecasting Dashboard

This commit adds the Forecasting Dashboard capabilities in both UI and SDK.

* remove unrelated file

* basic set of changes to get it working again

* forecasting_grains -> time_series_id_column_names

* fix breaking changes in latest main, add quantile prediction, fix date conversion, remove obsolete managers

* fix UI components (including table and what-if creation, chart still left tbd)

* get dashboard to work with multiple time series and switching back and forth

* remove data explorer and model overview, create and edit cohort functionalities from forecasting

* lintfix

* localizzation

* remove console.log

* remove question

* remove unrelated changes, fix package.json

* string fixes and package.json adjustment

* localization

* localization

* more localization and removing of unrelated files

* remove unrelated files

* remove unrelated file changes

* remove is_forecasting_true_y

* lintfix

* add dropdown label

* feature metadata input validation updates

* cache transformation predictions

* lintfix

* remove isUndefinedOrEmpty

* remove isUndefinedOrEmpty

* rename isAllDataCohort file as requested

* lintfix

* first draft of notebook

* get notebook to run, generate cohorts (not finished)

* ntoebook

* convert filter args and column names properly

* fix datetime handling

* fix forecast request handling

* working version for bug bash

* add wheels

* add UI changes

* update notebook to fix model download

* 15 iterations

* lintfix

* add example of operation method string

* add check for context

* add explanatory comment

* move description creation logic into getDescription

* lintfix

* remove datetime_features from snapshot

* lintfix and other weirdnesses

* undo print removal

* remove wheels, lintfix, small cleanup

* use META_JSON directly instead of declaring a variable

* move constants to common files and reuse

* lowercase f

* isort

* remove datetime_features

* sktime notebook (1st half)

* isort

* debugging the notebook issue

* use parentheses instead of backslashes

* flake8

* isort

* sktime progress

* pre-unified RAIInsights commit

* pre-unified RAIInsights commit 2

* first pass over unification

* unify RAIInsights and RAIForecastingInsights

* adjustments to serialization

* cleanup, test fixes, consolidation, TODO fixes

* fix tests

* isort

* flake8

* feature metadata and categorical_features consolidation

* fix serialization of feature metadata

* fix tests

* flake8

* tests for feature metadata and cat features

* flake8

* remove remnants of RAIForecastingInsights

* fix string

* move other utils back to rai insights

* undo ModelTask import changes

* undo ModelTask references to raiutils

* undo references to ModelTask in raituils

* remove raiutils changes since they're in a separate branch

* datetime_features and time_series_id_features replacement

* pytest.mark.skip

* furthe datetime_features fixes

* TS ID col name fix

* try out asfreq

* notebook try asfreq interpolation

* attempt to condense index into a single col

* add hidden feature flag, fix tests

* remove experimental file, isort

* undo string change

* restructure wrappers and field to file mapping code

* remove unnecessary TODO

* get AML notebook to work

* get AML notebook fully working

* resolve some issues with sktime

* notebook

* remove duplicated test case

* flake8

* isort

* flalke8

* wrap zip object with list

* use ModelTask from raiutils

* remove prints

* flake8

* isort

* use FORECASTING from raiutils.models

* isort

* fix sktime issue

* get past Python errors

* fix predictions array shape

* fix UI-Python mismatch with renamed time and time series ID column names (now called "features")

* lintfix

* undo changes that aren't needed any longer

* remove AML notebook

* update notebook by removing unnecessary content

* notebook tests, basic setup

* ids for tests

* fix notebook based on latest changes in the repo

* add test for adding a what if case

* flake8 and cleanup

* isort

* lintfix

* fix test

* move notebook

* fix nb path

* fix kernelspec

* add pmdarima dependency

* skip forecasting notebook on py 3.6

* remove commented out line

* skip explanation

* add reason kw arg name

* lintfix

* fix case for vision, text

* fix syntax error

* fix python version comparison since it doesn't work with <=

---------

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>
Co-authored-by: Gaurav Gupta <47334368+gaugup@users.noreply.github.com>
Co-authored-by: Gaurav Gupta <gaugup@microsoft.com>
Co-authored-by: John Wang <t-wangjohn@microsoft.com>
2023-08-22 23:46:08 -04:00
Ilya Matiach 4c80502269
refactor notebook examples into tabular, text and vision folders (#2253) 2023-08-17 13:13:35 -04:00
Advitya Gemawat 8898e8226e
Image Classification Notebook for UI testing #2175 (#2176)
* ic nbk ckpt

* release command support

* python lint fixes

* dataset support

* ci vision nbk gate support

* auto lint fixes

* vision date support + import fixes

* lint fix

* run command syntax fix

* lint fixes

* vision_notebooks mark support & gate update
2023-07-17 14:52:05 +00:00
Advitya Gemawat e433fdf547
Multiclass Image Classification Notebook for UI testing (#2175)
* multiclass nbk ckpt

* multiclass filename update

* nbk e2e support

* python lint fixes

* multilabel dataset support

* multilabel test support

* vision nbk gate support

* added component id

* disabled error analysis function

* nbk name fix

* nbk name fix

* vision gate support

* import fixes

* import fix

* visitVision import fix

* auto lint fixes

* doc & test fixes

* spec path fix

* dataset reference fix

* run command syntax fix

* auto lint fixes

* vision_notebooks mark support & gate update
2023-07-14 16:10:36 -04:00
Advitya Gemawat b7b5b856b5
ModelAssessmentVision OD + UI Test Template (#2174)
* initial nbk commit

* vision test template

* added vision support for visit

* lint fixes

* auto lint fixes

* removed spurious import

* fridge OD test case

* release command updates

* python lint fixes

* removed unused imports

* added vision CI nbk test gate

* gate name update

* commented error analysis function

* auto lint fixes

* ci e2e nbk vision gate setup

* .github/workflows/CI-e2e-notebooks-vision.yml

* dataset reference & flight fix

* export fixes

* import lint fix

* auto lint fixes

* removed py 3.6 support from vision
2023-07-13 15:38:49 -04:00
Roman Lutz 0401c68c77
Fix selection rate (#1958)
* fix selection rate

* fix selection rate in tests

* fix typo
2023-02-12 05:14:10 +00:00
xuke444 54154fc87f
fix e2e watch mode (#1740)
Signed-off-by: Ke Xu <xuke@microsoft.com>

Signed-off-by: Ke Xu <xuke@microsoft.com>
2022-09-22 21:38:57 +00:00
xuke444 c59cc223ca
add test watch mode (#1728) 2022-09-20 05:36:03 +00:00
Ilya Matiach f34a2e9c27
fix e2e UI tests incorrectly running tests with flights when no notebook name specified and reduce number of test jobs (#1577) 2022-07-22 13:39:37 -04:00
Roman Lutz 9b14e05fb2
Fix e2e-widget.js for the case without flight argument #1529 2022-06-30 23:00:16 -07:00
Roman Lutz f52539a3b4
Add e2e tests for new model overview experience (part 1) (#1467)
* execute e2e tests even with flighted versions of dashboard

* rename model stats to model overview, add v1 and v2 for new experience

* basic test harness for individual notebook execution and flighted notebook execution, more ID tags added to model overview component

* more ids in model overview

* Update postbuild with changes in main (#1451)

* fix error on machines with pyspark installed where passed dataframe is not spark pandas (#1415)

* add postbuild branch trigger (#1417)

* Fix causal UI strings according to classification/regression tasks (#1419)

* Fix causal UI strings according to classification/regression tasks

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Fix lint error

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Fix UI test

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Fix description for model overview (#1425)

* fix description for model overview

* keep new description for new model overview

* fix failing to create error report when filter_features is empty list (#1421)

* filter out missing values from what if dropdown to prevent explanation dashboard from crashing (#1418)

* Remove |Set Value| blurb in case it is not availble in counterfactual panel (#1426)

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Add y-axis description to counterfactual feature importance chart (#1423)

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

Co-authored-by: xuke444 <40614413+xuke444@users.noreply.github.com>

* Add the user class name to causal UI strings (#1422)

* Fix causal UI strings according to classification/regression tasks

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Fix lint error

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Fix UI test

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Add the user class name to causal UI strings

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

Co-authored-by: xuke444 <40614413+xuke444@users.noreply.github.com>

* fix math.min / max for array size more than 10^7 (#1427)

Signed-off-by: Ke Xu <xuke@microsoft.com>

* upgrade pytest and lightgbm to try to fix random pytest segfault test failures (#1424)

s

* fix flaky notebook causing build failures by adding retry logic (#1431)

* Upper bound SciKit-Learn to address freeze in causal (#1432)

<!--- Provide a general summary of your changes in the Title above -->

## Description

Replaces #1429  to address #1430 . Causal analysis is getting stuck with the latest release of SciKit-Learn. This contains:

- Test case which gets stuck with SciKit-Learn 1.1.0
- Upper bound on SciKit-Learn in `requirements.txt`

## Checklist

<!--- Make sure to satisfy all the criteria listed below. -->

- [x] I have added screenshots above for all UI changes.
- [x] Documentation was updated if it was needed.
- [x] New tests were added or changes were manually verified.


Signed-off-by: Richard Edgar <riedgar@microsoft.com>

* fix dependency chart axis updating with incorrect values in explanation dashboard (#1437)

* fix codecov and widget test screenshot uploads (#1428)

* release raiwidgets and responsibleai v0.18.2 (#1439)

* fix (#1441)

Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com>

* Fix cohort name conflict and not run few tests for AML (#1442)

* fix

Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com>

* lintfix

Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com>

* Few e2e tests changes to accommodate AML static tests (#1445)

* update

Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com>

* update

Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com>

* Fix locators logic for string features -  data explorer and model statistics components (#1446)

* update

Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com>

* update

Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com>

* fix

Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com>

* update

Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com>

* lintfix

Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com>

* fix

Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com>

* Add more unittests RAI dashboard input class  (#1448)

* Add unit tests for ResponsibleAIDashboardInput

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Add more tests

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Fix imports

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Address code review comments

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Update the way to get the length of elements obtained in e2e tests (#1450)

* update

Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com>

* update

Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com>

* skip what-if create tests for AML

Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com>

Co-authored-by: Ilya Matiach <ilmat@microsoft.com>
Co-authored-by: Gaurav Gupta <47334368+gaugup@users.noreply.github.com>
Co-authored-by: xuke444 <40614413+xuke444@users.noreply.github.com>
Co-authored-by: Richard Edgar <riedgar@microsoft.com>
Co-authored-by: Vinutha Karanth <vinutha.karanth@gmail.com>

* Fix TypeError: Cannot read properties of undefined (reading 'treatAsCategorical')" (#1452)

* fix error on machines with pyspark installed where passed dataframe is not spark pandas (#1415)

* add postbuild branch trigger (#1417)

* Fix causal UI strings according to classification/regression tasks (#1419)

* Fix causal UI strings according to classification/regression tasks

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Fix lint error

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Fix UI test

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Fix description for model overview (#1425)

* fix description for model overview

* keep new description for new model overview

* fix failing to create error report when filter_features is empty list (#1421)

* filter out missing values from what if dropdown to prevent explanation dashboard from crashing (#1418)

* Remove |Set Value| blurb in case it is not availble in counterfactual panel (#1426)

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Add y-axis description to counterfactual feature importance chart (#1423)

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

Co-authored-by: xuke444 <40614413+xuke444@users.noreply.github.com>

* Add the user class name to causal UI strings (#1422)

* Fix causal UI strings according to classification/regression tasks

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Fix lint error

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Fix UI test

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Add the user class name to causal UI strings

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

Co-authored-by: xuke444 <40614413+xuke444@users.noreply.github.com>

* fix math.min / max for array size more than 10^7 (#1427)

Signed-off-by: Ke Xu <xuke@microsoft.com>

* upgrade pytest and lightgbm to try to fix random pytest segfault test failures (#1424)

s

* fix flaky notebook causing build failures by adding retry logic (#1431)

* Upper bound SciKit-Learn to address freeze in causal (#1432)

<!--- Provide a general summary of your changes in the Title above -->

## Description

Replaces #1429  to address #1430 . Causal analysis is getting stuck with the latest release of SciKit-Learn. This contains:

- Test case which gets stuck with SciKit-Learn 1.1.0
- Upper bound on SciKit-Learn in `requirements.txt`

## Checklist

<!--- Make sure to satisfy all the criteria listed below. -->

- [x] I have added screenshots above for all UI changes.
- [x] Documentation was updated if it was needed.
- [x] New tests were added or changes were manually verified.


Signed-off-by: Richard Edgar <riedgar@microsoft.com>

* fix dependency chart axis updating with incorrect values in explanation dashboard (#1437)

* fix codecov and widget test screenshot uploads (#1428)

* release raiwidgets and responsibleai v0.18.2 (#1439)

* fix (#1441)

Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com>

* Fix cohort name conflict and not run few tests for AML (#1442)

* fix

Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com>

* lintfix

Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com>

* Few e2e tests changes to accommodate AML static tests (#1445)

* update

Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com>

* update

Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com>

* Fix locators logic for string features -  data explorer and model statistics components (#1446)

* update

Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com>

* update

Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com>

* fix

Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com>

* update

Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com>

* lintfix

Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com>

* fix

Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com>

* fix

Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com>

* Add more unittests RAI dashboard input class  (#1448)

* Add unit tests for ResponsibleAIDashboardInput

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Add more tests

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Fix imports

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Address code review comments

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* more update

Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com>

* Update the way to get the length of elements obtained in e2e tests (#1450)

* update

Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com>

* update

Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com>

* skip what-if create tests for AML

Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com>

Co-authored-by: Ilya Matiach <ilmat@microsoft.com>
Co-authored-by: Roman Lutz <romanlutz13@gmail.com>
Co-authored-by: Gaurav Gupta <47334368+gaugup@users.noreply.github.com>
Co-authored-by: xuke444 <40614413+xuke444@users.noreply.github.com>
Co-authored-by: Richard Edgar <riedgar@microsoft.com>

* remove randomness from notebooks

* small fixes

* lots of new IDs and tests

* make first set of tests work for first dataset

* Update predicted class value to uneditable text in counterfactual panel  (#1458)

* fix error on machines with pyspark installed where passed dataframe is not spark pandas (#1415)

* add postbuild branch trigger (#1417)

* Fix causal UI strings according to classification/regression tasks (#1419)

* Fix causal UI strings according to classification/regression tasks

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Fix lint error

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Fix UI test

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Fix description for model overview (#1425)

* fix description for model overview

* keep new description for new model overview

* fix failing to create error report when filter_features is empty list (#1421)

* filter out missing values from what if dropdown to prevent explanation dashboard from crashing (#1418)

* Remove |Set Value| blurb in case it is not availble in counterfactual panel (#1426)

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Add y-axis description to counterfactual feature importance chart (#1423)

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

Co-authored-by: xuke444 <40614413+xuke444@users.noreply.github.com>

* Add the user class name to causal UI strings (#1422)

* Fix causal UI strings according to classification/regression tasks

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Fix lint error

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Fix UI test

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Add the user class name to causal UI strings

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

Co-authored-by: xuke444 <40614413+xuke444@users.noreply.github.com>

* fix math.min / max for array size more than 10^7 (#1427)

Signed-off-by: Ke Xu <xuke@microsoft.com>

* upgrade pytest and lightgbm to try to fix random pytest segfault test failures (#1424)

s

* fix flaky notebook causing build failures by adding retry logic (#1431)

* Upper bound SciKit-Learn to address freeze in causal (#1432)

<!--- Provide a general summary of your changes in the Title above -->

## Description

Replaces #1429  to address #1430 . Causal analysis is getting stuck with the latest release of SciKit-Learn. This contains:

- Test case which gets stuck with SciKit-Learn 1.1.0
- Upper bound on SciKit-Learn in `requirements.txt`

## Checklist

<!--- Make sure to satisfy all the criteria listed below. -->

- [x] I have added screenshots above for all UI changes.
- [x] Documentation was updated if it was needed.
- [x] New tests were added or changes were manually verified.


Signed-off-by: Richard Edgar <riedgar@microsoft.com>

* fix dependency chart axis updating with incorrect values in explanation dashboard (#1437)

* fix codecov and widget test screenshot uploads (#1428)

* release raiwidgets and responsibleai v0.18.2 (#1439)

* fix (#1441)

Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com>

* Fix cohort name conflict and not run few tests for AML (#1442)

* fix

Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com>

* lintfix

Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com>

* Few e2e tests changes to accommodate AML static tests (#1445)

* update

Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com>

* update

Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com>

* Fix locators logic for string features -  data explorer and model statistics components (#1446)

* update

Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com>

* update

Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com>

* fix

Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com>

* update

Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com>

* lintfix

Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com>

* fix

Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com>

* Add more unittests RAI dashboard input class  (#1448)

* Add unit tests for ResponsibleAIDashboardInput

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Add more tests

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Fix imports

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Address code review comments

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Update the way to get the length of elements obtained in e2e tests (#1450)

* update

Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com>

* update

Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com>

* skip what-if create tests for AML

Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com>

* update cf predicted class to non-editable text

Co-authored-by: Ilya Matiach <ilmat@microsoft.com>
Co-authored-by: Roman Lutz <romanlutz13@gmail.com>
Co-authored-by: Gaurav Gupta <47334368+gaugup@users.noreply.github.com>
Co-authored-by: xuke444 <40614413+xuke444@users.noreply.github.com>
Co-authored-by: Richard Edgar <riedgar@microsoft.com>
Co-authored-by: Vinutha Karanth <vinutha.karanth@gmail.com>

* document e2e-widget options in CONTRIBUTING.md and flightCombinations in e2e-widget.js

* lintfix

* fix torch bytetensor input type

* torch manual seed instead of set_rng_state

* modularize e2e-widget script and propagate changes into github actions workflow, remove postbuild triggers, split pipeline into two

* fix pipeline naming

* remove commas

* remove erroneous comma

* single quotes

* rename folder

* CensusClassificationModelDebugging -> CensusClassificationModelAssessment

* ignore csv files

* clean up remaining renaming operations from debugging -> assessment

* update CONTRIBUTING.md, use flighting data, add adjustments for binary classification

* diabetes decision making notebook updates to tests

* rename test folder to match notebook name, add housing decision making test cases

* add multiclass dnn model debugging test case

* lintfix

* merge follow-up

* lintfix

* notebook and test case naming: assessment -> debugging

* lintfix

* fix test data accessors, lintfix

* fix heatmap cell test

* use lodash

* lintfix

* delete spec files that aren't required

* simplify modelAssessmentDatasets.ts using lodash

* make e2e-widget.js work with empty -f arg

* add error throwing back

* move id inside component and remove extra div

* lintfix

* adjust for aria-label in regression case

* add multiclass aria-label

* lintfix

* lintfix

Co-authored-by: Ilya Matiach <ilmat@microsoft.com>
Co-authored-by: Gaurav Gupta <47334368+gaugup@users.noreply.github.com>
Co-authored-by: xuke444 <40614413+xuke444@users.noreply.github.com>
Co-authored-by: Richard Edgar <riedgar@microsoft.com>
Co-authored-by: Vinutha Karanth <vinutha.karanth@gmail.com>
Co-authored-by: tongy-msft <91754176+tongyu-microsoft@users.noreply.github.com>
2022-06-24 00:51:07 -04:00
Roman Lutz 75afdc5e2f
Split raiwidgets/e2e-notebooks test pipeline in two (#1478)
* split pipeline in two

* remove old pipeline

* remove torch install, flights

* add e2e-widget adjustments to run individual notebooks, make naming uniform between tests and notebooks

* lintfix

* store UI build artifact to avoid redundant builds

* lintfix

* add node back since we run a JS script

* add yarn and yarn install

* lintfix

* add macos todo note

* add CONTRIBUTING update

* add --ignore-installed for requirements-dev.txt on macos to avoid certifi issue
2022-06-15 21:04:15 -04:00
Vinutha Karanth 29ed9fc81b
add tests (#1199) 2022-02-09 18:00:48 -05:00
Vinutha Karanth 7e0efa40ab
[E2E] Feature importance - responsibleaidashboard-diabetes-decision-making.ipynb (#1137)
* add notebook

* add agg tests

* individual FI

* lint fix
2022-01-14 20:47:41 +00:00
Vinutha Karanth b860c5e785
[E2E] All e2e tests for responsibleaidashboard-housing-classification-model-debugging notebook (#1134)
* add agg tests

* add individual feature tets

* add de tests

* add what-if tests

* add modelStatistics tests

* add causal tests

* lintfix
2022-01-13 20:56:55 +00:00
Vinutha Karanth 26cc2e4fe8
[E2E] Feature Importance - Aggregate feature importance (#1111)
* update

* add tests

* notebook changes

* update
2022-01-07 20:24:24 +00:00
Ilya Matiach bfc9b8e47e
update notebook tests for new notebooks (#1066) 2021-12-06 20:53:39 -05:00
Ilya Matiach c32ae435fc
rename ModelAnalysisDashboard to ResponsibleAIDashboard (#1028) 2021-11-19 22:46:48 -05:00
xuke444 2214bc7fd4
Xuke/adde2e (#982)
* add e2e for widget notebook
2021-10-30 00:37:32 -07:00
Ilya Matiach eb11a3fcfc
rename package and top level class (#476) 2021-04-30 15:27:57 -04:00
xuke444 a76890215b
add log for tag (#462)
Signed-off-by: Ke Xu <xuke@microsoft.com>
2021-04-21 23:58:14 -07:00
Ilya Matiach 776dc984b9
initial shell implementation of the raitools package (#427)
* initial shell implementation of the raianalysis package

* fix 403 forbidden on brew install
2021-04-12 16:42:42 -04:00
xuke444 9f978777a1
add tag option to auto version and release (#394)
* add tag option to auto version and release

Signed-off-by: Ke Xu <xuke@microsoft.com>

* fix format

Signed-off-by: Ke Xu <xuke@microsoft.com>
2021-03-26 13:12:32 -07:00
xuke444 e201bb2694
split test (#419)
* move file

Signed-off-by: Ke Xu <xuke@microsoft.com>

* split test

Signed-off-by: Ke Xu <xuke@microsoft.com>

* add copy test script

Signed-off-by: Ke Xu <xuke@microsoft.com>

* copy test file

Signed-off-by: Ke Xu <xuke@microsoft.com>
2021-03-26 09:37:19 -07:00
xuke444 15464d16ec
add email and name to git config in release pipeline to create tag (#372)
Signed-off-by: Ke Xu <xuke@microsoft.com>
2021-03-05 17:38:22 -08:00
xuke444 be7d246255
Xuke/fixpythonpublish (#366)
fix python publish version, by using commit sequence
2021-03-01 20:22:53 -08:00
xuke444 58d8b0962b
auto publish python (#363)
* auto publish python

Signed-off-by: Ke Xu <xuke@microsoft.com>

* add pr

Signed-off-by: Ke Xu <xuke@microsoft.com>

* fix typo

Signed-off-by: Ke Xu <xuke@microsoft.com>

* update command

Signed-off-by: Ke Xu <xuke@microsoft.com>

* fix format

Signed-off-by: Ke Xu <xuke@microsoft.com>

* change dir name

Signed-off-by: Ke Xu <xuke@microsoft.com>

* fix version

Signed-off-by: Ke Xu <xuke@microsoft.com>

* fix flow

Signed-off-by: Ke Xu <xuke@microsoft.com>

* fix build

Signed-off-by: Ke Xu <xuke@microsoft.com>

* fix flake8

Signed-off-by: Ke Xu <xuke@microsoft.com>

* rollback version

Signed-off-by: Ke Xu <xuke@microsoft.com>

* change name

Signed-off-by: Ke Xu <xuke@microsoft.com>

* change file name

Signed-off-by: Ke Xu <xuke@microsoft.com>

* remove dry run

Signed-off-by: Ke Xu <xuke@microsoft.com>
2021-03-01 12:00:05 -08:00
xuke444 e79b194e30
one version for js and python (#351)
* one version for js and python

Signed-off-by: Ke Xu <xuke@microsoft.com>

* remove package option

Signed-off-by: Ke Xu <xuke@microsoft.com>

* remove post

Signed-off-by: Ke Xu <xuke@microsoft.com>

* add version

Signed-off-by: Ke Xu <xuke@microsoft.com>

* Release v0.3.0.post214

* Release v0.3.0.post215

* Release v0.3.0.post216

Signed-off-by: Ke Xu <xuke@microsoft.com>

* change version

Signed-off-by: Ke Xu <xuke@microsoft.com>

* update version

Signed-off-by: Ke Xu <xuke@microsoft.com>

* add python to cd

Signed-off-by: Ke Xu <xuke@microsoft.com>

* rollback cd

Signed-off-by: Ke Xu <xuke@microsoft.com>

* fix flake 8

Signed-off-by: Ke Xu <xuke@microsoft.com>

* fix format

Signed-off-by: Ke Xu <xuke@microsoft.com>

* change dev version to 0.0.0

Signed-off-by: Ke Xu <xuke@microsoft.com>

* add comments

Signed-off-by: Ke Xu <xuke@microsoft.com>

* fix flake

Signed-off-by: Ke Xu <xuke@microsoft.com>
2021-02-24 19:12:05 -08:00
xuke444 494e13a34c
fix notebook by inline all scripts and data (#129)
inline scripts and data so it will for in jupyter and azure databricks.
extract common dashboard code to a separate dashboard class
2020-11-02 07:59:49 -08:00
xuke444 4b46a15e01
separate localization to extra package
* move localization

Signed-off-by: Ke Xu <xuke@microsoft.com>

* update reference

Signed-off-by: Ke Xu <xuke@microsoft.com>

* update reference

Signed-off-by: Ke Xu <xuke@microsoft.com>

* revert root dir

Signed-off-by: Ke Xu <xuke@microsoft.com>

* fix interpret

Signed-off-by: Ke Xu <xuke@microsoft.com>

* update fairlearn

Signed-off-by: Ke Xu <xuke@microsoft.com>

* add localization to publish

Signed-off-by: Ke Xu <xuke@microsoft.com>

* fix lint

Signed-off-by: Ke Xu <xuke@microsoft.com>

* update prettier ignore for rai static files

Signed-off-by: Ke Xu <xuke@microsoft.com>

* use english for not translated string

Signed-off-by: Ke Xu <xuke@microsoft.com>
2020-10-09 17:39:09 -07:00
Ke Xu d2f7f4903d
fix auto version
Signed-off-by: Ke Xu <xuke@microsoft.com>
2020-09-25 01:30:44 -07:00
xuke444 a974f4e247
Xuke/autoversion (#46)
Auto npm versioning to publish
2020-09-25 00:16:09 -07:00