Граф коммитов

334 Коммитов

Автор SHA1 Сообщение Дата
Ilya Matiach 8ee39df9da
pin pandas < 2.0.0 across all packages (#2021) 2023-04-03 18:38:53 -04:00
Ilya Matiach 4b5ce81f0c
update dependencies for rai-core-flask, raiwidgets and responsibleai packages (#2016) 2023-03-31 13:45:54 -04:00
Ilya Matiach 2dc957c7e6
try pickling model instead of failing based on state functions and change to UserConfigValidationException (#2014) 2023-03-29 16:53:42 -04:00
Gaurav Gupta fcb877d6fc
Add validations if target column is included in `FeatureMetadata` (#2013)
* Add validations if target column is included in FeatureMetadata

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Fix code review comments

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

---------

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>
2023-03-29 19:07:45 +00:00
Gaurav Gupta f87f22922a
Add validations for model predictions (#2008)
* Add validations for model predictions

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Add test

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Undo change

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Update notebooks for categorical features to pass through FeatureMetadata (#2011)

* Update responsibleaidashboard-diabetes-decision-making.ipynb

* Update responsibleaidashboard-census-classification-model-debugging.ipynb

* Update responsibleaidashboard-census-classification-model-debugging.ipynb

* Update responsibleaidashboard-diabetes-decision-making.ipynb

* Update responsibleaidashboard-diabetes-decision-making.ipynb

* Update responsibleaidashboard-diabetes-regression-model-debugging.ipynb

* Update responsibleaidashboard-census-classification-model-debugging.ipynb

* Update responsibleaidashboard-diabetes-decision-making.ipynb

* Update responsibleaidashboard-housing-classification-model-debugging.ipynb

* Update responsibleaidashboard-housing-classification-model-debugging.ipynb

* Update responsibleaidashboard-census-classification-model-debugging.ipynb

* Update responsibleaidashboard-diabetes-decision-making.ipynb

* Update responsibleaidashboard-diabetes-regression-model-debugging.ipynb

* Update responsibleaidashboard-housing-decision-making.ipynb

* Update responsibleaidashboard-multiclass-dnn-model-debugging.ipynb

* Update responsibleaidashboard-diabetes-decision-making.ipynb

* Update responsibleaidashboard-diabetes-regression-model-debugging.ipynb

* Update responsibleaidashboard-housing-classification-model-debugging.ipynb

* Update responsibleaidashboard-housing-decision-making.ipynb

* [Model Overview] Metrics Template support with OD-specific optional args (#2002)

* OD label support ckpt

* Surfaced OD metrics

* numLabels update

* lint fixes

* main fetch

* line end changes

* var fix

* ts lint fix

* lint autofixes

* Object Detection Model Overview Flask template (#2004)

* flask endpoint infra template

* docstring and lint fixes

* lint fixes

* lint fixes

* lint autofixes

* error statement fix

* Model Overview: Object Detection Widgets for Aggregate Methods, Class selection, & IoU Threshold (#1997)

* agg method & iou thresh widgets ckpt

* class selection widget

* widget option format fix

* comment fixes

* widget size & lint fixes

* semiclon lint fix

* od widget options refactor

* lint complexity fixes

* lint complexity fixes

* comment fixes

* refactor to reduce complexity

* complexity refactor

* lint fixes

* autolint fixes

* Address code review comments

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

---------

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>
Co-authored-by: tongy-msft <91754176+tongyu-microsoft@users.noreply.github.com>
Co-authored-by: Advitya Gemawat <agemawat@ucsd.edu>
Co-authored-by: Advitya Gemawat <agemawat@microsoft.com>
2023-03-23 22:27:42 +00:00
Advitya Gemawat a40e046487
[Model Overview] Metrics Template support with OD-specific optional args (#2002)
* OD label support ckpt

* Surfaced OD metrics

* numLabels update

* lint fixes

* main fetch

* line end changes

* var fix

* ts lint fix

* lint autofixes
2023-03-20 16:54:59 -04:00
Ilya Matiach bbb12fdae0
update raiwidgets and responsibleai to erroranalysis 0.4.2 (#2001) 2023-03-13 00:35:16 -04:00
Roman Lutz 6d4055f307
Support forecasting in RAIInsights (#1948)
* flake8

* isort

* flalke8

* wrap zip object with list

* use ModelTask from raiutils

* remove prints

* flake8

* isort

* use FORECASTING from raiutils.models

* isort

* fix sktime issue

* wrappers updates

* isort & flake8

* make predict_proba required for now

* docstrings

* small bugfix

* add property for data_balance
2023-03-03 19:01:25 +00:00
Gaurav Gupta 448309c90d
Create README.md for python tests (#1984)
* Create README.md

* Create README.md

* Create README.md

* Create README.md

* Create README.md

* Update erroranalysis/tests/README.md

Co-authored-by: Roman Lutz <romanlutz13@gmail.com>

* Fix code review comments

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

---------

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>
Co-authored-by: Roman Lutz <romanlutz13@gmail.com>
2023-02-25 04:25:41 +00:00
Gaurav Gupta 20018a819f
Update `raiutils` to 0.4.0 in `raiwidgets`, `responsibleai`, `nlp_feature_extractors` and `erroranalysis` (#1982)
Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>
2023-02-23 05:00:59 +00:00
Kashyap Patel 215df28213
[Bugfix] FeatureBalanceMeasures: skip computing measures for col if unique vals < 2 (#1980)
* [Bugfix] FeatureBalanceMeasures: skip computing measures for col if unique vals < 2

* Add unit tests to FeatureBalanceMeasures and DataBalanceManager for col < 2 unique vals
2023-02-22 11:03:14 -08:00
Gaurav Gupta 727786dab5
Add number of samples in large data in `meta.json` (#1976)
Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>
2023-02-22 01:14:02 +00:00
Ilya Matiach 8f7d17f2f9
update raiwidgets and responsibleai to erroranalysis 0.4.1 (#1969) 2023-02-14 12:51:02 -05:00
Gaurav Gupta 23cc0d8a4a
Migrate responsibleai tests to use utilities in rai_test_utils - Part 2 (#1956)
* Update requirements-dev.txt

* Update requirements-dev.txt

* Code changes with new rai_test_utils

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

---------

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>
2023-02-11 00:01:35 +00:00
Roman Lutz 7ef0054878
fixing strings (#1943) 2023-02-06 15:14:56 -05:00
Gaurav Gupta 0130b45cff
Migrate responsibleai tests to use utilities in rai_test_utils - Part 1 (#1937)
* Migrate responsibleai tests to use utilities in rai_test_utils - Part 1

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Add create_cancer_data

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* fix

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

---------

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>
Co-authored-by: Roman Lutz <romanlutz13@gmail.com>
2023-02-06 10:08:59 -08:00
Roman Lutz 3f4fdf3846
Deprecate categorical_features argument in favor of feature_metadata.categorical_features, improve metadata validation, and add forecasting-related metadata (#1934)
* feature metadata and categorical_features consolidation

* fix serialization of feature metadata

* fix tests

* flake8

* tests for feature metadata and cat features

* flake8

* fix string

* datetime_features and time_series_id_features replacement

* pytest.mark.skip

* remaining ts id col names fix

* fix failing test

* fix docstrings

* constants for feature purposes

* revert validation function name to original and fix docstring of other validation function

* flake8

* isort

* undo workaround in feature metadata validation code

* move feature metadata validation into a separate method

* flake8

* add constants for strings

* use set
2023-02-03 05:53:20 +00:00
Gaurav Gupta 0807da68e3
Remove duplicate load() and save() for large data (#1930)
* Remove duplicate load() and save() for large data

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Update CI-python.yml

* Update CI-python.yml

---------

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>
2023-02-01 03:33:48 +00:00
Gaurav Gupta e15a9d4fb5
Adding a limit on the number of samples used for computing global explanations (#1924)
* Adding a limit on the number of samples used for computing global explanations

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Increase the data limit to 10K

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

---------

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>
2023-01-28 01:43:38 +00:00
Roman Lutz 86af03289d
Unify responsibleai constants (#1925)
* use META_JSON directly instead of declaring a variable

* move constants to common files and reuse

* lowercase f

* isort

* use parentheses instead of backslashes

* flake8

* isort
2023-01-27 18:12:53 +00:00
tongy-msft 9d24ea2871
Fix model wrapper, remove task type from error analysis (#1912) 2023-01-17 15:37:39 -08:00
Ilya Matiach 04419236c5
update raiwidgets and responsibleai to erroranalysis 0.4.0 (#1910) 2023-01-17 13:57:40 -05:00
Gaurav Gupta 6c25ee28d2
Raise `UserConfigValidationException` when `treatment_feature` is empty list (#1904)
Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>
2023-01-13 23:39:56 +00:00
Kashyap Patel a635d6ddbf
Make `DataBalanceManager.compute()` throw warning instead of exception (#1902)
* Make DataBalanceManager.compute() throw warning instead of exception since it is enabled by default

* Lint fix

* Isort fix
2023-01-13 10:29:05 -08:00
Gaurav Gupta b75a59aa0b
Move import to top level from within the function (#1898)
Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>
2023-01-13 01:34:24 +00:00
Ilya Matiach 5343666b7f
update responsibleai to interpret-community 0.28.0 (#1879) 2023-01-09 12:05:04 -05:00
Gaurav Gupta 10d432f15e
Raise exception instead of logging warnings when model cannot be loaded (#1886)
Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>
2023-01-07 16:31:25 +00:00
Gaurav Gupta 502edf8388
Add test_data to `CounterfactualData` for large data scenario (#1885)
* Add test_data to `CounterfactualData` for large data scenario

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Add more assert conditions

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>
2023-01-07 06:20:45 +00:00
tongy-msft 012cfa2986
Add better error message if causal treatment features contain dropped features (#1868)
* Add better error message if causal treatment features contain dropped_features

* fix lint error

* fix ut failure

* fix build failure

* address comment

* fix build error

* revert change for cat_features

* remove unused test

* remove unused test
2023-01-05 22:52:16 -08:00
tongy-msft 9a46b6a3ac
Add better error message if all features are dropped from dataset (#1867)
* Add better error message if all features are dropped

* update error message

* address comments

* add test

* fix lint error

* address comments

* address comments

* remove unused test
2023-01-05 21:08:19 -08:00
Gaurav Gupta f2cdec69b6
Update `raiutils` in `raiwidgets`, `responsibleai`, `erroranalysis` and `nlp_feature_extractors` (#1873)
Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>
2023-01-06 04:13:21 +00:00
tongy-msft cbc5a7b18b
Remove warning for 'dropped_features are not in use currently.' (#1871)
* display tree branching decisions

* Remove warning for 'dropped_features are not in use currently.'
2023-01-03 12:01:01 -08:00
Gaurav Gupta 2a803f0ea5
Update requirements.txt in `raiwidgets` and `responsibleai` to pin numpy upper bound (#1864)
* Update requirements.txt

* Update requirements.txt
2022-12-20 16:16:58 -08:00
Ilya Matiach 5088482a43
fix loading older versions of RAIInsights due to _FEATURE_METADATA key error (#1857) 2022-12-16 15:32:16 -05:00
tongy-msft b17e7bb243
Enable dropped_features for error analysis, data explorer and explainer, counterfactual and causal managers (#1824)
* Add initial code for supporting dropped features

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Fix

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Fix causal path

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Validate counerfactual scenario

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Fix UI build

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Add postga build trigger (#1755) (#1756)

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Add model wrapper for wrapping predictions and test data (#1762)

* Add model wrapper for wrapping predictions and test data

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Fix failing tests

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Change description of cohort selection panel in Aggregate Feature Importance (#1770)

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Support cohort filtering of string target in rai_insights (#1771)

* Port tests

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Fix rai_insights

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Simplify tests in test_cohort_filter.py (#1772)

* Simply tests in test_cohort_filter.py

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Change test name

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Move cohort re-labelling logic to Cohort.ts (#1773)

* Move cohort re-labelling logic to Cohort.ts

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Lint fix

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Lint fix

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Update requirements.txt (#1779)

* Refactor DataAnalysisTab into Chartview/DataAnalysisView and DataBalanceView (#1775)

* Refactor DataAnalysisTab into Chartview/DataAnalysisView and DataBalanceView

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Fix lint

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* [Highcharts] Enable csv download, xls download and view data table in highcharts (#1783)

* enable csv xls download in hightcharts

* localization

* Add new data APIs for compute_matrix() and compute_error_tree() (#1790)

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* update e2e visit function (#1792)

* Add rai_test_utils package (#1777)

* Add rai_test_utils package

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Lint fix and namespace changes

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Fix duplicated cohorts not retaining the selection in combobox (#1785)

* fix and e2e

Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com>

* update filter

Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com>

Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com>

* release raiwidgets and responsibleai 0.23.0 (#1787)

* fix release github action for raiwidgets and responsibleai by making it same as in gated build (#1788)

* Add e2e for dependency plot Avg of abs value option (#1768)

* fix dep plot

Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com>

* add e2e

Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com>

* lintfix

Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com>

* lintfix

Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com>

Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com>

* update e2e visit function (#1792)

* Fix code review comments

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>
Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com>
Co-authored-by: Vinutha Karanth <vinutha.karanth@gmail.com>
Co-authored-by: Ilya Matiach <ilmat@microsoft.com>
Co-authored-by: tongy-msft <91754176+tongyu-microsoft@users.noreply.github.com>

* sort fix (#1798)

Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com>

Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com>

* [LogarithmicScaling] Enable log scaling for data explorer, feature importance, counterfactual and casual (#1802)

* update checkbox to toggle in axis config panel

* support log toggle for counterfactual

* enable log scaling for feature importance

* enable log scaling for casual and data explorer

* address comment

* Update CODEOWNERS (#1805)

* Fix ‘Close button’ and ‘Spin button’ present in new cohort dialog does not have any title or aria-label (#1806)

* add aria label

Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com>

* address comment

Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com>

Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com>

* Update erroranalysis tests to use new rai_test_utils package (#1800)

* Update erroranalysis tests to use new rai_test_utils package

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Remove shap and xgboost from test requirements

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Pin rai_test_utils

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Fix Heatmap tooltip theme (#1808)

* fix tooltip color

Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com>

* fix theme

Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com>

* fix

Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com>

* rev

Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com>

Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com>

* Calculate RAI insights for first 5K samples (#1803)

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Add API for indicating large data scenario in ModelAssessmentContext (#1804)

* [WIP] Add APIs for indicating large data scenario in ModelAssessmentContext

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Change API name

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Add unit test

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Fix lint

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Fix lint again

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Add RAI version number to oss serialize result (#1812)

* Add RAI version number to oss serialize result

* update json file namg

* add test

* enable dropped_features for EA and explainer

* enable EA and explainer for classification

* remove unused comments

* revert notebook change

* revert notebook change

* revert notebook change

* revert causal cf changes

* refactor getFeatureNamesAfterDrop  to a common method

* address comments on modelWrapper

* update comments

* update index.ts

* remove unused variable

* fix lint error

* fix noneType error

* address comments

* fix a test error

* support cf and causal

* hide dropped_features for cf and causal

* fix undefined feature_metadata error

* fix undefined feature_metadata error

* fix wrong cf predict value

* fix undefined feature_metadata

* fix undefined feature_metadata

* address comments

* address comments

* fix feature_names test error

* fix _feature_metadata undefined

* fix failing test on undefined model

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>
Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com>
Co-authored-by: Gaurav Gupta <gaugup@microsoft.com>
Co-authored-by: Gaurav Gupta <47334368+gaugup@users.noreply.github.com>
Co-authored-by: Vinutha Karanth <vinutha.karanth@gmail.com>
Co-authored-by: Ilya Matiach <ilmat@microsoft.com>
2022-12-06 23:54:12 -08:00
Ilya Matiach 4c34d81b56
update raiwidgets and responsibleai to erroranalysis 0.3.13 (#1822) 2022-11-28 15:29:48 -05:00
Gaurav Gupta 23c98e34ff
Update requirements.txt (#1813) 2022-11-18 11:52:35 -08:00
Gaurav Gupta 6e0a3911e2
merge postga branch into main (#1815)
* Add postga build trigger (#1755) (#1756)

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Add model wrapper for wrapping predictions and test data (#1762)

* Add model wrapper for wrapping predictions and test data

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Fix failing tests

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Change description of cohort selection panel in Aggregate Feature Importance (#1770)

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Support cohort filtering of string target in rai_insights (#1771)

* Port tests

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Fix rai_insights

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Simplify tests in test_cohort_filter.py (#1772)

* Simply tests in test_cohort_filter.py

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Change test name

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Move cohort re-labelling logic to Cohort.ts (#1773)

* Move cohort re-labelling logic to Cohort.ts

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Lint fix

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Lint fix

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Update requirements.txt (#1779)

* Refactor DataAnalysisTab into Chartview/DataAnalysisView and DataBalanceView (#1775)

* Refactor DataAnalysisTab into Chartview/DataAnalysisView and DataBalanceView

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Fix lint

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* [Highcharts] Enable csv download, xls download and view data table in highcharts (#1783)

* enable csv xls download in hightcharts

* localization

* Add new data APIs for compute_matrix() and compute_error_tree() (#1790)

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* update e2e visit function (#1792)

* Add rai_test_utils package (#1777)

* Add rai_test_utils package

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Lint fix and namespace changes

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Fix duplicated cohorts not retaining the selection in combobox (#1785)

* fix and e2e

Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com>

* update filter

Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com>

Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com>

* release raiwidgets and responsibleai 0.23.0 (#1787)

* fix release github action for raiwidgets and responsibleai by making it same as in gated build (#1788)

* Add e2e for dependency plot Avg of abs value option (#1768)

* fix dep plot

Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com>

* add e2e

Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com>

* lintfix

Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com>

* lintfix

Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com>

Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com>

* update e2e visit function (#1792)

* Fix code review comments

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>
Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com>
Co-authored-by: Vinutha Karanth <vinutha.karanth@gmail.com>
Co-authored-by: Ilya Matiach <ilmat@microsoft.com>
Co-authored-by: tongy-msft <91754176+tongyu-microsoft@users.noreply.github.com>

* sort fix (#1798)

Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com>

Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com>

* [LogarithmicScaling] Enable log scaling for data explorer, feature importance, counterfactual and casual (#1802)

* update checkbox to toggle in axis config panel

* support log toggle for counterfactual

* enable log scaling for feature importance

* enable log scaling for casual and data explorer

* address comment

* Update CODEOWNERS (#1805)

* Fix ‘Close button’ and ‘Spin button’ present in new cohort dialog does not have any title or aria-label (#1806)

* add aria label

Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com>

* address comment

Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com>

Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com>

* Update erroranalysis tests to use new rai_test_utils package (#1800)

* Update erroranalysis tests to use new rai_test_utils package

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Remove shap and xgboost from test requirements

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Pin rai_test_utils

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Fix Heatmap tooltip theme (#1808)

* fix tooltip color

Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com>

* fix theme

Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com>

* fix

Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com>

* rev

Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com>

Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com>

* Calculate RAI insights for first 5K samples (#1803)

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Add API for indicating large data scenario in ModelAssessmentContext (#1804)

* [WIP] Add APIs for indicating large data scenario in ModelAssessmentContext

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Change API name

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Add unit test

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Fix lint

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Fix lint again

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Add RAI version number to oss serialize result (#1812)

* Add RAI version number to oss serialize result

* update json file namg

* add test

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>
Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com>
Co-authored-by: tongy-msft <91754176+tongyu-microsoft@users.noreply.github.com>
Co-authored-by: Vinutha Karanth <vinutha.karanth@gmail.com>
Co-authored-by: Ilya Matiach <ilmat@microsoft.com>
2022-11-18 08:26:01 -08:00
Ilya Matiach 24f3f227d5
update raiwidgets and responsibleai to erroranalysis 0.3.12 (#1786) 2022-10-24 11:47:01 -04:00
Gaurav Gupta fd233b30ff
Update requirements.txt (#1782) 2022-10-20 23:28:47 +00:00
Ilya Matiach 0b2ea5846d
update raiwidgets and responsibleai to erroranalysis 0.3.11 (#1767) 2022-10-07 17:40:42 -04:00
Gaurav Gupta be176374de
Add attributes 'outcome', 'feature' and 'feature_value' to causal global effects (#1750)
* Add attributes 'outcome', 'feature' and 'feature_value' to causal global output

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Fix imports

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>
2022-09-28 18:07:02 +00:00
Gaurav Gupta cd59ac2afc
responsibleai: Move tests into respective directories (#1746)
* responsibleai: Move tests into respective directories

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Fix lint

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>
2022-09-27 23:18:00 +00:00
Gaurav Gupta 3c7368c299
Add validations to catch empty train/test scenarios (#1749)
Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>
2022-09-27 20:42:10 +00:00
Ilya Matiach e574ec315f
fix flaky test test_rai_insights_add_save_load_save on dataset fetch (#1734) 2022-09-26 13:55:28 -04:00
Gaurav Gupta ac30fae15b
Raise exception in case categorical feature list doesn't have all string features (#1720)
* Raise exception in case categorical feature list doesn't have all string features

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Fix code review comments

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>
2022-09-19 18:12:34 +00:00
Gaurav Gupta 85d8c60bcc
Port over cohort filtering tests for 'Predicted Y' cohort to responsibleai (#1709)
* Port over cohort filtering tests for 'Predicted Y' cohort

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Fixed code review comments

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>
2022-09-15 18:33:06 +00:00
Gaurav Gupta 9f906b53da
Correct predict call to predict_proba (#1717)
Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>
2022-09-15 16:41:25 +00:00
Ilya Matiach 113488fd82
update raiwidget and responsibleai to erroranalysis 0.3.10 and interpret-community 0.27.0 (#1708) 2022-09-12 23:15:15 -04:00
Gaurav Gupta f3835bef02
Enable flake8-breakpoint and fix errors (#1705)
* Enable flake8-breakpoint and fix errors

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Move the error

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>
2022-09-13 02:53:14 +00:00
Gaurav Gupta 2705bea5ca
Reduce the train and test dataset sizes in responsibleai to reduce test time (#1630)
* Reduce the time taken by RAIInsights counterfactual tests

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Reduce the train and test dataset sizes in responsibleai to reduce test time

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Fix causal test

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Fix failing tests

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Fix tests

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>
2022-09-12 21:45:49 +00:00
Gaurav Gupta dd57f03223
Cache predict() and predict_proba() output (#1702)
* Cache predict() and predict_proba() output

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Fix broken tests

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Make error conditions same

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>
2022-09-12 18:45:23 +00:00
jamesbchao 32297b60c1
Vision dashboard cohorts (#1686)
* model assessment vision

* fixups

* fixups
2022-09-07 10:52:18 -04:00
jamesbchao f2c5babbc6
table view and initial flyout (#1668)
Co-authored-by: James Chao <t-jameschao@microsoft.com>
2022-08-29 00:54:37 -04:00
Gaurav Gupta 873ff446b2
[responsibleai]: Add tests for classification outcome (multiclass) and regression error (#1662)
Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>
2022-08-24 16:27:22 -07:00
Gaurav Gupta fb916fb5bf
Add validations for heterogeneity_features in causal manager (#1659)
* Add validations for heterogeneity_features in causal manager

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Fix tests

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Fix linting

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>
2022-08-23 00:24:41 +00:00
Gaurav Gupta e11b862a1f
Update econml to 0.13.1 (#1660) 2022-08-22 21:51:51 +00:00
Ilya Matiach 17cab36cf7
update raiwidgets and responsibleai to erroranalysis 0.3.9 (#1657) 2022-08-22 00:26:17 -04:00
Gaurav Gupta 14f95624c8
Enable validations for FeatureMetadata when passed into RAIInsights (#1651)
* Enable validations for FeatureMetadata when passed into RAIInsights

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Fix code review comments

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>
2022-08-20 00:28:26 +00:00
Ilya Matiach b899faf08e
fix failing RAI Insights test due to change in EA _string_ind_data type (#1658) 2022-08-19 16:04:09 -07:00
Gaurav Gupta 6c67f98e97
Fix docs in rai_base_insights.py (#1650)
Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>
2022-08-19 01:58:52 +00:00
Ilya Matiach da56bd10b5
update raiwidgets and responsibleai to erroranalysis 0.3.8 (#1629) 2022-08-11 14:09:25 -04:00
Gaurav Gupta 2d9f76ff9e
Reduce the time taken by RAIInsights counterfactual tests (#1622)
Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>
2022-08-11 04:13:15 +00:00
Gaurav Gupta 4c4365acc6
responsibleai: Remove old manager namespaces (#1564)
Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>
2022-08-09 04:56:31 +00:00
Gaurav Gupta 57884c5acf
Inject FeatureMetadata into RAIInsights (#1616)
* Inject FeatureMetadata into RAIInsights

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Add doc string

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>
2022-08-09 00:59:19 +00:00
Gaurav Gupta 46e04a056f
Add cohort filtering capability in RAIInsights class (#1618)
Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>
2022-08-08 19:32:26 +00:00
Gaurav Gupta a7a71793f7
Add categorical statistics computation in RAIInsights (#1598)
* Add categorical statistics computation in RAIInsights

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Fix failing test

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Use test dataset to compute catrogtical stats

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>
2022-08-05 20:05:27 +00:00
Gaurav Gupta ad739926ab
responsibleai: Add FeatureMetadata class and related tests (#1604)
* responsibleai: Add FeatureMetadata class and related tests

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Remove sensitive features

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>
2022-08-05 14:56:58 +00:00
Ilya Matiach 5c7de61c7b
add support for multiclass local importance values for text (#1601) 2022-08-02 15:48:25 -04:00
Ilya Matiach 5f221f793f
update raiwidgets and responsibleai to erroranalysis 0.3.6 (#1588) 2022-08-01 10:01:16 -04:00
Gaurav Gupta fcdf459654
Add backend functions in causal_manager.py to handle dashboard requests (#1579)
* Add backend functions in causal_manager.py to handle dashboard requests

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Fix code review comments

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>
2022-07-27 18:20:19 +00:00
Gaurav Gupta f8312f636b
Add backend functions in explainer_manager.py to handle dashboard requests (#1585)
* Add backend functions in explainer_manager.py to handle dashboard requests

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Fix imports

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Fix code review comments

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>
2022-07-27 00:08:20 +00:00
Gaurav Gupta d4c2d4e244
Add hierarchy to rai exceptions (#1568)
* Add hierarchy to responsibleai exceptions

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Add tests

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Fix code review comments

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>
2022-07-22 20:06:57 +00:00
Gaurav Gupta 5eae3bc90d
Enable skipped causal unit test (#1565)
* Enable skipped causal unit test

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Set explicit lower bound on econml

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>
2022-07-22 08:20:05 +00:00
Gaurav Gupta 9c1a5dc282
Add capability to compute counterfactuals per point (#1561)
* Add capability to compute counterfactuals per point

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Add docstring and schema validation

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Rename method

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Fix code review comments

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>
2022-07-18 14:15:32 -07:00
Gaurav Gupta 22ede533f9
Add ID to counterfactual config and serialized counterfactual data (#1553)
* Add ID to counterfactual config and serialized counterfactual data

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Fix linting

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Fix failing test

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>
2022-07-14 21:41:55 +00:00
Gaurav Gupta b210eb6c25
Fix bug in deserializing counterfactual explainer (#1554)
Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>
2022-07-14 09:08:16 -07:00
Ilya Matiach b1cf129fae
update packages to new raiutils 0.2.0 and rai-core-flask 0.4.0 releases (#1550) 2022-07-13 12:41:35 -04:00
Kashyap Patel 2f255875b5
Create DataBalanceManager + unit tests; clean up data balance conftest (#1485)
* Add DataBalanceAnalysis module to ResponsibleAI pkg

* Fix TestFeatureBalanceMeasures:test_adult_data to have deterministic row order (failing test in CI/CD)

* Add DataBalanceManager + unit tests

* isort fixes

* Update responsibleai/responsibleai/databalanceanalysis/data_balance_helper.py

Co-authored-by: Roman Lutz <romanlutz13@gmail.com>

* Update responsibleai/responsibleai/databalanceanalysis/data_balance_helper.py

Co-authored-by: Roman Lutz <romanlutz13@gmail.com>

* Update responsibleai/responsibleai/databalanceanalysis/data_balance_helper.py

Co-authored-by: Roman Lutz <romanlutz13@gmail.com>

* Update responsibleai/responsibleai/databalanceanalysis/data_balance_helper.py

Co-authored-by: Roman Lutz <romanlutz13@gmail.com>

* Update responsibleai/responsibleai/databalanceanalysis/data_balance_helper.py

Co-authored-by: Roman Lutz <romanlutz13@gmail.com>

* Update responsibleai/responsibleai/managers/data_balance_manager.py

Co-authored-by: Roman Lutz <romanlutz13@gmail.com>

* Rename synthetic data col constants, fix quotes in DataBalanceManager

* Add task_type to DataBalanceManager and check that task_type == classification

* helper -> utils, move methods to toplevel file

* Auto-add data balance measures

* Add categorical_features param check

* Feature Balance Measures: compute for every target_column value

* Fix isort imports

* Remove NaN -> None transform

* databalanceanalysis/conftest: Fix adult_data fixture, pass categorical_features to RAIInsights in unit tests

Co-authored-by: Roman Lutz <romanlutz13@gmail.com>
2022-07-12 12:26:16 -04:00
Ilya Matiach bb57dcc7ea
update raiwidgets and responsibleai to erroranalysis 0.3.4 (#1544) 2022-07-12 10:08:58 -04:00
Vinutha Karanth 6b6e1fb2b7
Add column and feature range meta data to meta file (#1541)
* add feature range meta data

Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com>

* update

Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com>

* update

Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com>

* put back lines

Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com>

* put back line

Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com>

* update

Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com>

* update

Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com>

* lint fix

Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com>

* lintfix

Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com>

* remove target column

Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com>

* lintfix

Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com>

* fix test

Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com>

* fix test

Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com>
2022-07-09 00:54:16 +00:00
Gaurav Gupta c5c5c8016a
Move references for serialize_json_safe() to raiutils (#1536)
Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>
2022-07-07 18:26:14 +00:00
Gaurav Gupta 064ada32a1
Move references for _convert_to_list() and _convert_to_string_list_dict() to raiutils (#1534)
* Move references for _convert_to_list and _convert_to_string_list_dict to raiutils

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Fix flake8 and isort errors

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>
2022-07-06 21:05:26 +00:00
Ilya Matiach 05945f8a65
update raiwidgets and responsibleai to latest erroranalysis 0.3.3 release (#1535) 2022-07-06 12:51:47 -04:00
Jan-Benedikt Jagusch 343c925db2
Add License and Requirements to Source Distribtion (#1522)
* Don't commit dist/ directory.

* Add license file to raiwidgets package.

* Include requirements.txt in package.

* Make same changes to raiutils package.

* Make same changes to rai_core_flask package.

* Make same changes to responsibleai package.

* Make same changes to erroranalysis package.

Co-authored-by: Roman Lutz <romanlutz13@gmail.com>
2022-07-05 13:08:46 -04:00
Ilya Matiach 785422eab2
add more docs to matrix filter aka heatmap in error analysis (#1489) 2022-06-16 13:24:28 -04:00
Gaurav Gupta c062d0d3e6
Update requirements.txt (#1499) 2022-06-15 19:48:51 +00:00
Gaurav Gupta bcd90ddd1f
Taking dependency on `is_classifier()` method and `SKLearn` constants class from `raiutils` (#1289)
* Moving _is_classifier() method and SKLearn class to raiutils

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Undo models.py change

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>
2022-06-15 00:37:00 +00:00
Ilya Matiach c3ac9f5bf4
update responsibleai package to latest interpret-community 0.26.0 (#1491) 2022-06-14 19:39:22 +00:00
Gaurav Gupta aa62536afa
Update counterfactual serialization via dice-ml APIs (#1479)
* Update counterfactual serialization via dice-ml APIs

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Fix linting

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>
2022-06-10 07:46:05 +00:00
Ilya Matiach 9c9fe1c0a1
update responsibleai to raiutils 0.1.0, raiwidgets and responsibleai to erroranalysis 0.3.2 (#1483) 2022-06-09 23:28:30 +00:00
Kashyap Patel 2de91d3bb9
Add DataBalanceAnalysis module to ResponsibleAI package to be consumed by visualizations (#1473)
* Add DataBalanceAnalysis module to ResponsibleAI pkg

* Fix TestFeatureBalanceMeasures:test_adult_data to have deterministic row order (failing test in CI/CD)
2022-06-09 14:20:37 -04:00
Gaurav Gupta e14cf09971
Update requirements.txt to pin dice-ml at 0.8 (#1470)
* [WIP] Update requirements.txt to pin dice-ml at 0.8

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Fix raiwidget tests

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>
2022-06-07 23:12:08 +00:00
Richard Edgar f7b2fc8307
Upper bound SciKit-Learn to address freeze in causal (#1432)
<!--- Provide a general summary of your changes in the Title above -->

## Description

Replaces #1429  to address #1430 . Causal analysis is getting stuck with the latest release of SciKit-Learn. This contains:

- Test case which gets stuck with SciKit-Learn 1.1.0
- Upper bound on SciKit-Learn in `requirements.txt`

## Checklist

<!--- Make sure to satisfy all the criteria listed below. -->

- [x] I have added screenshots above for all UI changes.
- [x] Documentation was updated if it was needed.
- [x] New tests were added or changes were manually verified.


Signed-off-by: Richard Edgar <riedgar@microsoft.com>
2022-05-17 15:27:50 -04:00
Gaurav Gupta 9441f9b37c
Add warning in counterfactual manager when unable to load explainer (#1412)
* Add warning in counterfactual manager when unable to load explainer

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Fix linting

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>
2022-05-10 04:12:11 +00:00
Gaurav Gupta c4271081e4
Handle the loading of causal models more gracefully (#1377)
* Handle the loading of causal models more gracefully

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Address code review commensts and fix test

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Fix code review comment

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>
2022-05-05 23:48:07 +00:00
Gaurav Gupta d6ff29de22
Cache and serialize the counterfactual explainer (#1374)
* Cache and serialize the counterfactual explainer

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Fix failing tests

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>
2022-04-27 22:36:31 +00:00
Gaurav Gupta e93af5270a
Rename _validate_model_analysis_input_parameters() to _validate_rai_insights_input_parameters (#1373)
Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>
2022-04-27 19:26:44 +00:00
Ilya Matiach 8f1afb00e4
move the root all data statistics to ErrorReport and ErrorAnalysisData (#1352) 2022-04-16 02:27:55 +00:00
Ilya Matiach d12630ecd1
update erroranalysis to 0.2.1 and remove some duplicate dependencies (#1334) 2022-04-15 18:58:03 +00:00