Граф коммитов

334 Коммитов

Автор SHA1 Сообщение Дата
Ilya Matiach ab28cd3fca
remove python 3.6 from builds, tests and packages (#2442) 2023-12-06 11:34:24 -05:00
Ilya Matiach d03329208f
fix build error due to changed exception messages and UCI repository (#2413)
expired certificate
2023-11-13 20:39:08 -05:00
Gaurav Gupta 4d8d9b76cd
Update requirements.txt to upgrade dice-ml to 0.11.0 (#2397)
* Update requirements.txt to upgrade dice-ml to 0.11.0

* Add test

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Fix tests

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

---------

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>
2023-10-30 20:35:38 +00:00
Advitya Gemawat 40af9df23b
Backend and OD Notebook Dataset fixes (#2360)
* pandas operation fix

* cohort fix

* windows test fix

* backend & dataset fixes

* reverted test file

* python lint fixes

* eslint updates

* auto lint fixes

* auto lint fixes

* test update

* removed file
2023-09-29 14:35:00 -04:00
Gaurav Gupta dafb5327f1
Remove unreachable branch in `test_rai_insights_save_and_load_scenarios.py` (#2343)
Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>
2023-09-28 08:13:14 +00:00
Advitya Gemawat a6ca894f4f
Detection info inside Object Detection Flyout (#2339)
* ckpt

* refactor + unit tests

* auto lint fixes

* ckpt

* od label UI ckpt

* od agg label working ckpt

* working backend

* UI update to remove pred label

* added UI tests

* lint fixes

* lint fixes

* MO test tweak for vision

* comment fixes

* comment fixes

* Flyout object update ckpt

* reverted MO changes

* mock data test fixes

* lint fixes

* lint fix

* auto lint fixes

* auto lint fixes
2023-09-21 10:58:51 -04:00
Gaurav Gupta e3cbcfd419
causal_manager.py: Move user config validation checks from compute() to add() (#2342)
Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>
2023-09-19 19:24:10 +00:00
Advitya Gemawat ce3beaa6d3
Error Labeling integration into Image Data Explorer for Agg Labels (#2334)
* ckpt

* refactor + unit tests

* auto lint fixes

* ckpt

* od label UI ckpt

* od agg label working ckpt

* working backend

* UI update to remove pred label

* added UI tests

* lint fixes

* lint fixes

* MO test tweak for vision

* comment fixes

* comment fixes

* auto lint fixes

* reverted MO test changes

* auto lint fixes
2023-09-18 17:48:08 -04:00
Roman Lutz 615d68e1fc
Forecasting: consume locally served model (#2319) 2023-09-09 12:59:40 -04:00
Gaurav Gupta a307b8db4e
Remove pins of flake8 linter packages (#2328)
Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>
2023-09-09 04:37:25 +00:00
Gaurav Gupta e0b8348140
Turn off flag `should_construct_pandas_query` in `PredictionsModelWrapperClassification` (#2277)
Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>
2023-08-25 03:25:22 +00:00
Ilya Matiach 070a2c2445
update responsibleai to interpret-community 0.30.0 (#2275) 2023-08-24 14:07:48 -04:00
Gaurav Gupta b06768f5e8
responsibleai: Add prediction wrapper to missing value tests (#2270)
* responsibleai: Add prediction wrapper to missing value tests

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Fix failing tests

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

---------

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>
2023-08-23 11:10:08 -07:00
Roman Lutz ef215504c2
Add forecasting to raiwidgets and add a forecasting notebook (#2252)
* Add postga build trigger (#1755) (#1756)

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Add model wrapper for wrapping predictions and test data (#1762)

* Add model wrapper for wrapping predictions and test data

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Fix failing tests

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Change description of cohort selection panel in Aggregate Feature Importance (#1770)

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Support cohort filtering of string target in rai_insights (#1771)

* Port tests

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Fix rai_insights

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Simplify tests in test_cohort_filter.py (#1772)

* Simply tests in test_cohort_filter.py

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Change test name

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Forecasting Dashboard

This commit adds the Forecasting Dashboard capabilities in both UI and SDK.

* remove unrelated file

* basic set of changes to get it working again

* forecasting_grains -> time_series_id_column_names

* fix breaking changes in latest main, add quantile prediction, fix date conversion, remove obsolete managers

* fix UI components (including table and what-if creation, chart still left tbd)

* get dashboard to work with multiple time series and switching back and forth

* remove data explorer and model overview, create and edit cohort functionalities from forecasting

* lintfix

* localizzation

* remove console.log

* remove question

* remove unrelated changes, fix package.json

* string fixes and package.json adjustment

* localization

* localization

* more localization and removing of unrelated files

* remove unrelated files

* remove unrelated file changes

* remove is_forecasting_true_y

* lintfix

* add dropdown label

* feature metadata input validation updates

* cache transformation predictions

* lintfix

* remove isUndefinedOrEmpty

* remove isUndefinedOrEmpty

* rename isAllDataCohort file as requested

* lintfix

* first draft of notebook

* get notebook to run, generate cohorts (not finished)

* ntoebook

* convert filter args and column names properly

* fix datetime handling

* fix forecast request handling

* working version for bug bash

* add wheels

* add UI changes

* update notebook to fix model download

* 15 iterations

* lintfix

* add example of operation method string

* add check for context

* add explanatory comment

* move description creation logic into getDescription

* lintfix

* remove datetime_features from snapshot

* lintfix and other weirdnesses

* undo print removal

* remove wheels, lintfix, small cleanup

* use META_JSON directly instead of declaring a variable

* move constants to common files and reuse

* lowercase f

* isort

* remove datetime_features

* sktime notebook (1st half)

* isort

* debugging the notebook issue

* use parentheses instead of backslashes

* flake8

* isort

* sktime progress

* pre-unified RAIInsights commit

* pre-unified RAIInsights commit 2

* first pass over unification

* unify RAIInsights and RAIForecastingInsights

* adjustments to serialization

* cleanup, test fixes, consolidation, TODO fixes

* fix tests

* isort

* flake8

* feature metadata and categorical_features consolidation

* fix serialization of feature metadata

* fix tests

* flake8

* tests for feature metadata and cat features

* flake8

* remove remnants of RAIForecastingInsights

* fix string

* move other utils back to rai insights

* undo ModelTask import changes

* undo ModelTask references to raiutils

* undo references to ModelTask in raituils

* remove raiutils changes since they're in a separate branch

* datetime_features and time_series_id_features replacement

* pytest.mark.skip

* furthe datetime_features fixes

* TS ID col name fix

* try out asfreq

* notebook try asfreq interpolation

* attempt to condense index into a single col

* add hidden feature flag, fix tests

* remove experimental file, isort

* undo string change

* restructure wrappers and field to file mapping code

* remove unnecessary TODO

* get AML notebook to work

* get AML notebook fully working

* resolve some issues with sktime

* notebook

* remove duplicated test case

* flake8

* isort

* flalke8

* wrap zip object with list

* use ModelTask from raiutils

* remove prints

* flake8

* isort

* use FORECASTING from raiutils.models

* isort

* fix sktime issue

* get past Python errors

* fix predictions array shape

* fix UI-Python mismatch with renamed time and time series ID column names (now called "features")

* lintfix

* undo changes that aren't needed any longer

* remove AML notebook

* update notebook by removing unnecessary content

* notebook tests, basic setup

* ids for tests

* fix notebook based on latest changes in the repo

* add test for adding a what if case

* flake8 and cleanup

* isort

* lintfix

* fix test

* move notebook

* fix nb path

* fix kernelspec

* add pmdarima dependency

* skip forecasting notebook on py 3.6

* remove commented out line

* skip explanation

* add reason kw arg name

* lintfix

* fix case for vision, text

* fix syntax error

* fix python version comparison since it doesn't work with <=

---------

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>
Co-authored-by: Gaurav Gupta <47334368+gaugup@users.noreply.github.com>
Co-authored-by: Gaurav Gupta <gaugup@microsoft.com>
Co-authored-by: John Wang <t-wangjohn@microsoft.com>
2023-08-22 23:46:08 -04:00
Gaurav Gupta cd1ab77a72
Tabular Only: Address missing values as per each manager in responsibleai (#2263)
* Address missing values are per each manager in responsibleai

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Fix tests

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Address code review comments

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Fix docstring

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* fix linting

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

---------

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>
2023-08-22 22:53:14 +00:00
Ilya Matiach 14808955a3
update responsibleai and raiwidgets to erroranalysis 0.4.5 (#2264) 2023-08-22 10:38:04 -04:00
Ilya Matiach 376cc82a44
fix RAI explanation error for dropped categorical features after serialization (#2261) 2023-08-21 11:39:09 -04:00
Roman Lutz f07d675379
RAIInsights: prevent failures on optional methods & fix feature range formatting for timestamps (#2258)
* fix optional method validation

* strftime

* fix optional method handling

* error handling in model outputs method

* small change to avoid try except

* lintfix

* add tests for optional/required methods being present or not and succeeding/failing

* constant for time format
2023-08-18 20:14:45 -04:00
Advitya Gemawat c83a145546
OD model type support in responsibleai for EA (#2230)
* ea changes

* added unit test

* OD model & data ckpt

* test fix

* torch dependency

* removed 3.6 from PR gate

* removed 3.6 from PR gate

* test fix

* import fixes

* str format fix

* test update

* revert unneeded changes

* test ckpt

* image utils

* reverted test

* test reverts

* reverted rai test utils

* test fix

* lint fixes

* enum fixes

* reverting rai insight

* added classes & model task

* reverted change
2023-08-17 09:57:14 -04:00
Gaurav Gupta 2c9899fe33
Pass categorical features after dropping dropped features in CounterfactualManager (#2241)
It seems we are passing categorical_features without dropping the dropped features from it.
2023-08-16 23:45:37 +00:00
Gaurav Gupta 961a73b4cf
Update explainer_manager.py to change docs from MimicWrapper to MimicExplainer (#2240) 2023-08-16 19:16:09 +00:00
Gaurav Gupta cd2502a459
Move missing value validations before unique value validations (#2228)
Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>
2023-08-11 11:01:56 -07:00
Gaurav Gupta 9908fc473e
Add input type validation for FeatureMetadata class (#2218)
* Add input type validation for FeatureMetadata class

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Update responsibleai/responsibleai/feature_metadata.py

Co-authored-by: Roman Lutz <romanlutz13@gmail.com>

---------

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>
Co-authored-by: Roman Lutz <romanlutz13@gmail.com>
2023-08-10 00:30:10 +00:00
Gaurav Gupta 5eced64b5f
Change `ValueError` to `UserConfigValidationException` in casual_manager.py (#2209)
* Change `ValueError` to `UserConfigValidationException`

The `ValueError` being raised is asking user to update the configuration. So this should be `UserConfigValidationException`.

* Fix failing test and linting

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

---------

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>
2023-08-09 20:01:29 +00:00
Ilya Matiach e68fde8293
release scikit-learn upper bound in responsibleai package (#2173) 2023-08-02 13:51:39 -04:00
Ilya Matiach 9bfd7801c8
add base values and importances for ending tokens to QA explanations (#2178) 2023-07-12 12:25:59 -04:00
hawestra 0d5e41a38e
raise error instead of warning when a user has missing data and add c… (#2143)
* raise error instead of warning when a user has missing data and add check for train data in addition to test

* address comments
2023-07-05 17:19:20 -07:00
Ilya Matiach 8b059d6f5d
fix build failures due to new joblib 1.3.0 release failing on windows with python 3.7 (#2155) 2023-06-29 10:53:45 -04:00
hawestra 234c439411
add validation target column type in the classification scenario (#2127)
* add validation for the classification scenario when a user input a float-type target column

* use is_float_dtype

* add check if the float can be converted to integer
2023-06-27 13:20:16 -07:00
Gaurav Gupta af9b099054
Update dice-ml to 0.10.0 (#2145)
* Update dice-ml to 0.10.0

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Fix lint

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Fix failing test

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

---------

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>
2023-06-26 23:18:38 +00:00
Advitya Gemawat f55e4be135
[Image Explorer] CanvasTools Image Loading support for Object Detection (#2097)
* bbox vott template ckpt

* canvastools image load ckpt

* loading image from scratch ckpt

* canvastools image loading support

* coordinate fixes

* regiondata call + path fix

* code cleanup

* image loading ckpt

* callback image loading support

* lint fixes

* disabling internal imports for vott

* file refactor lint fix

* auto lint fixes

* lint fixes

* image dims arg for frontend bbox

* lint fixes

* lint fixes

* image dimension support

* canvas module added

* comment fix

* async image loading support

* lint fixes

* lint fixes

* max-lines lint fixes

* lint fixes
2023-06-13 18:07:13 -04:00
Ilya Matiach 7307a16cc9
update econml to latest 0.14.1 release (#2112) 2023-06-12 16:49:57 -04:00
Gaurav Gupta 99706a146c
Update rai_test_utils in erroranalysis and responsibleai to 0.3.0 (#2111)
* Update rai_test_utils in erroranalysis and responsibleai to 0.3.0

* Update requirements-dev.txt
2023-06-12 10:10:55 -07:00
Ilya Matiach d86525ff00
update responsibleai and raiwidgets to erroranalysis 0.4.4 (#2107) 2023-06-09 15:08:15 -04:00
tongy-msft 069c0a44b4
Fix dimension mismatch error when dropped_features contains cat_features (#2099)
* fix error when dropped_features contains cat_features

* fix lint

* add tests

* add tests

* fix UT error
2023-06-08 19:20:48 -07:00
Gaurav Gupta 3952cbd1fd
Port over logic of `load_adult_income_dataset` from `dice-ml` to unblock gates (#2106)
* Port over logic of `load_adult_income_dataset` from `dice-ml` to unblock gates

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Fix linting and add TODO

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Add fixture for dataset fetch

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

---------

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>
2023-06-08 22:32:40 +00:00
kicha0 cde413c074
Raise value error for min max computation of feature range (#2072)
* Raise value error for min max computation of feature range

* Update rai_insights.py

* Add test

* Update test name

* Update formatting

* Update exception type

* Update test for new exception type

* Update formatting
2023-06-03 01:05:11 +00:00
Gaurav Gupta b2d98f82a2
Add user feedback to compute() function (#697)
* Add user feedback to compute()

* ADd user feedback to compute(

* Add log wrapper

* Fix explanations

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Fix imports

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

---------

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>
2023-05-30 22:29:39 +00:00
Gaurav Gupta d6d88694ab
Add dataset metadata to `IDataset` (#2071)
* Add dataset metadata to `IDataset`

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Fix tests

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

---------

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>
2023-05-22 21:18:55 +00:00
Gaurav Gupta e398f5a396
Use `is_valid_uuid` from `rai_test_utils` (#2069)
Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>
2023-05-19 07:14:46 +00:00
Gaurav Gupta 8aedc09fb7
Raise warning in case the test data has missing values (#2065)
* Raise warning in case the test data has missing values

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Fix linting

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Fix tests

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

---------

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>
2023-05-18 22:39:07 +00:00
Gaurav Gupta 6f4f38bbc9
Update requirements-dev.txt in `responsibleai` and `erroranalysis` with `rai_test_utils` 0.2.0 (#2067)
* Update requirements-dev.txt in 'responsibleai' and `erroranalysis` with `rai_test_utils` 0.2.0

* Update requirements-dev.txt
2023-05-18 19:34:15 +00:00
Ilya Matiach 92c9dd6f3e
fix build failures by pinning statsmodels to older version due to numpy incompatibility (#2053) 2023-05-05 14:21:19 -04:00
Gaurav Gupta 7a2414727a
Referencing `UserConfigValidationException` from `raiutils` instead of `responsibleai` (#1932)
* Referencing `UserConfigValidationException` from `raiutils` instead of `responsibleai`

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Fix tests

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

* Fix linting

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

---------

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>
2023-04-28 00:32:41 +00:00
Gaurav Gupta 9be0b9e59e
Usecohort filter constatns from erroranalysis in tests (#2047)
Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>
2023-04-27 17:50:37 +00:00
Ilya Matiach 8255c129f8
update responsibleai and raiwidgets to erroranalysis 0.4.3 (#2045) 2023-04-26 11:03:56 -04:00
Gaurav Gupta 0b950af61c
responsibleai: Add test case for dataset having boolean features (#2042)
Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>
2023-04-22 22:26:53 -07:00
Gaurav Gupta 409e99aa87
Add 3.10 classifier for python packages (#2035)
* Add 3.10 classifier for python packages

* Update setup.py

* Update setup.py

* Update setup.py

* Update setup.py

* Update setup.py

* Update README.md

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>

---------

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>
2023-04-21 19:36:22 +00:00
Ilya Matiach 5c8671bb31
make train data optional on RAIBaseInsights class (#2029) 2023-04-21 13:44:31 -04:00
Ilya Matiach 01254e37fd
update responsibleai to interpret-community 0.29.0 (#2031) 2023-04-13 12:51:13 -04:00