microsoft
/
MLOS
зеркало из https://github.com/microsoft/MLOS.git
1
0
Форкнуть 0
Код Задачи Пакеты Проекты Релизы Вики Активность
MLOS/conda-envs/mlos-3.10.yml

41 строка
828 B
YAML
Исходник Обычный вид История

Rename the conda env (#319) * rename the conda env, which serves mlos_bench as much as mlos_core now, to just "mlos" * add rename to the docker container - pulled from #313
2023-04-28 22:13:41 +03:00
name: mlos-3.10
Merged PR 860: Various Build Fixups - add nightly builds so we can catch issues with upstream changes sooner - allow reading conda envs out of the environment - handle only setting one of CONDA_EXPERIMENTAL_SOLVER and CONDA_SOLVER envs - adjust conda envs to avoid python 3.11 for now - adjust Makefile to use the same version of python from the current CONDA_ENV for our test environment (this is quick way to respect that version constraint and only specify it in one place) - adjust the expected version of configspace - remove configspace from conda env file (upstream doesn't have the version we need outside of conda-forge) - move all other version restrictions to setup.py files - add a 'full' mode for installing all extra_requires for each package - use that in the conda envs instead Related to additional build/test issues discovered in !850
2023-01-31 02:49:26 +03:00
channels:
- defaults
dependencies:
Merged PR 903: Combination of additional build and doc fixups This PR was originally aimed at just fixing the intermittent documentation build errors. That issue ultimately stems from conflicts between conda and pip installs of two different versions of `mistune` dependency. Along the way I found a handful of other improvements for build, pipeline, and documentation generation things. - Make sure we do the nightly build regardless of whether code has changed - Don't build the docs in parallel by default (trying to avoid an intermittent build failure) - Add basic support for testing devcontainer manually outside for vscode - Stop doing parallel builds so it's easier to debug, and move doc build/publishing to the devcontainer - Split windows conda env off, stop using gpy from conda-forge, and just build it locally with clang, gcc, or msvc - Adjust the devcontainer build so that more dependencies are built upfront during the container build. This makes the process more cacheable so that we can just pull the upstream version and not have to build as much locally which could delay first launch. - Import part of a fix from elsewhere - Switch to docker-compose style devcontainer that automatically also starts an nginx container for viewing the generated docs - Update some docs and doc building - [X] pydocstyle fixups - [X] Add some log filtering of the `make doc` output for easier debugging (e.g. don't care about missing examples for now) - [X] doc link lint checks - DONE - [X] Split this out into multiple PRs - [X] SpaceAdapterFactory: !959 - [X] docstyle fixups: !960 - [ ] doc build fixups - [ ] devcontainer improvements (leaving the last two as this PR)
2023-02-27 08:42:22 +03:00
# Basic dev environment packages.
# All other dependencies for the mlos modules come from pip.
Merged PR 860: Various Build Fixups - add nightly builds so we can catch issues with upstream changes sooner - allow reading conda envs out of the environment - handle only setting one of CONDA_EXPERIMENTAL_SOLVER and CONDA_SOLVER envs - adjust conda envs to avoid python 3.11 for now - adjust Makefile to use the same version of python from the current CONDA_ENV for our test environment (this is quick way to respect that version constraint and only specify it in one place) - adjust the expected version of configspace - remove configspace from conda env file (upstream doesn't have the version we need outside of conda-forge) - move all other version restrictions to setup.py files - add a 'full' mode for installing all extra_requires for each package - use that in the conda envs instead Related to additional build/test issues discovered in !850
2023-01-31 02:49:26 +03:00
- pip
- pylint
- pycodestyle
Merged PR 960: pydocstyle fixups pydocstyle fixups
2023-02-25 04:07:34 +03:00
- pydocstyle
devcontainer style improvements (#358) * Disable line buffering * fail pylint checks on unused-import errors * make sure pycodestyle checks for indentation * increase code quality requirements * add some new extensions * bring pycodestyle checks inline with flake8 * add a prettier rc that instructs it to use our editorconfig --------- Co-authored-by: Sergiy Matusevych <sergiym@microsoft.com>
2023-05-16 01:19:20 +03:00
- flake8
Merged PR 860: Various Build Fixups - add nightly builds so we can catch issues with upstream changes sooner - allow reading conda envs out of the environment - handle only setting one of CONDA_EXPERIMENTAL_SOLVER and CONDA_SOLVER envs - adjust conda envs to avoid python 3.11 for now - adjust Makefile to use the same version of python from the current CONDA_ENV for our test environment (this is quick way to respect that version constraint and only specify it in one place) - adjust the expected version of configspace - remove configspace from conda env file (upstream doesn't have the version we need outside of conda-forge) - move all other version restrictions to setup.py files - add a 'full' mode for installing all extra_requires for each package - use that in the conda envs instead Related to additional build/test issues discovered in !850
2023-01-31 02:49:26 +03:00
- setuptools
Automatic versioning support (#278) * adding configs to be able to use bumpversion for managing versions * Bump version: 0.0.4 → 0.1.0 * cleanup old file * don't need to reinstall licenseheaders everytime if we include it in the conda env * github actions checks out in shallow mode which setuptools-scm doesn't like, but doesn't cause issues, so we ignore the warning
2023-03-21 01:46:06 +03:00
- setuptools-scm
Merged PR 860: Various Build Fixups - add nightly builds so we can catch issues with upstream changes sooner - allow reading conda envs out of the environment - handle only setting one of CONDA_EXPERIMENTAL_SOLVER and CONDA_SOLVER envs - adjust conda envs to avoid python 3.11 for now - adjust Makefile to use the same version of python from the current CONDA_ENV for our test environment (this is quick way to respect that version constraint and only specify it in one place) - adjust the expected version of configspace - remove configspace from conda env file (upstream doesn't have the version we need outside of conda-forge) - move all other version restrictions to setup.py files - add a 'full' mode for installing all extra_requires for each package - use that in the conda envs instead Related to additional build/test issues discovered in !850
2023-01-31 02:49:26 +03:00
- jupyter
- ipykernel
- nb_conda_kernels
- matplotlib
- seaborn
Add some additional conda dependencies to build wheels (#519) Fixes some uncached rebuild issues that are holding up some other PRs.
2023-09-29 01:25:02 +03:00
- swig
- libpq
Merged PR 860: Various Build Fixups - add nightly builds so we can catch issues with upstream changes sooner - allow reading conda envs out of the environment - handle only setting one of CONDA_EXPERIMENTAL_SOLVER and CONDA_SOLVER envs - adjust conda envs to avoid python 3.11 for now - adjust Makefile to use the same version of python from the current CONDA_ENV for our test environment (this is quick way to respect that version constraint and only specify it in one place) - adjust the expected version of configspace - remove configspace from conda env file (upstream doesn't have the version we need outside of conda-forge) - move all other version restrictions to setup.py files - add a 'full' mode for installing all extra_requires for each package - use that in the conda envs instead Related to additional build/test issues discovered in !850
2023-01-31 02:49:26 +03:00
- python=3.10
Rename the conda env (#319) * rename the conda env, which serves mlos_bench as much as mlos_core now, to just "mlos" * add rename to the docker container - pulled from #313
2023-04-28 22:13:41 +03:00
# See comments in mlos.yml.
Merged PR 903: Combination of additional build and doc fixups This PR was originally aimed at just fixing the intermittent documentation build errors. That issue ultimately stems from conflicts between conda and pip installs of two different versions of `mistune` dependency. Along the way I found a handful of other improvements for build, pipeline, and documentation generation things. - Make sure we do the nightly build regardless of whether code has changed - Don't build the docs in parallel by default (trying to avoid an intermittent build failure) - Add basic support for testing devcontainer manually outside for vscode - Stop doing parallel builds so it's easier to debug, and move doc build/publishing to the devcontainer - Split windows conda env off, stop using gpy from conda-forge, and just build it locally with clang, gcc, or msvc - Adjust the devcontainer build so that more dependencies are built upfront during the container build. This makes the process more cacheable so that we can just pull the upstream version and not have to build as much locally which could delay first launch. - Import part of a fix from elsewhere - Switch to docker-compose style devcontainer that automatically also starts an nginx container for viewing the generated docs - Update some docs and doc building - [X] pydocstyle fixups - [X] Add some log filtering of the `make doc` output for easier debugging (e.g. don't care about missing examples for now) - [X] doc link lint checks - DONE - [X] Split this out into multiple PRs - [X] SpaceAdapterFactory: !959 - [X] docstyle fixups: !960 - [ ] doc build fixups - [ ] devcontainer improvements (leaving the last two as this PR)
2023-02-27 08:42:22 +03:00
#- gcc_linux-64
Merged PR 860: Various Build Fixups - add nightly builds so we can catch issues with upstream changes sooner - allow reading conda envs out of the environment - handle only setting one of CONDA_EXPERIMENTAL_SOLVER and CONDA_SOLVER envs - adjust conda envs to avoid python 3.11 for now - adjust Makefile to use the same version of python from the current CONDA_ENV for our test environment (this is quick way to respect that version constraint and only specify it in one place) - adjust the expected version of configspace - remove configspace from conda env file (upstream doesn't have the version we need outside of conda-forge) - move all other version restrictions to setup.py files - add a 'full' mode for installing all extra_requires for each package - use that in the conda envs instead Related to additional build/test issues discovered in !850
2023-01-31 02:49:26 +03:00
- pip:
Autopep8 devcontainer fixups (#472) The recommended autopep8 extension doesn't seem to be working for us: https://github.com/microsoft/vscode-autopep8/issues/16 So, for now I'm reverting to the old way of doing things. Also, the previous extension relied on a newer version of autopep8 than conda was installing anyways, so I switched to installing it from pip.
2023-08-04 01:35:57 +03:00
- autopep8>=1.7.0
Automatic versioning support (#278) * adding configs to be able to use bumpversion for managing versions * Bump version: 0.0.4 → 0.1.0 * cleanup old file * don't need to reinstall licenseheaders everytime if we include it in the conda env * github actions checks out in shallow mode which setuptools-scm doesn't like, but doesn't cause issues, so we ignore the warning
2023-03-21 01:46:06 +03:00
- bump2version
mlos_bench config json schema validation: optimizers and tunable_values (#340) This PR introduces initial json schemas for mlos_bench optimizer configs and tunable_values configs, their validation at load time, and tests for both. Future PRs will handle other config types. See Also: #331
2023-05-16 00:30:36 +03:00
- check-jsonschema
Automatic versioning support (#278) * adding configs to be able to use bumpversion for managing versions * Bump version: 0.0.4 → 0.1.0 * cleanup old file * don't need to reinstall licenseheaders everytime if we include it in the conda env * github actions checks out in shallow mode which setuptools-scm doesn't like, but doesn't cause issues, so we ignore the warning
2023-03-21 01:46:06 +03:00
- licenseheaders
Stricter mypy typing for mlos_core (#305) * force function definitions to have type decorations * type annotations * ignore errors on listening to port 81 from 127.0.0.1 so we can run two devcontainer instances at a time * more type check fixups * ignore missing matplotlib stubs * more typing * spelling * annotate test functions * spelling * types * spelling * more typing * more typing fixups * more strict * more typing fixups * fixups * more * spaces * merge conflict fixups * more merge conflicts * fixup * back that change out * minor tweaks for unimplemented function * fixups for py 3.89 * fixups for newer version of mypy * minor tweaks to dmypy script * update --------- Co-authored-by: Sergiy Matusevych <sergiym@microsoft.com>
2023-04-18 00:01:27 +03:00
- mypy
mypy type checking support for mlos_core (mlos_bench to follow later) (#301) * mypy type checking support for mlos_core (mlos_bench to follow later)
2023-04-12 19:11:58 +03:00
- pandas-stubs
Add more mypy type stubs to the conda env (#534)
2023-10-11 00:30:58 +03:00
- types-beautifulsoup4
mlos_bench config json schema validation: optimizers and tunable_values (#340) This PR introduces initial json schemas for mlos_bench optimizer configs and tunable_values configs, their validation at load time, and tests for both. Future PRs will handle other config types. See Also: #331
2023-05-16 00:30:36 +03:00
- types-colorama
Add more mypy type stubs to the conda env (#534)
2023-10-11 00:30:58 +03:00
- types-jsonschema
mlos_bench config json schema validation: optimizers and tunable_values (#340) This PR introduces initial json schemas for mlos_bench optimizer configs and tunable_values configs, their validation at load time, and tests for both. Future PRs will handle other config types. See Also: #331
2023-05-16 00:30:36 +03:00
- types-pygments
Add SSH Support (#510) - Adds SSH support for remote exec and file copy operations via `asyncssy` library. Closes #379 - This requires an event loop thread to operate the async calls in the background without blocking the rest of our main thread operations or changing our APIs dramatically. Instead we interact with all operations as futures after that. - Add json schema config support for SSH - Adds test infrastructure for running SSH servers inside containers via `pytest-docker` which uses `docker compose` to start/stop them as fixtures. This *should* work in all dev environments (Linux host, WSL host, Windows host), but is quite sensitive to networking setups. - [x] test the background thread cleanup logic - [x] test error handling of a broken ssh endpoint - [x] test basic exec commands - [x] test host operations (e.g., reboot) - [x] test basic copy commands - [x] test for single connection reuse across services - [x] test multi-server support - [x] use random ports to avoid conflicts - provide some config examples for using this - add remote_env exec tests with this (increase code coverage) - Will do these in a future PR instead - #521 --------- Co-authored-by: Sergiy Matusevych <sergiym@microsoft.com> Co-authored-by: Sergiy Matusevych <sergiy.matusevych@gmail.com>
2023-10-26 21:49:53 +03:00
- types-pytest-lazy-fixture
Stricter mypy typing for mlos_core (#305) * force function definitions to have type decorations * type annotations * ignore errors on listening to port 81 from 127.0.0.1 so we can run two devcontainer instances at a time * more type check fixups * ignore missing matplotlib stubs * more typing * spelling * annotate test functions * spelling * types * spelling * more typing * more typing fixups * more strict * more typing fixups * fixups * more * spaces * merge conflict fixups * more merge conflicts * fixup * back that change out * minor tweaks for unimplemented function * fixups for py 3.89 * fixups for newer version of mypy * minor tweaks to dmypy script * update --------- Co-authored-by: Sergiy Matusevych <sergiym@microsoft.com>
2023-04-18 00:01:27 +03:00
- types-requests
mlos_bench config json schema validation: optimizers and tunable_values (#340) This PR introduces initial json schemas for mlos_bench optimizer configs and tunable_values configs, their validation at load time, and tests for both. Future PRs will handle other config types. See Also: #331
2023-05-16 00:30:36 +03:00
- types-setuptools
Rework package dependencies (#320) * rework package dependencies
2023-04-28 23:59:43 +03:00
- "--editable ../mlos_core[full-tests]"
- "--editable ../mlos_bench[full-tests]"
Introduce basic experiment visualization module mlos_viz via dabl (#624) Adds a basic `mlos_viz.plot(exp)` style API for simple visualizations of `ExperimentData` results relative to the experiment's objectives (building off of #628 and https://github.com/dabl/dabl/pull/335). Note: this PR currently omits unit tests for the new module due to the complexity of testing visualizations. We intend to add this in future PRs. There is however, a working example of its use here right now: https://github.com/Microsoft-CISL/sqlite-autotuning/pull/41 --------- Co-authored-by: Sergiy Matusevych <sergiy.matusevych@gmail.com>
2024-01-16 21:48:20 +03:00
- "--editable ../mlos_viz[full-tests]"