610341c203
# Pull Request ## Title Quick fixups to the documentation build. --- ## Description - Expands one of the ignored warnings. - Reformats the sphinx conf for black and pylint. - Removes a warning from that file around redefinition of `html_theme_path`. - Adds a dependency requirement tweak for `pyparsing` when installing under python 3.8 (unrelated other CI bug). - Adds a workaround to a mypy false positive with in checking `np.e` as a "deleted variable" (e.g., `e` is used in a try/except block) --- ## Type of Change - 🛠️ Bug fix - 📝 Documentation update --- ## Testing - Ran `make doc` and `make check-doc`. - Ran `make notebook-exec-test`. --- ## Additional Notes (optional) This is a quick fix to get the CI pipeline working again. The more complete fix to remove warning ignores from doc generation, improve cross reference linking, etc. will be handled later in #869 --- |
||
|---|---|---|
| .. | ||
| mlos_core | ||
| notebooks | ||
| MANIFEST.in | ||
| README.md | ||
| pyproject.toml | ||
| setup.py | ||
README.md
mlos-core
This directory contains the code for the mlos-core optimizer package.
It's available for pip install via the pypi repository at mlos-core.
Description
mlos-core is an optimizer package, wrapping other libraries like FLAML and SMAC to use techniques like Bayesian optimization and others to identify & sample tunable configuration parameters and propose optimal parameter values with a consistent API: suggest and register.
These can be evaluated by mlos-bench, generating and tracking experiment results (proposed parameters, benchmark results & telemetry) to update the optimization loop, or used independently.
Features
Since the tunable parameter search space is often extremely large, mlos-core automates the following steps to efficiently generate optimal task-specific kernel and application configurations.
- Reduce the search space by identifying a promising set of tunable parameters
- Map out the configuration search space: Automatically track and manage the discovery of new Linux kernel parameters and their default values across versions. Filter out non-tunable parameters (e.g., not writable) and track which kernel parameters exist for a given kernel version.
- Leverage parameter knowledge for optimization: Information on ranges, sampling intervals, parameter correlations, workload type sensitivities for tunable parameters are tracked and currently manually curated. In the future, this can be automatically maintained by scraping documentation pages on kernel parameters.
- Tailored to application: Consider prior knowledge of the parameter's impact & an application's workload profile (e.g. network heavy, disk heavy, CPU bound, multi-threaded, latency sensitive, throughput oriented, etc.) to identify likely impactful candidates of tunable parameters, specific to a particular application.
- Sampling to warm-start optimization in a high dimensional search space
- Produce optimal configurations through Bayesian optimization
- Support for various optimizer algorithms (default Bayesian optimizer, Flaml, SMAC, and random for baseline comparison), that handle multiple types of constraints. This includes cost-aware optimization, that considers experiment costs given current tunable parameters.
- Integrated with
mlos-bench, proposed configurations are logged and evaluated.