mlops/requirements.md

59 строки
4.9 KiB
Markdown
Исходник Обычный вид История

2020-05-29 19:08:38 +03:00
The problem we are trying to solve is we want to be able to curate all of the below assets in a central place that is easy for people to browse and discover. We want to host this on GitHub Pages (we can figure out how to deploy it if you are not familiar with GitHub Pages)
2020-05-29 18:56:43 +03:00
2020-05-29 19:01:41 +03:00
# Categories of Assets We have created (a seperate page for each)
2020-05-29 18:56:43 +03:00
1. Blog Posts
- [Providing Data Scientists With New Superpowers](https://fastpages.fast.ai/actions/markdown/2020/03/06/fastpages-actions.html)
2020-05-29 18:59:34 +03:00
- [Microsoft Official Blog Post](https://techcommunity.microsoft.com/t5/azure-ai/using-github-actions-amp-azure-machine-learning-for-mlops/ba-p/1419027)
- Pending - GitHub Official Blog Post - TBD
2020-05-29 18:56:43 +03:00
2. GitHub Actions
- [Action: Submit Argo Workflows on GKE](https://github.com/marketplace/actions/submit-argo-workflows-to-gke) - leverages the gcloud cli to authenticate to your GKE cluster and submit argo workflows.
- [Action: Submit Argo Workflows on K8s (Cloud agnostic)](https://github.com/marketplace/actions/submit-argo-workflows-from-github) - requires that you supply a kubeconfig file to authenticate to your k8 cluster.
- [Action: Fetch runs from Weights & Biases](https://github.com/marketplace/actions/get-runs-from-weights-biases) - W&B is an experiment tracking and logging system for machine learning, and is free for open source projects.
- [Action: To compile, deploy and run Kubeflow pipeline](https://github.com/marketplace/actions/kubeflow-compile-deploy-and-run). This action allows you to instantiate [Kubeflow pipelines](https://www.kubeflow.org/docs/pipelines/overview/pipelines-overview/) from GitHub directly.
- [Action: Dockerize GitHub repositories automatically as a Jupyter Server](https://github.com/machine-learning-apps/repo2docker-action)
2020-05-29 19:15:17 +03:00
- [aml-workspace](https://github.com/marketplace/actions/azure-machine-learning-workspace) - creates an Azure Machine Learning workspace.
- [aml-compute](https://github.com/marketplace/actions/azure-machine-learning-compute-action) - Manage Azure Compute Resources.
- [aml-run](https://github.com/marketplace/actions/azure-machine-learning-run-action) - Run a training job, experiment or pipeline on Azure.
- [aml-registermodel](https://github.com/marketplace/actions/azure-machine-learning-register-model-action) - Register a model on Azure Machine Learning.
- [aml-deploy](https://github.com/marketplace/actions/azure-machine-learning-deploy-action) - Deploy a model to AKS or ACI.
2020-05-29 18:56:43 +03:00
3. Repository Templates
- [fastpages](https://github.com/fastai/fastpages)
2020-05-29 19:12:58 +03:00
- [Azure ML + Actions](https://github.com/machine-learning-apps/ml-template-azure)
2020-05-29 18:56:43 +03:00
4. Live Demos / Tutorials
- [GitHub Universe Talk - MLOps](https://www.youtube.com/watch?v=Ll50l3fsoYs)
- [Live Demo Actions & ML Workflows](https://www.youtube.com/watch?v=S-kn4mmlxFU)
2020-05-29 19:12:58 +03:00
- [Azure ML + Actions Webinar](https://www.youtube.com/watch?v=V8MRYtNeqUc)
2020-05-29 18:56:43 +03:00
5. Documentation
TBD we have not made this yet, but we want to create documentation as well, and want the documentation theme to be coherent with the rest of the website.
When I say documentation. Documentation site should look like [this page](https://primer.style/css/tools/prototyping)
6. Team Page
We want to list all the members of our team like [this page](https://primer.style/about/#team/)
You can use our GitHub profiles to get this started, the team is:
2020-05-29 19:01:09 +03:00
- [@awmatheson](https://github.com/awmatheson)
- [@hamelsmu](https://github.com/hamelsmu)
- [@inc0](https://github.com/inc0)
2020-05-29 18:56:43 +03:00
# Asthetics / Creative Inspiration
- We like the asthetics of [primer.style](https://primer.style/) something along those lines as a front page with cards as links to various sections
- primer.style is also a design system like Jekyll you can use CSS or Gatsby if you are so inclined to use these assets.
- We also like the look and feel of this page https://github.com/features/actions
- Some assets you can try to use (but it is not necessary)
- [Primer CSS](https://primer.style/css/)
- [GitHub Icons](https://ghicons.github.com/)
# Requirements
2020-05-29 19:25:40 +03:00
- Preferred static site generator is either [Jekyll](https://jekyllrb.com/), [Gatsby](https://www.gatsbyjs.org/), or [Eleventy](https://github.com/11ty/eleventy)
2020-05-29 18:56:43 +03:00
- We want to make it such that we can update the content any of the pages that have a list of resources with CSV or JSON files ourselves. This will make it easy for us to maintain. You can make this happen for example with [Jekyll Datafiles](https://jekyllrb.com/docs/datafiles/). For anything that is a list, we want an image thumbnail that we can add a reference to in the csv or json and that will get rendered for us automatically to make things look nice.
2020-05-29 19:25:40 +03:00
- All youtube videos we supply via a csv/json list for the "Live Demos / Tutorials" page should appear as embedded in the site.
2020-05-29 18:56:43 +03:00
- For other pages we want to be able to update those with markdown.
2020-05-29 18:59:34 +03:00
- **All work on this project must be done in this GitHub repo**