azure-databricks-operator/README.md

82 строки
3.5 KiB
Markdown
Исходник Обычный вид История

2019-05-15 13:59:15 +03:00
# Azure Databricks operator
2019-05-13 08:04:24 +03:00
2019-05-15 13:59:15 +03:00
## Introduction
Azure Databricks operator contains two projects. This golang application is a Kubernetes controller that watches CRDs that defines a Databricks job (input, output, functions, transformers, etc) and Python Flask App that sends commands to Databricks.
![alt text]docs/images/azure-databricks-operator.jpg "high level architecture")
The project was built using
1. [Kubebuilder](https://book.kubebuilder.io/)
2. [Swagger Codegen](https://github.com/swagger-api/swagger-codegen)
3. [Flask-RESTPlus](http://flask-restplus.readthedocs.io)
4. [Flask](http://flask.pocoo.org/)
![alt text]docs/images/development-flow.jpg "development flow")
### Prerequisites And Assumptions
1. You have [Minikube](https://kubernetes.io/docs/tasks/tools/install-minikube/),[Kind](https://github.com/kubernetes-sigs/kind) or docker for desktop installed on your local computer with RBAC enabled.
2. You have a Kubernetes cluster running.
3. You have the kubectl command line (kubectl CLI) installed.
4. You have Helm and Tiller installed.
* Configure a Kubernetes cluster in your machine
> You need to make sure a kubeconfig file is configured.
> if you opt AKS, you can use: `az aks get-credentials --resource-group $RG_NAME --name $Cluster_NAME`
#### Basic commands to check your cluster
```shell
kubectl config get-contexts
kubectl cluster-info
kubectl version
kubectl get pods -n kube-system
```
#### Kubernetes on WSL
on windows command line run `kubectl config view` to find the values of [windows-user-name],[minikubeip],[port]
```shell
mkdir ~/.kube \
&& cp /mnt/c/Users/[windows-user-name]/.kube/config ~/.kube
kubectl config set-cluster minikube --server=https://<minikubeip>:<port> --certificate-authority=/mnt/c/Users/<windows-user-name>/.minikube/ca.crt
kubectl config set-credentials minikube --client-certificate=/mnt/c/Users/<windows-user-name>/.minikube/client.crt --client-key=/mnt/c/Users/<windows-user-name>/.minikube/client.key
kubectl config set-context minikube --cluster=minikube --user=minikub
```
More info:
https://devkimchi.com/2018/06/05/running-kubernetes-on-wsl/
https://www.jamessturtevant.com/posts/Running-Kubernetes-Minikube-on-Windows-10-with-WSL/
##
Docs and Samples are coming soon
## Main Contributors
1. [Jordan Knight](https://www.linkedin.com/in/jakkaj/)
2. [Paul Bouwer](https://www.linkedin.com/in/pbouwer/)
3. [Lace Lofranco](https://www.linkedin.com/in/lacelofranco/)
4. [Allan Targino](https://www.linkedin.com/in/allan-targino//)
5. [Azadeh Khojandi](https://www.linkedin.com/in/azadeh-khojandi-ba441b3/)
## Contributing
2019-05-13 08:04:24 +03:00
This project welcomes contributions and suggestions. Most contributions require you to agree to a
Contributor License Agreement (CLA) declaring that you have the right to, and actually do, grant us
the rights to use your contribution. For details, visit https://cla.microsoft.com.
When you submit a pull request, a CLA-bot will automatically determine whether you need to provide
a CLA and decorate the PR appropriately (e.g., label, comment). Simply follow the instructions
provided by the bot. You will only need to do this once across all repos using our CLA.
This project has adopted the [Microsoft Open Source Code of Conduct](https://opensource.microsoft.com/codeofconduct/).
For more information see the [Code of Conduct FAQ](https://opensource.microsoft.com/codeofconduct/faq/) or
contact [opencode@microsoft.com](mailto:opencode@microsoft.com) with any additional questions or comments.