planetary-computer-apis/docker-compose.dev.yml

125 строки
4.4 KiB
YAML
Исходник Постоянная ссылка Обычный вид История

2021-10-18 19:13:28 +03:00
services:
Project renames; publish and deploy (#12) * Add helm chart publication * Remove old cipublish path * switch from "1" to "true" GitHub sets CI to "true" rather than 1: https://docs.github.com/en/actions/learn-github-actions/environment-variables#default-environment-variables * wip -- attempt the run * don't condition deploy step for now * switch branch back to main youc an use $default-branch in templates, but not actual workflows: https://github.blog/changelog/2020-07-22-github-actions-better-support-for-alternative-default-branch-names/ * switch branch back to main youc an use $default-branch in templates, but not actual workflows: https://github.blog/changelog/2020-07-22-github-actions-better-support-for-alternative-default-branch-names/ * set azure env variables * parse and echo from json * don't set tenant id? https://github.com/hashicorp/terraform-provider-azuread/issues/343#issuecomment-721455149 ?? * oops i don't think these are getting passed through * add override compose this compose file un-sets the env variables that we don't have because we don't have a .env file in ci, so I _think_ it should inherit them from the environment * add back mqe resource group why was this deleted am i being trolled * Add path debugging * check what tf keys we got * remove api management from ingress 🤞🏻 * all container registries through github * remove debug prints from jinja * re-remove the mqe resource group because it was deliberately missing, not accidentally * skip tests for a sec * debug echo cluster name and rg * require az account env variables * reuse tf env variable names * don't point to `latest` tag * Add workflow for publishing helm charts to GH Pages. * Rename charts, separate published, reset versions * Use -dev suffix for development release * Publish dev charts only on main * Rename mqe -> stac, dqe -> tiler in codebase * Update README Rename MQE to STAC API and DQE to Tiler; also editorally make things more terse * Remove testdata, move loadtestdata to tests * Remove out of date and generic docs for tiler * Use cipublish to publish images * Rename python packages to be prefixed with 'pc' * Remove stac-vrt * Remove unused model and method. Also formatting * Remove scripts/env * Upgrade to stac-fastapi 2.2.0 * Delete unusued doc images * Update deployment code with renames. * Update cert-manager, other deployment fixes * Test on cibuild, remove GA test branch trigger * Fixup PR template Co-authored-by: Nathan Zimmerman <npzimmerman@gmail.com> Co-authored-by: James Santucci <james.santucci@gmail.com>
2021-11-01 18:27:39 +03:00
stac-dev:
platform: linux/amd64
Project renames; publish and deploy (#12) * Add helm chart publication * Remove old cipublish path * switch from "1" to "true" GitHub sets CI to "true" rather than 1: https://docs.github.com/en/actions/learn-github-actions/environment-variables#default-environment-variables * wip -- attempt the run * don't condition deploy step for now * switch branch back to main youc an use $default-branch in templates, but not actual workflows: https://github.blog/changelog/2020-07-22-github-actions-better-support-for-alternative-default-branch-names/ * switch branch back to main youc an use $default-branch in templates, but not actual workflows: https://github.blog/changelog/2020-07-22-github-actions-better-support-for-alternative-default-branch-names/ * set azure env variables * parse and echo from json * don't set tenant id? https://github.com/hashicorp/terraform-provider-azuread/issues/343#issuecomment-721455149 ?? * oops i don't think these are getting passed through * add override compose this compose file un-sets the env variables that we don't have because we don't have a .env file in ci, so I _think_ it should inherit them from the environment * add back mqe resource group why was this deleted am i being trolled * Add path debugging * check what tf keys we got * remove api management from ingress 🤞🏻 * all container registries through github * remove debug prints from jinja * re-remove the mqe resource group because it was deliberately missing, not accidentally * skip tests for a sec * debug echo cluster name and rg * require az account env variables * reuse tf env variable names * don't point to `latest` tag * Add workflow for publishing helm charts to GH Pages. * Rename charts, separate published, reset versions * Use -dev suffix for development release * Publish dev charts only on main * Rename mqe -> stac, dqe -> tiler in codebase * Update README Rename MQE to STAC API and DQE to Tiler; also editorally make things more terse * Remove testdata, move loadtestdata to tests * Remove out of date and generic docs for tiler * Use cipublish to publish images * Rename python packages to be prefixed with 'pc' * Remove stac-vrt * Remove unused model and method. Also formatting * Remove scripts/env * Upgrade to stac-fastapi 2.2.0 * Delete unusued doc images * Update deployment code with renames. * Update cert-manager, other deployment fixes * Test on cibuild, remove GA test branch trigger * Fixup PR template Co-authored-by: Nathan Zimmerman <npzimmerman@gmail.com> Co-authored-by: James Santucci <james.santucci@gmail.com>
2021-11-01 18:27:39 +03:00
image: pc-apis-stac-dev
2021-10-18 19:13:28 +03:00
build:
context: .
Project renames; publish and deploy (#12) * Add helm chart publication * Remove old cipublish path * switch from "1" to "true" GitHub sets CI to "true" rather than 1: https://docs.github.com/en/actions/learn-github-actions/environment-variables#default-environment-variables * wip -- attempt the run * don't condition deploy step for now * switch branch back to main youc an use $default-branch in templates, but not actual workflows: https://github.blog/changelog/2020-07-22-github-actions-better-support-for-alternative-default-branch-names/ * switch branch back to main youc an use $default-branch in templates, but not actual workflows: https://github.blog/changelog/2020-07-22-github-actions-better-support-for-alternative-default-branch-names/ * set azure env variables * parse and echo from json * don't set tenant id? https://github.com/hashicorp/terraform-provider-azuread/issues/343#issuecomment-721455149 ?? * oops i don't think these are getting passed through * add override compose this compose file un-sets the env variables that we don't have because we don't have a .env file in ci, so I _think_ it should inherit them from the environment * add back mqe resource group why was this deleted am i being trolled * Add path debugging * check what tf keys we got * remove api management from ingress 🤞🏻 * all container registries through github * remove debug prints from jinja * re-remove the mqe resource group because it was deliberately missing, not accidentally * skip tests for a sec * debug echo cluster name and rg * require az account env variables * reuse tf env variable names * don't point to `latest` tag * Add workflow for publishing helm charts to GH Pages. * Rename charts, separate published, reset versions * Use -dev suffix for development release * Publish dev charts only on main * Rename mqe -> stac, dqe -> tiler in codebase * Update README Rename MQE to STAC API and DQE to Tiler; also editorally make things more terse * Remove testdata, move loadtestdata to tests * Remove out of date and generic docs for tiler * Use cipublish to publish images * Rename python packages to be prefixed with 'pc' * Remove stac-vrt * Remove unused model and method. Also formatting * Remove scripts/env * Upgrade to stac-fastapi 2.2.0 * Delete unusued doc images * Update deployment code with renames. * Update cert-manager, other deployment fixes * Test on cibuild, remove GA test branch trigger * Fixup PR template Co-authored-by: Nathan Zimmerman <npzimmerman@gmail.com> Co-authored-by: James Santucci <james.santucci@gmail.com>
2021-11-01 18:27:39 +03:00
dockerfile: pcstac/Dockerfile.dev
2021-10-18 19:13:28 +03:00
environment:
- ENVIRONMENT=development
- POSTGRES_USER=username
- POSTGRES_PASS=password
- POSTGRES_DBNAME=postgis
- POSTGRES_HOST=database
- POSTGRES_HOST_READER=database
- POSTGRES_HOST_WRITER=database
- POSTGRES_PORT=5432
- PCAPIS_DEBUG=TRUE
- TILER_HREF=http://localhost:8080/data/
Use Azure Storage Tables for collection and container configuration (#48) * Add additional dependencies to pccommon * Fix mypy error in pctiler Brining in the type stubs for cachetools caused mypy to complain about unknown types for the key function * Refactor scripts to test pccommon Also run flake8 on pccommon, which wasn't happening * Linting fixups * Add tables classes * Refactor collection config in pccommon Also refactor CommonConfig to use pydantic settings. Create a table setup for collection configuration and container configuration. Use cachetools to cache the configuration. * Add Azurite setup Encode collection configuration and container configuration (which was hardcoded) as JSON. This can be used to populate the initial table structure in deployment as well, after which this test data will diverge from production settings. * Update codebase to use refactored configuration * Set azurite settings in docker-compose Also account for environment prefix for DEBUG that change with refactor to use BaseSettings in CommonConfig * Move to using only pytest for consistency * Test get render config for naip * Refactor config code layout Enable configuration of TTL * Run azurite setup in scripts/setup Also fix setup_azurite * Add mosaicInfo and queriables to collection config * Remove usage of requirements.txt This was being used inconsistently. * Add script for local package install * Fetch queryables from storage tables * Use orjson in pccommon * Use ORJSONResponse * Remove unused endpoint prefixes * Add mosiac/info endpoint * Add method to fetch all rows * Add CLI for loading and dumping config data * Variable for k8s version; update dev * Allow AKS to pull from ACR * Storage Tables in terraform * Add config table env vars to helm charts * Update ingress apiVersion * Make note in deploy README about updating tables * Update CHANGELOG * Linting/formatting * Remove unused __init__ override This was left over from a previous implementation, should have been cleaned up. * Remove unused vars in dev terraform * Allow cli to dump configs by id Co-authored-by: Matt McFarland <mmcfarland@microsoft.com>
2022-02-18 00:06:08 +03:00
# Azure Storage
- AZURITE_ACCOUNT_KEY=${AZURITE_ACCOUNT_KEY}
Use Azure Storage Tables for collection and container configuration (#48) * Add additional dependencies to pccommon * Fix mypy error in pctiler Brining in the type stubs for cachetools caused mypy to complain about unknown types for the key function * Refactor scripts to test pccommon Also run flake8 on pccommon, which wasn't happening * Linting fixups * Add tables classes * Refactor collection config in pccommon Also refactor CommonConfig to use pydantic settings. Create a table setup for collection configuration and container configuration. Use cachetools to cache the configuration. * Add Azurite setup Encode collection configuration and container configuration (which was hardcoded) as JSON. This can be used to populate the initial table structure in deployment as well, after which this test data will diverge from production settings. * Update codebase to use refactored configuration * Set azurite settings in docker-compose Also account for environment prefix for DEBUG that change with refactor to use BaseSettings in CommonConfig * Move to using only pytest for consistency * Test get render config for naip * Refactor config code layout Enable configuration of TTL * Run azurite setup in scripts/setup Also fix setup_azurite * Add mosaicInfo and queriables to collection config * Remove usage of requirements.txt This was being used inconsistently. * Add script for local package install * Fetch queryables from storage tables * Use orjson in pccommon * Use ORJSONResponse * Remove unused endpoint prefixes * Add mosiac/info endpoint * Add method to fetch all rows * Add CLI for loading and dumping config data * Variable for k8s version; update dev * Allow AKS to pull from ACR * Storage Tables in terraform * Add config table env vars to helm charts * Update ingress apiVersion * Make note in deploy README about updating tables * Update CHANGELOG * Linting/formatting * Remove unused __init__ override This was left over from a previous implementation, should have been cleaned up. * Remove unused vars in dev terraform * Allow cli to dump configs by id Co-authored-by: Matt McFarland <mmcfarland@microsoft.com>
2022-02-18 00:06:08 +03:00
- PCAPIS_COLLECTION_CONFIG__ACCOUNT_URL=http://azurite:10002/devstoreaccount1
- PCAPIS_COLLECTION_CONFIG__ACCOUNT_NAME=devstoreaccount1
- PCAPIS_COLLECTION_CONFIG__ACCOUNT_KEY=${AZURITE_ACCOUNT_KEY}
Use Azure Storage Tables for collection and container configuration (#48) * Add additional dependencies to pccommon * Fix mypy error in pctiler Brining in the type stubs for cachetools caused mypy to complain about unknown types for the key function * Refactor scripts to test pccommon Also run flake8 on pccommon, which wasn't happening * Linting fixups * Add tables classes * Refactor collection config in pccommon Also refactor CommonConfig to use pydantic settings. Create a table setup for collection configuration and container configuration. Use cachetools to cache the configuration. * Add Azurite setup Encode collection configuration and container configuration (which was hardcoded) as JSON. This can be used to populate the initial table structure in deployment as well, after which this test data will diverge from production settings. * Update codebase to use refactored configuration * Set azurite settings in docker-compose Also account for environment prefix for DEBUG that change with refactor to use BaseSettings in CommonConfig * Move to using only pytest for consistency * Test get render config for naip * Refactor config code layout Enable configuration of TTL * Run azurite setup in scripts/setup Also fix setup_azurite * Add mosaicInfo and queriables to collection config * Remove usage of requirements.txt This was being used inconsistently. * Add script for local package install * Fetch queryables from storage tables * Use orjson in pccommon * Use ORJSONResponse * Remove unused endpoint prefixes * Add mosiac/info endpoint * Add method to fetch all rows * Add CLI for loading and dumping config data * Variable for k8s version; update dev * Allow AKS to pull from ACR * Storage Tables in terraform * Add config table env vars to helm charts * Update ingress apiVersion * Make note in deploy README about updating tables * Update CHANGELOG * Linting/formatting * Remove unused __init__ override This was left over from a previous implementation, should have been cleaned up. * Remove unused vars in dev terraform * Allow cli to dump configs by id Co-authored-by: Matt McFarland <mmcfarland@microsoft.com>
2022-02-18 00:06:08 +03:00
- PCAPIS_COLLECTION_CONFIG__TABLE_NAME=collectionconfig
- PCAPIS_CONTAINER_CONFIG__ACCOUNT_URL=http://azurite:10002/devstoreaccount1
- PCAPIS_CONTAINER_CONFIG__ACCOUNT_NAME=devstoreaccount1
- PCAPIS_CONTAINER_CONFIG__ACCOUNT_KEY=${AZURITE_ACCOUNT_KEY}
Use Azure Storage Tables for collection and container configuration (#48) * Add additional dependencies to pccommon * Fix mypy error in pctiler Brining in the type stubs for cachetools caused mypy to complain about unknown types for the key function * Refactor scripts to test pccommon Also run flake8 on pccommon, which wasn't happening * Linting fixups * Add tables classes * Refactor collection config in pccommon Also refactor CommonConfig to use pydantic settings. Create a table setup for collection configuration and container configuration. Use cachetools to cache the configuration. * Add Azurite setup Encode collection configuration and container configuration (which was hardcoded) as JSON. This can be used to populate the initial table structure in deployment as well, after which this test data will diverge from production settings. * Update codebase to use refactored configuration * Set azurite settings in docker-compose Also account for environment prefix for DEBUG that change with refactor to use BaseSettings in CommonConfig * Move to using only pytest for consistency * Test get render config for naip * Refactor config code layout Enable configuration of TTL * Run azurite setup in scripts/setup Also fix setup_azurite * Add mosaicInfo and queriables to collection config * Remove usage of requirements.txt This was being used inconsistently. * Add script for local package install * Fetch queryables from storage tables * Use orjson in pccommon * Use ORJSONResponse * Remove unused endpoint prefixes * Add mosiac/info endpoint * Add method to fetch all rows * Add CLI for loading and dumping config data * Variable for k8s version; update dev * Allow AKS to pull from ACR * Storage Tables in terraform * Add config table env vars to helm charts * Update ingress apiVersion * Make note in deploy README about updating tables * Update CHANGELOG * Linting/formatting * Remove unused __init__ override This was left over from a previous implementation, should have been cleaned up. * Remove unused vars in dev terraform * Allow cli to dump configs by id Co-authored-by: Matt McFarland <mmcfarland@microsoft.com>
2022-02-18 00:06:08 +03:00
- PCAPIS_CONTAINER_CONFIG__TABLE_NAME=containerconfig
- PCAPIS_IP_EXCEPTION_CONFIG__ACCOUNT_URL=http://azurite:10002/devstoreaccount1
- PCAPIS_IP_EXCEPTION_CONFIG__ACCOUNT_NAME=devstoreaccount1
- PCAPIS_IP_EXCEPTION_CONFIG__ACCOUNT_KEY=${AZURITE_ACCOUNT_KEY}
- PCAPIS_IP_EXCEPTION_CONFIG__TABLE_NAME=ipexceptionlist
# Redis
- PCAPIS_REDIS_HOSTNAME=redis
- PCAPIS_REDIS_PASSWORD=devcache
- PCAPIS_REDIS_PORT=6380
- PCAPIS_REDIS_SSL=FALSE
# Rate limit
- PCAPIS_RATE_LIMITS__COLLECTIONS=1000
- PCAPIS_RATE_LIMITS__COLLECTION=100
- PCAPIS_RATE_LIMITS__ITEMS=1000
- PCAPIS_RATE_LIMITS__ITEM=1000
- PCAPIS_RATE_LIMITS__SEARCH=1000
# Backpressure
- PCAPIS_BACK_PRESSURES__COLLECTIONS__REQ_PER_SEC=100
- PCAPIS_BACK_PRESSURES__COLLECTIONS__INC_MS=10
- PCAPIS_BACK_PRESSURES__COLLECTION__REQ_PER_SEC=100
- PCAPIS_BACK_PRESSURES__COLLECTION__INC_MS=10
- PCAPIS_BACK_PRESSURES__ITEMS__REQ_PER_SEC=100
- PCAPIS_BACK_PRESSURES__ITEMS__INC_MS=10
- PCAPIS_BACK_PRESSURES__ITEM__REQ_PER_SEC=100
- PCAPIS_BACK_PRESSURES__ITEM__INC_MS=10
- PCAPIS_BACK_PRESSURES__SEARCH__REQ_PER_SEC=100
- PCAPIS_BACK_PRESSURES__SEARCH__INC_MS=10
2021-10-18 19:13:28 +03:00
volumes:
- .:/opt/src
command: >
/bin/bash
depends_on:
Project renames; publish and deploy (#12) * Add helm chart publication * Remove old cipublish path * switch from "1" to "true" GitHub sets CI to "true" rather than 1: https://docs.github.com/en/actions/learn-github-actions/environment-variables#default-environment-variables * wip -- attempt the run * don't condition deploy step for now * switch branch back to main youc an use $default-branch in templates, but not actual workflows: https://github.blog/changelog/2020-07-22-github-actions-better-support-for-alternative-default-branch-names/ * switch branch back to main youc an use $default-branch in templates, but not actual workflows: https://github.blog/changelog/2020-07-22-github-actions-better-support-for-alternative-default-branch-names/ * set azure env variables * parse and echo from json * don't set tenant id? https://github.com/hashicorp/terraform-provider-azuread/issues/343#issuecomment-721455149 ?? * oops i don't think these are getting passed through * add override compose this compose file un-sets the env variables that we don't have because we don't have a .env file in ci, so I _think_ it should inherit them from the environment * add back mqe resource group why was this deleted am i being trolled * Add path debugging * check what tf keys we got * remove api management from ingress 🤞🏻 * all container registries through github * remove debug prints from jinja * re-remove the mqe resource group because it was deliberately missing, not accidentally * skip tests for a sec * debug echo cluster name and rg * require az account env variables * reuse tf env variable names * don't point to `latest` tag * Add workflow for publishing helm charts to GH Pages. * Rename charts, separate published, reset versions * Use -dev suffix for development release * Publish dev charts only on main * Rename mqe -> stac, dqe -> tiler in codebase * Update README Rename MQE to STAC API and DQE to Tiler; also editorally make things more terse * Remove testdata, move loadtestdata to tests * Remove out of date and generic docs for tiler * Use cipublish to publish images * Rename python packages to be prefixed with 'pc' * Remove stac-vrt * Remove unused model and method. Also formatting * Remove scripts/env * Upgrade to stac-fastapi 2.2.0 * Delete unusued doc images * Update deployment code with renames. * Update cert-manager, other deployment fixes * Test on cibuild, remove GA test branch trigger * Fixup PR template Co-authored-by: Nathan Zimmerman <npzimmerman@gmail.com> Co-authored-by: James Santucci <james.santucci@gmail.com>
2021-11-01 18:27:39 +03:00
- stac
tiler-dev:
platform: linux/amd64
Project renames; publish and deploy (#12) * Add helm chart publication * Remove old cipublish path * switch from "1" to "true" GitHub sets CI to "true" rather than 1: https://docs.github.com/en/actions/learn-github-actions/environment-variables#default-environment-variables * wip -- attempt the run * don't condition deploy step for now * switch branch back to main youc an use $default-branch in templates, but not actual workflows: https://github.blog/changelog/2020-07-22-github-actions-better-support-for-alternative-default-branch-names/ * switch branch back to main youc an use $default-branch in templates, but not actual workflows: https://github.blog/changelog/2020-07-22-github-actions-better-support-for-alternative-default-branch-names/ * set azure env variables * parse and echo from json * don't set tenant id? https://github.com/hashicorp/terraform-provider-azuread/issues/343#issuecomment-721455149 ?? * oops i don't think these are getting passed through * add override compose this compose file un-sets the env variables that we don't have because we don't have a .env file in ci, so I _think_ it should inherit them from the environment * add back mqe resource group why was this deleted am i being trolled * Add path debugging * check what tf keys we got * remove api management from ingress 🤞🏻 * all container registries through github * remove debug prints from jinja * re-remove the mqe resource group because it was deliberately missing, not accidentally * skip tests for a sec * debug echo cluster name and rg * require az account env variables * reuse tf env variable names * don't point to `latest` tag * Add workflow for publishing helm charts to GH Pages. * Rename charts, separate published, reset versions * Use -dev suffix for development release * Publish dev charts only on main * Rename mqe -> stac, dqe -> tiler in codebase * Update README Rename MQE to STAC API and DQE to Tiler; also editorally make things more terse * Remove testdata, move loadtestdata to tests * Remove out of date and generic docs for tiler * Use cipublish to publish images * Rename python packages to be prefixed with 'pc' * Remove stac-vrt * Remove unused model and method. Also formatting * Remove scripts/env * Upgrade to stac-fastapi 2.2.0 * Delete unusued doc images * Update deployment code with renames. * Update cert-manager, other deployment fixes * Test on cibuild, remove GA test branch trigger * Fixup PR template Co-authored-by: Nathan Zimmerman <npzimmerman@gmail.com> Co-authored-by: James Santucci <james.santucci@gmail.com>
2021-11-01 18:27:39 +03:00
image: pc-apis-tiler-dev
# For Mac OS M1 user, you'll need to add `platform: linux/amd64`.
# see https://github.com/developmentseed/titiler/discussions/387#discussioncomment-1643110
# platform: linux/amd64
2021-10-18 19:13:28 +03:00
build:
context: .
Project renames; publish and deploy (#12) * Add helm chart publication * Remove old cipublish path * switch from "1" to "true" GitHub sets CI to "true" rather than 1: https://docs.github.com/en/actions/learn-github-actions/environment-variables#default-environment-variables * wip -- attempt the run * don't condition deploy step for now * switch branch back to main youc an use $default-branch in templates, but not actual workflows: https://github.blog/changelog/2020-07-22-github-actions-better-support-for-alternative-default-branch-names/ * switch branch back to main youc an use $default-branch in templates, but not actual workflows: https://github.blog/changelog/2020-07-22-github-actions-better-support-for-alternative-default-branch-names/ * set azure env variables * parse and echo from json * don't set tenant id? https://github.com/hashicorp/terraform-provider-azuread/issues/343#issuecomment-721455149 ?? * oops i don't think these are getting passed through * add override compose this compose file un-sets the env variables that we don't have because we don't have a .env file in ci, so I _think_ it should inherit them from the environment * add back mqe resource group why was this deleted am i being trolled * Add path debugging * check what tf keys we got * remove api management from ingress 🤞🏻 * all container registries through github * remove debug prints from jinja * re-remove the mqe resource group because it was deliberately missing, not accidentally * skip tests for a sec * debug echo cluster name and rg * require az account env variables * reuse tf env variable names * don't point to `latest` tag * Add workflow for publishing helm charts to GH Pages. * Rename charts, separate published, reset versions * Use -dev suffix for development release * Publish dev charts only on main * Rename mqe -> stac, dqe -> tiler in codebase * Update README Rename MQE to STAC API and DQE to Tiler; also editorally make things more terse * Remove testdata, move loadtestdata to tests * Remove out of date and generic docs for tiler * Use cipublish to publish images * Rename python packages to be prefixed with 'pc' * Remove stac-vrt * Remove unused model and method. Also formatting * Remove scripts/env * Upgrade to stac-fastapi 2.2.0 * Delete unusued doc images * Update deployment code with renames. * Update cert-manager, other deployment fixes * Test on cibuild, remove GA test branch trigger * Fixup PR template Co-authored-by: Nathan Zimmerman <npzimmerman@gmail.com> Co-authored-by: James Santucci <james.santucci@gmail.com>
2021-11-01 18:27:39 +03:00
dockerfile: pctiler/Dockerfile.dev
2021-10-18 19:13:28 +03:00
environment:
- ENVIRONMENT=development
Project renames; publish and deploy (#12) * Add helm chart publication * Remove old cipublish path * switch from "1" to "true" GitHub sets CI to "true" rather than 1: https://docs.github.com/en/actions/learn-github-actions/environment-variables#default-environment-variables * wip -- attempt the run * don't condition deploy step for now * switch branch back to main youc an use $default-branch in templates, but not actual workflows: https://github.blog/changelog/2020-07-22-github-actions-better-support-for-alternative-default-branch-names/ * switch branch back to main youc an use $default-branch in templates, but not actual workflows: https://github.blog/changelog/2020-07-22-github-actions-better-support-for-alternative-default-branch-names/ * set azure env variables * parse and echo from json * don't set tenant id? https://github.com/hashicorp/terraform-provider-azuread/issues/343#issuecomment-721455149 ?? * oops i don't think these are getting passed through * add override compose this compose file un-sets the env variables that we don't have because we don't have a .env file in ci, so I _think_ it should inherit them from the environment * add back mqe resource group why was this deleted am i being trolled * Add path debugging * check what tf keys we got * remove api management from ingress 🤞🏻 * all container registries through github * remove debug prints from jinja * re-remove the mqe resource group because it was deliberately missing, not accidentally * skip tests for a sec * debug echo cluster name and rg * require az account env variables * reuse tf env variable names * don't point to `latest` tag * Add workflow for publishing helm charts to GH Pages. * Rename charts, separate published, reset versions * Use -dev suffix for development release * Publish dev charts only on main * Rename mqe -> stac, dqe -> tiler in codebase * Update README Rename MQE to STAC API and DQE to Tiler; also editorally make things more terse * Remove testdata, move loadtestdata to tests * Remove out of date and generic docs for tiler * Use cipublish to publish images * Rename python packages to be prefixed with 'pc' * Remove stac-vrt * Remove unused model and method. Also formatting * Remove scripts/env * Upgrade to stac-fastapi 2.2.0 * Delete unusued doc images * Update deployment code with renames. * Update cert-manager, other deployment fixes * Test on cibuild, remove GA test branch trigger * Fixup PR template Co-authored-by: Nathan Zimmerman <npzimmerman@gmail.com> Co-authored-by: James Santucci <james.santucci@gmail.com>
2021-11-01 18:27:39 +03:00
- FF_VRT="yes"
- STAC_API_URL=http://stac:8081
- STAC_API_HREF=http://localhost:8080/stac/
- VECTORTILE_SA_BASE_URL=http://example.com
- PCAPIS_DEBUG=TRUE
Project renames; publish and deploy (#12) * Add helm chart publication * Remove old cipublish path * switch from "1" to "true" GitHub sets CI to "true" rather than 1: https://docs.github.com/en/actions/learn-github-actions/environment-variables#default-environment-variables * wip -- attempt the run * don't condition deploy step for now * switch branch back to main youc an use $default-branch in templates, but not actual workflows: https://github.blog/changelog/2020-07-22-github-actions-better-support-for-alternative-default-branch-names/ * switch branch back to main youc an use $default-branch in templates, but not actual workflows: https://github.blog/changelog/2020-07-22-github-actions-better-support-for-alternative-default-branch-names/ * set azure env variables * parse and echo from json * don't set tenant id? https://github.com/hashicorp/terraform-provider-azuread/issues/343#issuecomment-721455149 ?? * oops i don't think these are getting passed through * add override compose this compose file un-sets the env variables that we don't have because we don't have a .env file in ci, so I _think_ it should inherit them from the environment * add back mqe resource group why was this deleted am i being trolled * Add path debugging * check what tf keys we got * remove api management from ingress 🤞🏻 * all container registries through github * remove debug prints from jinja * re-remove the mqe resource group because it was deliberately missing, not accidentally * skip tests for a sec * debug echo cluster name and rg * require az account env variables * reuse tf env variable names * don't point to `latest` tag * Add workflow for publishing helm charts to GH Pages. * Rename charts, separate published, reset versions * Use -dev suffix for development release * Publish dev charts only on main * Rename mqe -> stac, dqe -> tiler in codebase * Update README Rename MQE to STAC API and DQE to Tiler; also editorally make things more terse * Remove testdata, move loadtestdata to tests * Remove out of date and generic docs for tiler * Use cipublish to publish images * Rename python packages to be prefixed with 'pc' * Remove stac-vrt * Remove unused model and method. Also formatting * Remove scripts/env * Upgrade to stac-fastapi 2.2.0 * Delete unusued doc images * Update deployment code with renames. * Update cert-manager, other deployment fixes * Test on cibuild, remove GA test branch trigger * Fixup PR template Co-authored-by: Nathan Zimmerman <npzimmerman@gmail.com> Co-authored-by: James Santucci <james.santucci@gmail.com>
2021-11-01 18:27:39 +03:00
# titiler.pgstac
2021-10-18 19:13:28 +03:00
- POSTGRES_USER=username
- POSTGRES_PASS=password
- POSTGRES_DBNAME=postgis
- POSTGRES_HOST=database
- POSTGRES_HOST_READER=database
- POSTGRES_HOST_WRITER=database
- POSTGRES_PORT=5432
Project renames; publish and deploy (#12) * Add helm chart publication * Remove old cipublish path * switch from "1" to "true" GitHub sets CI to "true" rather than 1: https://docs.github.com/en/actions/learn-github-actions/environment-variables#default-environment-variables * wip -- attempt the run * don't condition deploy step for now * switch branch back to main youc an use $default-branch in templates, but not actual workflows: https://github.blog/changelog/2020-07-22-github-actions-better-support-for-alternative-default-branch-names/ * switch branch back to main youc an use $default-branch in templates, but not actual workflows: https://github.blog/changelog/2020-07-22-github-actions-better-support-for-alternative-default-branch-names/ * set azure env variables * parse and echo from json * don't set tenant id? https://github.com/hashicorp/terraform-provider-azuread/issues/343#issuecomment-721455149 ?? * oops i don't think these are getting passed through * add override compose this compose file un-sets the env variables that we don't have because we don't have a .env file in ci, so I _think_ it should inherit them from the environment * add back mqe resource group why was this deleted am i being trolled * Add path debugging * check what tf keys we got * remove api management from ingress 🤞🏻 * all container registries through github * remove debug prints from jinja * re-remove the mqe resource group because it was deliberately missing, not accidentally * skip tests for a sec * debug echo cluster name and rg * require az account env variables * reuse tf env variable names * don't point to `latest` tag * Add workflow for publishing helm charts to GH Pages. * Rename charts, separate published, reset versions * Use -dev suffix for development release * Publish dev charts only on main * Rename mqe -> stac, dqe -> tiler in codebase * Update README Rename MQE to STAC API and DQE to Tiler; also editorally make things more terse * Remove testdata, move loadtestdata to tests * Remove out of date and generic docs for tiler * Use cipublish to publish images * Rename python packages to be prefixed with 'pc' * Remove stac-vrt * Remove unused model and method. Also formatting * Remove scripts/env * Upgrade to stac-fastapi 2.2.0 * Delete unusued doc images * Update deployment code with renames. * Update cert-manager, other deployment fixes * Test on cibuild, remove GA test branch trigger * Fixup PR template Co-authored-by: Nathan Zimmerman <npzimmerman@gmail.com> Co-authored-by: James Santucci <james.santucci@gmail.com>
2021-11-01 18:27:39 +03:00
- WEB_CONCURRENCY=1
- WORKERS_PER_CORE=1
Use Azure Storage Tables for collection and container configuration (#48) * Add additional dependencies to pccommon * Fix mypy error in pctiler Brining in the type stubs for cachetools caused mypy to complain about unknown types for the key function * Refactor scripts to test pccommon Also run flake8 on pccommon, which wasn't happening * Linting fixups * Add tables classes * Refactor collection config in pccommon Also refactor CommonConfig to use pydantic settings. Create a table setup for collection configuration and container configuration. Use cachetools to cache the configuration. * Add Azurite setup Encode collection configuration and container configuration (which was hardcoded) as JSON. This can be used to populate the initial table structure in deployment as well, after which this test data will diverge from production settings. * Update codebase to use refactored configuration * Set azurite settings in docker-compose Also account for environment prefix for DEBUG that change with refactor to use BaseSettings in CommonConfig * Move to using only pytest for consistency * Test get render config for naip * Refactor config code layout Enable configuration of TTL * Run azurite setup in scripts/setup Also fix setup_azurite * Add mosaicInfo and queriables to collection config * Remove usage of requirements.txt This was being used inconsistently. * Add script for local package install * Fetch queryables from storage tables * Use orjson in pccommon * Use ORJSONResponse * Remove unused endpoint prefixes * Add mosiac/info endpoint * Add method to fetch all rows * Add CLI for loading and dumping config data * Variable for k8s version; update dev * Allow AKS to pull from ACR * Storage Tables in terraform * Add config table env vars to helm charts * Update ingress apiVersion * Make note in deploy README about updating tables * Update CHANGELOG * Linting/formatting * Remove unused __init__ override This was left over from a previous implementation, should have been cleaned up. * Remove unused vars in dev terraform * Allow cli to dump configs by id Co-authored-by: Matt McFarland <mmcfarland@microsoft.com>
2022-02-18 00:06:08 +03:00
# Azure Storage
- AZURITE_ACCOUNT_KEY=${AZURITE_ACCOUNT_KEY}
Use Azure Storage Tables for collection and container configuration (#48) * Add additional dependencies to pccommon * Fix mypy error in pctiler Brining in the type stubs for cachetools caused mypy to complain about unknown types for the key function * Refactor scripts to test pccommon Also run flake8 on pccommon, which wasn't happening * Linting fixups * Add tables classes * Refactor collection config in pccommon Also refactor CommonConfig to use pydantic settings. Create a table setup for collection configuration and container configuration. Use cachetools to cache the configuration. * Add Azurite setup Encode collection configuration and container configuration (which was hardcoded) as JSON. This can be used to populate the initial table structure in deployment as well, after which this test data will diverge from production settings. * Update codebase to use refactored configuration * Set azurite settings in docker-compose Also account for environment prefix for DEBUG that change with refactor to use BaseSettings in CommonConfig * Move to using only pytest for consistency * Test get render config for naip * Refactor config code layout Enable configuration of TTL * Run azurite setup in scripts/setup Also fix setup_azurite * Add mosaicInfo and queriables to collection config * Remove usage of requirements.txt This was being used inconsistently. * Add script for local package install * Fetch queryables from storage tables * Use orjson in pccommon * Use ORJSONResponse * Remove unused endpoint prefixes * Add mosiac/info endpoint * Add method to fetch all rows * Add CLI for loading and dumping config data * Variable for k8s version; update dev * Allow AKS to pull from ACR * Storage Tables in terraform * Add config table env vars to helm charts * Update ingress apiVersion * Make note in deploy README about updating tables * Update CHANGELOG * Linting/formatting * Remove unused __init__ override This was left over from a previous implementation, should have been cleaned up. * Remove unused vars in dev terraform * Allow cli to dump configs by id Co-authored-by: Matt McFarland <mmcfarland@microsoft.com>
2022-02-18 00:06:08 +03:00
- PCAPIS_COLLECTION_CONFIG__ACCOUNT_URL=http://azurite:10002/devstoreaccount1
- PCAPIS_COLLECTION_CONFIG__ACCOUNT_NAME=devstoreaccount1
- PCAPIS_COLLECTION_CONFIG__ACCOUNT_KEY=${AZURITE_ACCOUNT_KEY}
Use Azure Storage Tables for collection and container configuration (#48) * Add additional dependencies to pccommon * Fix mypy error in pctiler Brining in the type stubs for cachetools caused mypy to complain about unknown types for the key function * Refactor scripts to test pccommon Also run flake8 on pccommon, which wasn't happening * Linting fixups * Add tables classes * Refactor collection config in pccommon Also refactor CommonConfig to use pydantic settings. Create a table setup for collection configuration and container configuration. Use cachetools to cache the configuration. * Add Azurite setup Encode collection configuration and container configuration (which was hardcoded) as JSON. This can be used to populate the initial table structure in deployment as well, after which this test data will diverge from production settings. * Update codebase to use refactored configuration * Set azurite settings in docker-compose Also account for environment prefix for DEBUG that change with refactor to use BaseSettings in CommonConfig * Move to using only pytest for consistency * Test get render config for naip * Refactor config code layout Enable configuration of TTL * Run azurite setup in scripts/setup Also fix setup_azurite * Add mosaicInfo and queriables to collection config * Remove usage of requirements.txt This was being used inconsistently. * Add script for local package install * Fetch queryables from storage tables * Use orjson in pccommon * Use ORJSONResponse * Remove unused endpoint prefixes * Add mosiac/info endpoint * Add method to fetch all rows * Add CLI for loading and dumping config data * Variable for k8s version; update dev * Allow AKS to pull from ACR * Storage Tables in terraform * Add config table env vars to helm charts * Update ingress apiVersion * Make note in deploy README about updating tables * Update CHANGELOG * Linting/formatting * Remove unused __init__ override This was left over from a previous implementation, should have been cleaned up. * Remove unused vars in dev terraform * Allow cli to dump configs by id Co-authored-by: Matt McFarland <mmcfarland@microsoft.com>
2022-02-18 00:06:08 +03:00
- PCAPIS_COLLECTION_CONFIG__TABLE_NAME=collectionconfig
- PCAPIS_CONTAINER_CONFIG__ACCOUNT_URL=http://azurite:10002/devstoreaccount1
- PCAPIS_CONTAINER_CONFIG__ACCOUNT_NAME=devstoreaccount1
- PCAPIS_CONTAINER_CONFIG__ACCOUNT_KEY=${AZURITE_ACCOUNT_KEY}
Use Azure Storage Tables for collection and container configuration (#48) * Add additional dependencies to pccommon * Fix mypy error in pctiler Brining in the type stubs for cachetools caused mypy to complain about unknown types for the key function * Refactor scripts to test pccommon Also run flake8 on pccommon, which wasn't happening * Linting fixups * Add tables classes * Refactor collection config in pccommon Also refactor CommonConfig to use pydantic settings. Create a table setup for collection configuration and container configuration. Use cachetools to cache the configuration. * Add Azurite setup Encode collection configuration and container configuration (which was hardcoded) as JSON. This can be used to populate the initial table structure in deployment as well, after which this test data will diverge from production settings. * Update codebase to use refactored configuration * Set azurite settings in docker-compose Also account for environment prefix for DEBUG that change with refactor to use BaseSettings in CommonConfig * Move to using only pytest for consistency * Test get render config for naip * Refactor config code layout Enable configuration of TTL * Run azurite setup in scripts/setup Also fix setup_azurite * Add mosaicInfo and queriables to collection config * Remove usage of requirements.txt This was being used inconsistently. * Add script for local package install * Fetch queryables from storage tables * Use orjson in pccommon * Use ORJSONResponse * Remove unused endpoint prefixes * Add mosiac/info endpoint * Add method to fetch all rows * Add CLI for loading and dumping config data * Variable for k8s version; update dev * Allow AKS to pull from ACR * Storage Tables in terraform * Add config table env vars to helm charts * Update ingress apiVersion * Make note in deploy README about updating tables * Update CHANGELOG * Linting/formatting * Remove unused __init__ override This was left over from a previous implementation, should have been cleaned up. * Remove unused vars in dev terraform * Allow cli to dump configs by id Co-authored-by: Matt McFarland <mmcfarland@microsoft.com>
2022-02-18 00:06:08 +03:00
- PCAPIS_CONTAINER_CONFIG__TABLE_NAME=containerconfig
- PCAPIS_IP_EXCEPTION_CONFIG__ACCOUNT_URL=http://azurite:10002/devstoreaccount1
- PCAPIS_IP_EXCEPTION_CONFIG__ACCOUNT_NAME=devstoreaccount1
- PCAPIS_IP_EXCEPTION_CONFIG__ACCOUNT_KEY=${AZURITE_ACCOUNT_KEY}
- PCAPIS_IP_EXCEPTION_CONFIG__TABLE_NAME=ipexceptionlist
# Redis
- PCAPIS_REDIS_HOSTNAME=redis
- PCAPIS_REDIS_PASSWORD=devcache
- PCAPIS_REDIS_PORT=6380
- PCAPIS_REDIS_SSL=FALSE
2021-10-18 19:13:28 +03:00
volumes:
- .:/opt/src
- ~/.azure:/root/.azure
2021-10-18 19:13:28 +03:00
command: >
/bin/bash
depends_on:
Project renames; publish and deploy (#12) * Add helm chart publication * Remove old cipublish path * switch from "1" to "true" GitHub sets CI to "true" rather than 1: https://docs.github.com/en/actions/learn-github-actions/environment-variables#default-environment-variables * wip -- attempt the run * don't condition deploy step for now * switch branch back to main youc an use $default-branch in templates, but not actual workflows: https://github.blog/changelog/2020-07-22-github-actions-better-support-for-alternative-default-branch-names/ * switch branch back to main youc an use $default-branch in templates, but not actual workflows: https://github.blog/changelog/2020-07-22-github-actions-better-support-for-alternative-default-branch-names/ * set azure env variables * parse and echo from json * don't set tenant id? https://github.com/hashicorp/terraform-provider-azuread/issues/343#issuecomment-721455149 ?? * oops i don't think these are getting passed through * add override compose this compose file un-sets the env variables that we don't have because we don't have a .env file in ci, so I _think_ it should inherit them from the environment * add back mqe resource group why was this deleted am i being trolled * Add path debugging * check what tf keys we got * remove api management from ingress 🤞🏻 * all container registries through github * remove debug prints from jinja * re-remove the mqe resource group because it was deliberately missing, not accidentally * skip tests for a sec * debug echo cluster name and rg * require az account env variables * reuse tf env variable names * don't point to `latest` tag * Add workflow for publishing helm charts to GH Pages. * Rename charts, separate published, reset versions * Use -dev suffix for development release * Publish dev charts only on main * Rename mqe -> stac, dqe -> tiler in codebase * Update README Rename MQE to STAC API and DQE to Tiler; also editorally make things more terse * Remove testdata, move loadtestdata to tests * Remove out of date and generic docs for tiler * Use cipublish to publish images * Rename python packages to be prefixed with 'pc' * Remove stac-vrt * Remove unused model and method. Also formatting * Remove scripts/env * Upgrade to stac-fastapi 2.2.0 * Delete unusued doc images * Update deployment code with renames. * Update cert-manager, other deployment fixes * Test on cibuild, remove GA test branch trigger * Fixup PR template Co-authored-by: Nathan Zimmerman <npzimmerman@gmail.com> Co-authored-by: James Santucci <james.santucci@gmail.com>
2021-11-01 18:27:39 +03:00
- stac
- tiler