Граф коммитов

246 Коммитов

Автор SHA1 Сообщение Дата
Marc Lichtman c431d0f1d0
Block search calls that dont include a collection in the body or query param (#240)
* Block search calls that dont include a collection in the body or query param

* also allow collectionid to be in the filter

* switch to orjson

---------

Co-authored-by: Marc Lichtman <marclichtman@microsoft.com>
2024-10-25 12:33:59 -04:00
Marc Lichtman 8602de8930
Remove brackets around tag 2024-09-03 16:48:39 -04:00
Marc Lichtman 32d9bb8eaf
Push image to prod ACR with unique tag (#238)
Co-authored-by: Marc Lichtman <marclichtman@microsoft.com>
2024-09-03 16:45:56 -04:00
Marc Lichtman 51ca4e8cf8
Fixed searchid bug, added unit tests, improved main readme (#236)
* fixed searchid bug and added unit tests

* readme tweaks

* black line length

* change line length in flake settings

* revert line length change, going to do it in separate PR

* autoformatter

* retrigger github actions

* Delete scripts/test-mosaic

* hack for not needing secrets AZURITE_ACCOUNT_KEY

* shorten command

* testing output

* remove grep

* quotes

* trying another method

* trying another method

* remove extra echo

* tweaks

* remove echo

* use env

* test failure

* fail step

* try removing azurite from api validator

* autoformatter

* pipeline tweak

* Delete storage-use-azurite?tabs=visual-studio,blob-storage

---------

Co-authored-by: Marc Lichtman <marclichtman@microsoft.com>
2024-08-30 10:52:28 -07:00
Maitreyee Joshi 822f8f5120
Remove development azurite keys (#235)
* remove development azurite keys

* add AZURITE_DEFAULT_KEY to workflows

* rename azurite default key

* fix validate

* lint fix

* add defult key before validate

* test

* revert test change

* remove dash from docker-compose

* revert change

* replace docker-compose with docker compose

* add AZURITE_ACCOUNT_KEY as env var

* update azurite account key

---------

Co-authored-by: elay <yileihu@microsoft.com>
2024-08-13 10:36:10 -07:00
Matt McFarland d2b46c9ae8
Add support and tests for legacy mosaic tile routes (#234)
* Add support and tests for legacy mosaic tile routes

The tile route prefixes were reordered in recent versions of
titiler.pgstac. Both versions of the routes are supported in PC and
tests have been added to confirm.
2024-07-18 12:40:01 -04:00
Matt McFarland 66fa8fe96d
Update pydantic, titiler, stac-fastapi (#233)
* update pccommon requirements

* update pcstac requirements

* update pcfuncs

* update pcfuncs/pcstac/pccommon

* allow YYYY-MM-DD date format in search

* update pctiler

* update stac-fastapi.*

* Dependencies

* Get mosaic tiles working

* Formatting

* Use items request model

* Backwards compat with searchid

* certifi upgrade

* Read envs correctly

* Restore health check filtering

* Update titiler uvicorn

* lint

* Fix casing on colormaps

* Fix cmap and add /crop

* Fixups

---------

Co-authored-by: vincentsarago <vincent.sarago@gmail.com>
2024-07-17 10:22:54 -04:00
elayrocks 23b5e6936b
Add subnet of pct sas kubernetes cluster to the storage account that holds ip ban table (#230)
Co-authored-by: elay <yileihu@microsoft.com>
2024-07-02 10:47:02 -07:00
Matt McFarland 302a44fc9b
Upgrade stac urllib3 (#229) 2024-07-01 16:37:41 -04:00
Matt McFarland cfaf0a8992
Function identity and storage network access (#228)
* upgrade to linux app and use identity based storage connection for function app

* add back config

* remove settings for remote build, enable local build

* Set default deny network action on SA

* Add IP to tf state storage firewall

* Add subscription to shared access key setting

* Function debugging in new premium service plan

* Assign function subnet to output storage

* Cleanup

---------

Co-authored-by: elay <yileihu@microsoft.com>
Co-authored-by: Rob Emanuele <rdemaneuele@gmail.com>
2024-07-01 14:37:27 -04:00
elayrocks a08f05e5d1
Azure Function App which runs periodically to aggregate the bytes read per IP address over a window of time (#215)
* init

* update

* update flake8 config

* code format changes

* fix long lines

* fix imports

* function app changes

* code format changes

* test

* remove readme

* remove redundant packages and revert python version

* revert python version

* remove redundant type hints

* use settings class inherited from baseSettings

* change kql

* use placeholder for timer schedule

* change test parameter

* update assertions and logger

* remove import

* remove dash in table name

* update test id

* format

* add no-integration flag

* add dependencies

* test

* change trigger to run every hour

* use azure clients as context manager

* add  context managers in test

* role assignment for function app

* change LAW name

* change role

* change provider's name

* change name of LAW

* better readability

* better readability

* format

* add logging

* UPDATE function settings

* suppress mypy warning

* update env variables for function app

* typo

---------

Co-authored-by: elay <yileihu@microsoft.com>
2024-06-26 08:16:00 -07:00
Matt McFarland 69098c7014
Storage access fixes (#225)
* Use AzureAD auth for terraform backend

Move away from using shared key credentials for the backend auth in both
CI and local dev.

* Test deploy

* CLI + OIDC

* Debug

* Remove debug
2024-06-24 14:42:18 -04:00
Matt McFarland 9beb59b65b
Remove storage account keys from deployment (#224)
* Remove storage account keys from table access

* pcfuncs don't use keys

* Deploy and tests

* Contrib

* Remove temp

* Remove verbosity

* Move settings validation to startup check
2024-06-24 09:50:39 -04:00
Matt McFarland 3b1e9f7258
Set root-path from uvicorn (#221)
* Set root-path from uvicorn

Sets the root path in uvicorn to match that set via FastAPI. This is
required with updates to starlette, which were included previously.

Fixes https://github.com/microsoft/PlanetaryComputer/issues/360

* New black formatting
2024-06-14 13:58:12 -04:00
Matt McFarland 54802baff3
Bump requests (#220)
* Bump requests

Near-SLA vulnerability

* Bump in pcfuncs as well

* Actually do pcfuncs bump
2024-06-13 12:32:32 -04:00
Matt McFarland 034b9c3bb2
Security patching (#219)
* Security patching

Near-SLA security updates

* fixup
2024-06-12 10:53:46 -04:00
Matt McFarland dc022d44b8
Auth against pccomponents for tagged image publish (#217)
* Auth against pccomponents for tagged image publish

* Reconcile node count with deployment
2024-06-11 16:06:04 -04:00
Matt McFarland 5628de76c2
Security upgrades for pcstac and pctiler (#214)
* Upgrade STAC libraries

* Updates for tiler
2024-06-11 13:52:48 -04:00
Matt McFarland 34ebd993c7
Use mcr for nginx-ingress (#213)
Also updates:
- 24 hour image cleaner cycle
- Don't specify k8s version; it's auto upgraded
2024-06-07 14:58:39 -04:00
elayrocks 2df6413d95
Merge pull request #208 from microsoft/remove-secret-from-cicd
Remove secret from cicd
2024-05-02 14:05:51 -07:00
elayrocks f4e3d903e3 ready for review, revert the changes for testing purpose 2024-05-02 13:27:45 -07:00
elayrocks 39dc68add8 test 2024-05-02 12:17:38 -07:00
elayrocks d9f8247026 test 2024-05-02 11:33:16 -07:00
elayrocks cfd385dc01 test 2024-05-02 11:30:00 -07:00
elayrocks b6e42aebfd test 2024-05-02 10:09:37 -07:00
elayrocks 9f9fb83800 test 2024-05-02 10:03:55 -07:00
elayrocks f511643931 try Matt's fix 2024-05-02 09:47:47 -07:00
elayrocks 91fe97de14 test 2024-05-02 00:10:21 -07:00
elayrocks c995a47c28 test 2024-05-01 23:57:39 -07:00
elayrocks bab9c3d369 test 2024-05-01 23:53:23 -07:00
elayrocks 95bfabd873 test 2024-05-01 23:48:57 -07:00
elayrocks a94c00e8a0 test 2024-05-01 23:45:21 -07:00
elayrocks 8ed4dc589d test 2024-05-01 23:41:36 -07:00
elayrocks ee0f20d30d test 2024-05-01 23:29:48 -07:00
elayrocks cfa7afc76a test 2024-05-01 23:23:59 -07:00
elayrocks ea587c08ec test 2024-05-01 23:03:59 -07:00
elayrocks 214fdffce0 test 2024-05-01 23:00:31 -07:00
elayrocks 92ee274b3d test 2024-05-01 22:46:43 -07:00
elayrocks 3e7fc3e1df test 2024-05-01 21:23:32 -07:00
elayrocks ea62afc4a1 test 2024-05-01 19:13:09 -07:00
elayrocks 3cf35c2826 test 2024-05-01 19:02:36 -07:00
elayrocks b033600a45 remove secret 2024-05-01 18:59:49 -07:00
elayrocks 2493804f44 test 2024-05-01 18:51:48 -07:00
elayrocks a235a6d26f test 2024-05-01 18:42:48 -07:00
elayrocks 5c91f11425 test 2024-05-01 18:36:56 -07:00
elayrocks 2e424d8b2b test 2024-05-01 18:34:28 -07:00
elayrocks 2c38f89331 remove azlogin 2024-05-01 18:13:12 -07:00
elayrocks 16f0c9f302 test 2024-05-01 18:00:33 -07:00
elayrocks eb34587a3f test 2024-05-01 17:53:52 -07:00
elayrocks 0487135933 test 2024-05-01 17:46:13 -07:00