Граф коммитов

34 Коммитов

Автор SHA1 Сообщение Дата
Marcus Robinson 792e1a46ac
Revert "Fix Blob.Created trigger to only handle Blob.Created events" (#4060)
Revert "Fix Blob.Created trigger to only handle Blob.Created events (#4044)"

This reverts commit 4334cbcb8f.

Co-authored-by: Tim Allen <tim.allen@cloudkubed.com>
2024-08-06 16:51:44 +00:00
Marcus Robinson 4334cbcb8f
Fix Blob.Created trigger to only handle Blob.Created events (#4044)
* Fix Blob.Created trigger to only handle Blob.Created events

Related to #3795

Update the `airlock_processor/BlobCreatedTrigger/function.json` to remove the binding for Blob.Deleted events.

* Remove the `dataDeletionEvent` binding from the `airlock_processor/BlobCreatedTrigger/function.json` file.
* Update the `CHANGELOG.md` to include the bug fix for the issue "Delete of in-progress container is triggered twice" (#4035).

---

For more details, open the [Copilot Workspace session](https://copilot-workspace.githubnext.com/microsoft/AzureTRE/issues/3795?shareId=XXXX-XXXX-XXXX-XXXX).

* Increment version

* Update version from 0.7.1 to 0.7.2

---

For more details, open the [Copilot Workspace session](https://copilot-workspace.githubnext.com/microsoft/AzureTRE/issues/3795?shareId=XXXX-XXXX-XXXX-XXXX).

* Update CHANGELOG.md

* Update CHANGELOG.md

---------

Co-authored-by: Tim Allen <tim.allen@cloudkubed.com>
2024-08-05 17:05:28 +00:00
Tim Allen e14f440d77
update dependabot dependencies (#4037)
* update dependencies

* update app version

* update chnagelog

* update

* Update CHANGELOG.md

* Update _version.py

* Update _version.py
2024-08-05 15:26:26 +00:00
Marcus Robinson ddddbf6e3e
Update packages for February Security Updates (#3866) 2024-03-05 17:55:52 +00:00
Anat Balzam d5cd77b3ef
Enable malware scanner - Defender for Storage (#3784)
* enable defender for storage on TRE core

* allow malware scanning only for import

* cr comments

* cr comments

* fix deletion issue

* add docs on malware scanning

* disable sensitiveDataDiscovery

---------

Co-authored-by: anatbal <anatbal@example.com>
2023-11-20 15:45:38 +00:00
Marcus Robinson 5848fcb9f8
Upgrade Python packages, switch to FastAPI lifespan async context manager (#3765)
* Many Python packages are outdated and need updating
Fixes #3764
2023-11-14 13:30:07 +00:00
Martin Peck fb4a3a1971
Upgrade Airlock and Apply FW Rule for Airlock (#3682)
* update function app runtime

* create app rule for airlock

* Increase core version

* Testing e2e shared service fix for failed firewall deployments.

* Add admin_connection_uri as output (#3684)

* remove retention policies from all resources

* update version numbers

* As using dev container base image with none root user this is redundant.

* Revert command changes, try setting user ID, add debug commands

* debug perms current dir

* revert debug commands

---------

Co-authored-by: marrobi <marrobi@microsoft.com>
2023-08-24 16:34:53 +01:00
LizaShak d316f1ad1f Integration and versions upgrade 2023-04-03 20:05:58 +00:00
Yuval Yaron 7b81ebe952 Remove the usage of azure-cli-core library (#3381)
* remove usage of azure.cli.core from airlock processor

* use urllib for parsing url

* update the way we get webapp_suffix  - to match the most recent  version of the module

* remove usage of azure.cli.core from resource processor

* remove usage of azure.cli.core from the api

* fix usage of terraform module terraform_azurerm_environment_configuration

* remove ARM_ENVIRONMENT where it's not used

* update versions

* remove unused os import from tests

* add credential_scopes to the config

* fix usage of RESOURCE_MANAGER_ENDPOINT in CREDENTIAL_SCOPES

* change the github source for terraform_azurerm_environment_configuration

* temporarily remove the version for terraform_azurerm_environment_configuration

* temporarily use the hash of the latest commit

* temporarily use the hash of the latest commit instead of version 1.0.1 of terraform_azurerm_environment_configuration

* update core
2023-04-03 09:52:14 +00:00
Anat Balzam f94384934a Support Airlock in GOV cloud (#3338)
* hardcoded storage endpoint

* fix unit tests, api hardcoded value

* bump api version

* support arm env in airlock processor

* rename

---------

Co-authored-by: Anat Balzam <anat@example.com>
2023-04-03 09:49:44 +00:00
Elad Iwanir 44d3b91069
Aligning airlock processor unittests to use pytest (#3086)
* aligning airlock processor unittests to use pytest

* update changelog

* update version

* Update airlock_processor/tests/shared_code/test_blob_operations.py

Co-authored-by: Tamir Kamara <26870601+tamirkamara@users.noreply.github.com>

* Update airlock_processor/tests/test_status_change_queue_trigger.py

Co-authored-by: Tamir Kamara <26870601+tamirkamara@users.noreply.github.com>

* adding mock to the req dev file

* fix

Co-authored-by: Tamir Kamara <26870601+tamirkamara@users.noreply.github.com>
2023-01-18 08:44:10 +00:00
Tamir Kamara 52448e41b5
Remove asyncio-mode=auto (#3043)
* remove asyncio-mode=auto

* versions
2023-01-02 13:02:50 +00:00
Elad Iwanir a64d1d7e3d
Enabling http2 (#2960)
* Enabling http2 + requesting client cert

* fix

* fix

* remove the client cert

* lint fix

* update core ver
2022-12-13 12:01:15 +02:00
Tamir Kamara 0582086bfb
Update python dependencies (#2907)
* update python dependencies

* versions

* fix pyetst asyncio

* lint bash

* comment check in a test
2022-11-27 16:58:24 +00:00
Yuval Yaron ac9f028638
Add 'status_message' for requests that are blocked by the malware scanner (#2666)
* change error_message to status_message

* add malware scanner result to status message

* update changelog and versions
2022-10-02 08:59:47 +00:00
Yuval Yaron 03a3aab4d0
Rename Azure Function ToDeleteTrigger to DataDeletionTrigger (#2592)
* add 'previous status' field to 'status changed' message

* add support for container deletion in azure function 'toDeleteTrigger'

* handle request cancellation in StatusChangedQueueTrigger

* fix  output event names

* update versions

* clean code by extracting to methods

* update changelog

* fix unit tests

* add unit tests

* use already declared variables instead of request_properties

* update api version

* update changelog

Co-authored-by: Elad Iwanir <13205761+eladiw@users.noreply.github.com>

* update log message

Co-authored-by: Elad Iwanir <13205761+eladiw@users.noreply.github.com>

* rename references of toDelete event to dataDeletion event in statusChanged function

* change toDelete to DataDeletion

* update version and changelog

* rename ToDelete to DataDeletion

* update version

* fix terraform file format

* fix terraform variable values

* update core version

Co-authored-by: Elad Iwanir <13205761+eladiw@users.noreply.github.com>
2022-09-14 11:04:32 +00:00
Yuval Yaron ed68d49940
Handle request cancellation in Airlock processor (#2584)
* add 'previous status' field to 'status changed' message

* add support for container deletion in azure function 'toDeleteTrigger'

* handle request cancellation in StatusChangedQueueTrigger

* fix  output event names

* update versions

* clean code by extracting to methods

* update changelog

* fix unit tests

* add unit tests

* use already declared variables instead of request_properties

* update api version

* update changelog

Co-authored-by: Elad Iwanir <13205761+eladiw@users.noreply.github.com>

* update log message

Co-authored-by: Elad Iwanir <13205761+eladiw@users.noreply.github.com>

* rename references of toDelete event to dataDeletion event in statusChanged function

* change toDelete to DataDeletion

* update version and changelog

Co-authored-by: Elad Iwanir <13205761+eladiw@users.noreply.github.com>
2022-09-13 17:11:17 +03:00
Yuval Yaron ff389150f7
Enumerating Airlock request files after request submission (#2504)
* add method to enumerate airlock request files

* add request_files to the output event of BlobCreatedTrigger

* consume request_files in the api

* fix merge conflict and add log

* clean code in BlobCreatedTrigger

* update api and airlock processor versions

* refine comment

* enumerate request files on failures

* add test for get_request_files in StatusChangedQueueTrigger

* add test for get_request_files in BlobCreatedTrigger

* refine log

* remove empty lines

* update changelog

* revet file enumeration in BlobCreatedTrigger

* add file enumeration to StatusChangedQueueTrigger

* add support for concurrent updates of airlock requests and for file enumeration response

* add test for file enumeration in StatusChangedQueueTrigger

* add ETag test case for update_airlock_request

* update api version
2022-08-30 12:32:36 +03:00
Tamir Kamara bd9396b078
Upgrade Terraform, AzureRM, Porter (#2501)
* update lock file script

* update lock files

* update timeout for gitea shared service e2e

* upgrade tf, tf-azurerm, porter

* native terraform vnet integration

* dump version
2022-08-24 19:12:54 +03:00
tanya-borisova edfe0f5613
Airlock data cleanup deletion when moving between stages (#2454) 2022-08-22 19:14:04 +01:00
Liza Shakury 3a64455180
Use delegated key when generating SAS token in API (#2460)
* Use delegated key when generating SAS token in API

* Upgrade AP version

* Upgrade versions

* Add to release notes

* Remove logging

* CR changes

* CR changes

* Rename account details

* Fix lint

* Upgrade api version.

Co-authored-by: Liza Shakury <lishakur@Lizas-MacBook-Pro.local>
2022-08-16 13:29:38 +03:00
Yuval Yaron ae8c251a2e
Move failed airlock requests to "failed" state (#2395)
* add failed status to airlock

* handle exceptions by sending a failed event to event grid

* fix typo

* do not raise the error in the catch, if the function's status is failed the output binding is not called

* log the exception

* fix "Error exception must derive from BaseException" error thrown

* add error message to failed airlock requests

* add airlock exceptions for a more specific cases

* fix test

* handle specific exceptions instead of handling all exceptions the same way

* update versions and changelog

* add error_message to sample airlock request in test

* fix airlock tests

* move strings to constants.py and rename variable
2022-08-04 13:27:45 +03:00
Tamir Kamara d1b2ef4bc4
Remove usage of storage account key in airlock processor (#2382)
* copy with delegation key

* part2

* update change log

* fix tf

* cr comments
2022-08-02 15:46:38 +03:00
Tamir Kamara 498ec31079
release 0.4 version (#2356) 2022-07-27 14:02:58 +03:00
Anat Balzam 4157f70f29
Fix Airlock blocked functionality (#2183)
* Fixing blocked container bugs

* cr comments

Co-authored-by: Anat Balzam <anatbalzam@microsoft.com>
2022-07-03 14:33:47 +03:00
Elad Iwanir bbb0b78ec7
Airlock - Adding missing blocked storage (#2163)
* Adding missing blocked storage
* opening the Scan result Event grid topic to public access so malware scanning can deliver messages
* adding missing scan_result topic subscription
2022-06-30 14:46:44 +03:00
Ross Smith ec0f56ccfe
Migrations were not running (#2151)
* Migrations were not running

* Amend build to migrate

* Bump version

* Fixed unit tests

* Bump version

* P1v3 -> P1v2

* Added insecure option for migrate

* Bump version

* Fixed insecure

* Bump Version
2022-06-29 22:20:48 +01:00
tanya-borisova 72e5dabc99
Fix pipeline uninstalling a parent instead of upgrading it (#2153) 2022-06-29 14:53:50 +01:00
Elad Iwanir 02c7fbe06a
Malware scanning support (no actual scanner) + Refactoring airlock stages (#2127)
* Malware scanning + Refactoring airlock stages

1. Malware scanning can be toggled on/off
2. Added missing stages 
3. Fixed TRE API to accommodate new stages
4. Added Scan Result function to handle malware scanning results
5. fixes TF to support the scanning toggle
2022-06-28 11:26:26 +03:00
Tamir Kamara c284039595
Run airlock's unit-tests in docker (#2128)
* airlock unit tests run in docker and ci

* bump version

* fix lint
2022-06-27 14:54:10 +03:00
Liza Shakury 2beb1f92ea
[airlock] Create containers (#2091)
* Create containers

* CR changes

* Lint fix

* Lint fix

Co-authored-by: Liza Shakury <lishakur@Lizas-MacBook-Pro.local>
2022-06-26 17:15:45 +03:00
Elad Iwanir 0a4e0d482f
Airlock processor networking (vnet integration and airlock subnet) (#2040)
* Airlock networking, including:

1. Airlock subnet in the core vnet
2. Airlock processor is now vnet integrated

* moving the airlock storage accounts to a dedicated subnet

* adding private endpoint for all event grid topics

* adding inbound rule to allow airlock processor to reach the workspaces

* Adding an AirlockEventSubnet
All eventgrids are in the AirlockEventSubnets
All airlock storage are in the AirlockStorageSubnet
The airlock function is in the AirlockProcessorSubnet
2022-06-16 21:40:24 +03:00
Elad Iwanir 11a39622c8
Airlock processor handles request Submission (#1978)
* Handling submitted/approved/rejected statusChangedEvent
terraform support for the az function

* Consolidate blob created queues to single SB topic + two subscriptions
Added support for blob created event handling in the airlock processor
airlock processor uses managed identity to get keys (+ added role assignment to SAs)
2022-06-14 13:45:51 +03:00
Elad Iwanir b11954c88a
Airlock processor - function app based - Base (#1950) 2022-06-02 09:12:26 +03:00