Граф коммитов

687 Коммитов

Автор SHA1 Сообщение Дата
Arjun Roy Chaudhuri 65c30d857f
Fix publish SBOM manifest with nuget package and Changing Win to Linux for release pipeline (#960) 2022-02-17 14:34:20 -08:00
Varad Meru 8a450e9023
Bumping up azure-functions==1.9.0 (#963) 2022-02-15 09:33:38 -08:00
Varad Meru 18aafe9f93
Enabling Python 3.10 CI and other changes (#961)
* Removing loop in Queue and fixing Python version test
* Updating the workflow files for 3.10 CI
* Updating Prod V4 info
* Enabling UTs to run for any Push
* Correcting the test skip for DI
* Updating readme.md for Python 3.10
* Skipping LC E2E tests for 3.10
* Bumping up EH version
* nit changes to use is_python_version and bumping up versions
* Resolving flake8 issues
2022-02-12 07:22:35 -08:00
Varad Meru 5e522fc610
Setting up dev as V4 branch for PyWorker (#936)
* Setting up dev as V4 branch for PyWorker
* Installing Dotnet 6 for AzurePipelines and GH Actions
* Disabling SharedMem tests from Mac, and disabling shm when disabled.
* Logging stdout errors, and adding proc kill for lingering processes
* Updating extension version in csproj
* Enable SharedMemory for Tests
* Adding extensionBundle info to host.json template
* Adding extension.csproj file for correctly loading extensions.dll
* Tweaking csproj for e2e tests
* Reintroducing Trace Logging
* Adding some sleep time
* Solving the timestamp timezone awareness issue
* Fixing UTs and E2E tests, setup.py changes, and v4 pipeline changes
* Formatting and Typo changes
* Refactoring azure.pipelines.yml file.
2022-02-04 14:35:36 -08:00
peterstone2017 3755e68eb8
Enable debug logging add recommendation (#948)
* enable debug logging recommendation log

* Fix logging.py change style

* style fix

* remove test

* use aka.ms link

Co-authored-by: wangbill <wangbill@microsoft.com>
2022-02-01 09:38:09 -06:00
Arjun Roy Chaudhuri 3d49d5bb5b
update nuspec to add sbom as part of package (#941)
Co-authored-by: Varad Meru <vrdmr@users.noreply.github.com>
2022-01-31 08:35:58 -08:00
peterstone2017 ae2160737d
Add comments to enable debug logging tests (#943)
Co-authored-by: wangbill <wangbill@microsoft.com>
2022-01-18 18:10:47 -06:00
Shreya Batra 707d56826a
Adding Shared Memory Diagrams (#942)
Adding a page in the GitHub wiki under Developer Topics for Shared Memory architecture information. These images contain diagrams that will be referenced in the page.
2022-01-18 14:56:09 -06:00
peterstone2017 191c9a0c2f
Enable debug logging using the PYTHON_ENABLE_DEBUG_LOGGING flag (#939)
* Supporting customer enable debug logging flag from app settings

* Removing unused import

* Fixed flake8 styling issues

* Fix flaky enable debug log tests

* Fix enable debug logging test

* Address PR feedbacks(Add test case, Copyright, remove comments)

* Remove duplicate test app for enable debug logging testing

Co-authored-by: wangbill <wangbill@microsoft.com>
2022-01-14 16:05:45 -06:00
Arjun Roy Chaudhuri edc21f8c62
update pipeline's agent pool as per bi operation recommendation (#925)
* update vmimage demand in yaml as per exec order
2022-01-06 10:26:42 -08:00
gavin-aguiar fd6f8c10ea
Enable dependency isolation by default for python 3.10 (#922)
* Enable dependency isolation by default for python 3.10

* Simplified condition to run unit test

Co-authored-by: Gavin Aguiar <gavin.aguiar@microsoft.com>
2021-12-07 16:38:04 -08:00
gavin-aguiar 2bc45d1aaf
Added e2e tests for dependency isolation (#919)
* Added e2e tests for dependency isolation

Co-authored-by: Gavin Aguiar <gavin.aguiar@microsoft.com>
Co-authored-by: Varad Meru <vrdmr@users.noreply.github.com>
2021-12-03 11:28:07 -06:00
Arjun Roy Chaudhuri a83ac06e37
remove copy file task from pipeline and run sbom manisfest task in artifactstagingdirectory(#921)
* remove copy file task

* add debug lines

* revert debug/test tasks
2021-12-02 15:58:07 -08:00
Arjun Roy Chaudhuri 93738f1856
add sbom generator task in the pipeline (#918)
* add sbom generator and validator task

* update

* update

* update

* added some debug steps and commented out condition to check metadata task in the azure pipeline

* test

* update

* update

* update

* update

* update

* remove and update

* remove debug lines
2021-12-01 12:24:25 -08:00
Varad Meru f6f66c7bc8
Update Python SDK Version to 1.8.0 (#913) 2021-11-12 17:42:23 -08:00
gavin-aguiar 291a85279f
Added Retry Context for python worker (#909)
* Retry context initial commit

* Added unit tests

* Fixed spacing

* Removed additional log

* Fixed Lint check errors

* Fixed line spacing errors

* Refactored get_context

* Reverting setup.py

* Updated setup.py

* Added doc links

Co-authored-by: Varad Meru <vrdmr@users.noreply.github.com>
2021-11-01 16:38:21 -07:00
Francisco Gamino 51b47ed282
Update logic to push the Python worker package to the AzureFunctionsPreRelease feed (#908) 2021-11-01 00:14:40 -07:00
Varad Meru ae1f5f5796
Fixing multiple pipelines - OGF and Integration tests (#902)
* Reducing the storage account length in OGF workflow
* CODEOWNERS updated
* New BuildNumber and changing version spec.
2021-10-28 23:50:03 -07:00
Varad Meru 8f03839ea9
Add dotnet 5.0.x in CI pipeline to fix errors (#901) 2021-10-20 00:12:35 -07:00
Gohar Irfan Chaudhry 6e3ecd42bb
Using the cache for function bindings and not deleting shared memory resources upon request to close (#844)
* Separate field in the message to close shared memory maps which indicate if the maps should be deleted or just the reference should be dropped
* Check for function data cache capability from host
* Update azure_functions_worker/bindings/meta.py
* Addressing comments for cleaning up shared memory usage checks in meta.py
2021-10-01 18:32:22 -07:00
AzureFunctionsPython fdb3bd9208 Update Python Worker Version to 1.2.6 2021-09-24 16:49:30 +00:00
Varad Meru 4da437d7d2
Add a default script_file for function.json without scriptFile (#893) 2021-09-22 23:52:43 -07:00
Hanzhang Zeng 7630661394
Add Linux Consumption Testing Utils (#882)
* Add Linux Consumption WebHost Controller
* Add safe kill container method
* Header generator
* Add specialization encryptor
* Add testing utils for Linux Consumption
* Link docker executable into pytest
* Test with docker --help
* Install fuse
* Fix test cases
* Test Docker
* Introduce pytest from python
* Use privileged permissions to execute python
* Elevate superuser permission
* recover ci e2e workflow
* Is docker working on GitHub Action
* Extract arguments
* Use privileged mode
* Fix pylint
* address PR issues
2021-09-17 17:51:45 -07:00
Varad Meru f5271ce323
Setting special limits for Python 3.6 and 3.7 (#890)
* Setting special limits for Python 3.[6|7]
* Updated CODEOWNERS file
2021-09-14 12:43:52 -07:00
AzureFunctionsPython f5a68bd203 Merge remote-tracking branch 'origin/release/1.2.5' into dev 2021-08-06 21:18:05 +00:00
Hanzhang Zeng 77bf3a107e Disable dependency isolation (#877) 2021-07-23 14:10:08 -07:00
AzureFunctionsPython 316eec6af0 Update Python Worker Version to 1.2.5 2021-07-23 21:09:02 +00:00
Hanzhang Zeng 2400749fac
Disable dependency isolation (#877) 2021-07-23 14:06:25 -07:00
Varad Meru e9afecc971
Update the max TP threads count to sys.maxsize (#875)
* Removing any max limits altogether.
2021-07-22 17:07:58 -07:00
AzureFunctionsPython e4adb351e5 Merge remote-tracking branch 'origin/release/1.2.4' into dev 2021-07-13 23:48:17 +00:00
Hanzhang Zeng (Roger) 637df71bf1 Update version to 1.2.4 2021-07-02 12:12:59 -07:00
Hanzhang Zeng 295caf4376
Ensure azure namespace is established in 3.9 (#869) 2021-07-02 12:01:09 -07:00
Hanzhang Zeng (Roger) b157632b3a Merge remote-tracking branch 'origin/release/1.2.3' into dev 2021-07-02 11:15:56 -07:00
AzureFunctionsPython 22802c2b5f Update Python Worker Version to x.y.z (e.g. 1.1.8) 2021-07-02 18:12:16 +00:00
Francisco Gamino dbcc645c12
Update AspNetVNext value to https://www.myget.org/F/aspnetcore-dev/api/v3/index.json (#862) 2021-06-15 14:16:15 -07:00
Hanzhang Zeng 213b051d70
Skip paths resolution if in Integration Test CI (#859)
* Skip paths resolution if in Integration Test CI

* Removed unused import

* Wrap test os.environ into a separate patch session

* Fix extension patching
2021-06-07 14:36:31 -07:00
AzureFunctionsPython 4356c0036e Update Python Worker Version to 1.2.3 2021-06-04 21:39:04 +00:00
Hanzhang Zeng 8f3645cefd
Fix issue when isolating libraries when file not ready (#854)
* Fix an issue when isolating libraries when file not mounted

Adding namespace import scenarios

Ensure changes

Add unittests

Amend test cases

Fix an issue when customer defines a module with collided name

Fix test_paths_resolution

Fix case

* Squash commit

* Retry webhost resolution

* Reload linux consumption environment

* Add more logs in depenency

* Refactor prioritize_customers_dependencies

* Remove unnecessary if statements

* Fix linting

* Fix namespace packaging

* Revert "Fix namespace packaging"

This reverts commit 8cb98eeb74.

* Only fix namespace in Python 3.9

* Fix tab typo

* Fix naming

* Should fetch the data from variables
2021-06-04 14:36:22 -07:00
Hanzhang Zeng d2005ff723
Update Python SDK Version to 1.7.2 (#857)
Co-authored-by: AzureFunctionsPython <funcdisc@microsoft.com>
2021-06-03 11:58:26 -07:00
Hanzhang Zeng (Roger) 7978dfc26d Add retry pattern in Unittest and E2E pipelines 2021-06-03 11:36:55 -07:00
Hanzhang Zeng f4156b1983
Disable isolate worker dependencies for Python 3.9 (#855)
* Disable isolate worker dependencies

* Mark unittest

* Skip tests that assumes the feature flags are turned on
2021-06-02 13:06:19 -07:00
Hanzhang Zeng 4cf6402a2e
Update Python SDK Version to 1.7.1 (#856)
Co-authored-by: AzureFunctionsPython <funcdisc@microsoft.com>
2021-06-02 12:41:33 -07:00
Hanzhang Zeng a3c047bb01
Categorize SDK logs as system logs (#850)
* Add testing for cases

* Amend expected behavior
2021-06-02 10:22:27 -07:00
Hanzhang Zeng 473cd1e264
Re-enable WorkerStatus report in Worker (#848)
* Add E2E tests

* Test disabled scenario
2021-05-10 18:21:47 -07:00
Hanzhang Zeng 1fdc110969
[HotFix] Disable Worker Status Report (#846) 2021-05-04 14:40:45 -07:00
Hanzhang Zeng 58544e9438
Generate E2E integration test report in Azure DevOps (#845)
* Enable Azure DevOps pipeline test generation

* Update the pipeline.yml

* Fix variable

* Remote docmodule test

* Disable broken throughput test
2021-05-03 12:25:42 -07:00
Hanzhang Zeng (Roger) 299701ebca [HotFix] Add shared_memory_data_transfer in setup.py 2021-04-05 13:18:07 -07:00
AzureFunctionsPython 2d73430059 Update Python Worker Version to 1.2.0 2021-04-05 17:08:26 +00:00
Hanzhang Zeng 7cee87120f
Python Worker Extension Interface (worker) (#815) 2021-04-01 16:12:03 -07:00
Gohar Irfan Chaudhry 9324efc5d4
Shared memory data transfer between Functions Host and Python worker (#816)
* Basic structure laid out for reading parameters from shared memory before passing to the function

* Writing output from worker to Shared Memory

* Put output from worker into Shared Memory

* Free shared memory resources after use

* Removed control flag from mmap header

* Proto change

* Working for blob shared memory data transfer; needs clean up, comments and tests

* Changing message for closing mmaps

* Support for string datatype for shared memory data transfer

* Change to oneof

* Use oneof in .proto

* Refactoring mmap_handler

* Refactoring, cleaning up and adding docstrings

* Updating CloseSharedMemoryResourcesResponse usage

* Fixing accidental changes to tests/*

* Addressing comments

* Basic structure laid out for reading parameters from shared memory before passing to the function

* Writing output from worker to Shared Memory

* Put output from worker into Shared Memory

* Free shared memory resources after use

* Removed control flag from mmap header

* Proto change

* Working for blob shared memory data transfer; needs clean up, comments and tests

* Changing message for closing mmaps

* Support for string datatype for shared memory data transfer

* Change to oneof

* Refactoring mmap_handler

* Refactoring, cleaning up and adding docstrings

* Updating CloseSharedMemoryResourcesResponse usage

* Fixing accidental changes to tests/*

* Addressing comments

* Cleaning up, addressing comments

* Following same class structure as the shared memory changes made for the host

* Moving shared memory data transfer related changes into separate directory

* Input error checks for shared memory map ctor

* Rebase fix

* Trying to make lint happy

* Making flake8 happy

* Fixing more lint issues

* Removing the use of __annotations__ to be compatible with Python 3.6, adding FileAccessor tests

* Added tests for FileAccessor, SharedMemoryMap, FileAccessorFactory

* Adding shared memory test setup for Unix

* Adding tests for SharedMemoryManager

* Adding tests to ensure the dispatcher can invoke the function and send/receive inputs over shared memory using a mock host

* More tests for worker/dispatcher's use of shared memory

* Using truncate instead of writing 0x00 byte manually upon creating mmap. More tests for multiple input/output blobs.

* Addressing comments

* Adding missing tests and doc strings for tests and their classes

* assertEqual -> assertTrue in test_dispose_without_delete_file

* Tried with blob trigger function - removed TODO

* Addressing comments

* Minor const fix

* Addressing comments

* Fixed test - removed unused test functions

* Addressing comments; caching list of valid directories for later use instead of checking every time

* Whitespace fix

* Cleanup

* Adding AppSetting to override shared memory directory for Unix - test setup for macOS

* Logging subprocess result in Exception

* Changed Exception -> IOError

* Check shared memory directory AppSetting only for Darwin tests

* Fix test cleanup for Darwin

* Only split AppSetting list of directories if the AppSetting was found

* Fix consts.UNIX_TEMP_DIRS

* Typo fix

* Adding throughput tests for blob input/output using shared memory

* Changing branch hardcode to instead use current branch

* Creating tests URL from current branch name

* Whitespace fixes

* Using tests from local dir

* Removing the need to use a URL for tests; just use from local directory

* Rename env variable to follow convention from host of using FUNCTIONS_

* Addressing comments

* Fixes for running tests on macOS

* Log which allowed directories for shared memory are being used

* Change assert -> raise

Co-authored-by: Hanzhang Zeng <48038149+Hazhzeng@users.noreply.github.com>
2021-03-24 10:53:56 -07:00