* Reuse same branch name for previews of a PR
* Default AddBuildSummary parameter using pipeline variable existence
---------
Co-authored-by: Patrick Hallisey <pahallis@microsoft.com>
* Changes to scripts to deal with PATs and AccessTokens
* swap access and auth for add-retention-lease
* AuthToken to BearerToken and remove unused Base64EncodedAuthToken from the script parameters
* remove unneccsary if not null check for the mandatory parameter
---------
Co-authored-by: James Suplizio <jasupliz@microsoft.com>
* Migrate stress cluster to use workload identity
* Only sleep to sync fed creds when namespace is new
---------
Co-authored-by: Ben Broderick Phillips <bebroder@microsoft.com>
* consume newest stable version of the test-proxy
* remove the override pin such that CI reverts to honoring eng/common/testproxy/target_version.txt again
---------
Co-authored-by: Scott Beddall <scbedd@microsoft.com>
* ensure we write the log to the same root directory as what is being used for the proxy invocation
* fix spacing
* we should write these proxy logs to the same root folder that we start the proxy in
---------
Co-authored-by: Scott Beddall <scbedd@microsoft.com>
* Add support for Federated Auth to test resources scripts
* Default -- UseFederatedAuth: false
* Clear secrets if FederatedAuth is set
* Template conditions use AzurePowerShell only when a service connection is needed
* Review feedback and pair with Ben
* Update docs
* http:// -> https://
---------
Co-authored-by: Daniel Jurek <djurek@microsoft.com>
This PR updates our Python testing framework to adopt the new TestProxy
which enables numerous common sanitizers.
Signed-off-by: Paul Van Eck <paulvaneck@microsoft.com>
* allow an override FILE to be honored by test-proxy-tool
* update local test-framework to honor proxy override version by default
---------
Co-authored-by: Scott Beddall (from Dev Box) <scbedd@microsoft.com>
* Only make one call to GetPackageInfoJson
* fix copy/paste, it should be packageInfoLocation not packageInfoJsonLocation
---------
Co-authored-by: James Suplizio <jasupliz@microsoft.com>
* Show review link in logs and set DevOps project name based on the pipeline run
* Add project param in request
---------
Co-authored-by: Praveen Kuttappan <prmarott@microsoft.com>
* [Core][Corehttp] Update multipart test-server code
Aiohttp now doesn't set payload `Content-Length` headers. Let's stop
checking content length in the test server assertions.
Signed-off-by: Paul Van Eck <paulvaneck@microsoft.com>
* Update eng/tox/install_depend_packages.py
---------
Signed-off-by: Paul Van Eck <paulvaneck@microsoft.com>
Co-authored-by: Xiang Yan <xiangsjtu@gmail.com>
Moving away from SAS tokens for connecting to storage so switching to using a Workload Identity Federation connection to the container to download the needed files.
Co-authored-by: Wes Haggard <weshaggard@users.noreply.github.com>
* Pass flag to suppress errors correctly when verifying release change log
* Changes as per review comments
---------
Co-authored-by: Praveen Kuttappan <prmarott@microsoft.com>
* Updates for docs ToC generation
* Complete an existing partial comment
* Temp DocIndex testing change, will be removed before merge
* Actually remove the networkservice usage since it was deleted
* Change the if that checks for Namespaces to work in strict mode
* change order of pip command line, set namespaces to library name if none are found
* Add a couple of temp commands to get pip's version and upgrade
* remove pip version/update commands from script and add to yml
* revert the yml changes and add an equals sign in between the --extra-index-url option and the url
* modify the download command
* Fix the command line args for PSNativeCommandArgumentPassing Standard
* Remove temporary changes to docindex.yml
* Finish a sentence fragment in a comment and add comment to Language-Settings to make a function searchable.
* Update eng/scripts/Language-Settings.ps1
Co-authored-by: Ben Broderick Phillips <ben@benbp.net>
---------
Co-authored-by: Ben Broderick Phillips <ben@benbp.net>
* Pipeline template to validate package and update package work item
* Changes to restructure validations
* Additional fixes as per comments
* Remove explicit exit code
* Set erroractionpreference for change log check
---------
Co-authored-by: Praveen Kuttappan <prmarott@microsoft.com>
* ensure that image.yml is populated everywhere
* update ci.yml to also use the variables as provided by image.yml
* update gitignore so that our updates don't break anyone's analyze
* ensure analyze weekly runs on the correct job
In the case there is exactly one previous release PS will return the single object and thus the Count property will not exist. Instead this change ensures that we always have a list.
Co-authored-by: Wes Haggard <weshaggard@users.noreply.github.com>
* Run publish on failed or succeeded
* Expand agent os string detection
* Check agent job status env var for artifact name detection
* Add sbomEnabled flag to publish template
* Fix image and artifact name conditional
---------
Co-authored-by: Ben Broderick Phillips <bebroder@microsoft.com>
* use optional env for azure openai tests and remove v0 tests
* update param ToxTestEnv in live test template
* enable optional
* debug
* fix config options
* fixes to path for audio file and install aiohttp dev req
* remove debug logging line
* debugging test failure
* more debug
* undo debug testing, use pathlib for paths, target sys.executable for cli tests
* cspell ignores
* no logprobs
* Add 1es changes for job/matrix generation and publish
* Use more flexible pool filter for prev/next pool matches
* consolidate displayname definition
* use linux pool variables for generate matrix job
* Fix publish artifact
* Use single publish task for publish artifact
---------
Co-authored-by: Ben Broderick Phillips <bebroder@microsoft.com>
* Support resolving environment variable references in matrix config
* Improve type and null handling
* Fix reference bug
* Change behavior on missing env vars to throw
---------
Co-authored-by: Ben Broderick Phillips <bebroder@microsoft.com>
* Added Cross partition query tests for sync and async APIs
* Added license header for new files
* Updated database and container creation
* Updated python tests with setup and tear down
* Fixed some tests cases
* Fixed spelling
* Added emulator CI
* Removed python 3.7 emulator tests config
* Removed collection crud tests from emulator
* Updated some collection heavy tests to skip for emulator
* Fixing python 3.10
* Marking test_computed_properties async test to run only in live tests
* Fixed emulator tests with pytest fixtures
* Fixed more emulator tests with pytest fixtures
* Fixed more emulator tests with pytest fixtures
* Fixed more emulator tests with pytest fixtures and updated azure core min version
* Fixed flaky tests
* Updated stored procedure create calls
* Fixing sproc test
* Fixing trigger test
* Fixing flaky live ci tests
* Fixing max parallel and removed python 3.11 for cosmos emulator windows as there is a python open issue
* Added MIT license header
* Update sdk/cosmos/azure-cosmos/test/test_partition_split_query.py
---------
Co-authored-by: Simon Moreno <30335873+simorenoh@users.noreply.github.com>
* Fix sparse-checkout git command line behavior
* Use command arg parsing behavior in sparse-checkout.yml
---------
Co-authored-by: Daniel Jurek <djurek@microsoft.com>
* Prepare-Release.ps1: Make dateTime.ToString("MM/dd/yyyy") to work on exotic set-ups
On my machine, I experimented with the registry, and the worst part is that I don't remember/know how to reset it back.
The work items that script produces, do have datetimes for the upcoming releases in the `MM-dd-yyyy` format, and then I have to correct them by hand.
`dateTime.ToString("MM/dd/yyyy")` does produce the date in the format of `MM-dd-yyyy` on my machine. This also happens if I write a corresponding .NET app.
The fix that I am proposing makes it work on my specific setup and hopefully breaks no one else. I understand if you are hesitant to take it. Let me know, I'll see how I can restore my setting.
But on the other hand, I don't think it makes anything worse, it only makes things more robust, so maybe take it?
* Use [CultureInfo]::InvarialtCulture
Co-authored-by: Wes Haggard <weshaggard@users.noreply.github.com>
* Update eng/common/scripts/Prepare-Release.ps1
* Update eng/common/scripts/Prepare-Release.ps1
---------
Co-authored-by: Anton Kolesnyk <41349689+antkmsft@users.noreply.github.com>
Co-authored-by: Wes Haggard <weshaggard@users.noreply.github.com>
* Remove package retrieval when verify pkg version
* Modified description of PackageName parameter
---------
Co-authored-by: Ray Chen <raychen@microsoft.com>
* Correct the name of JS package folder
* Uncomment the package verification
* Logging more info for troubleshooting
* Get sdkType and directory from the package info
---------
Co-authored-by: Ray Chen <raychen@microsoft.com>
* Support creating resources with user auth
* Log warning if TestApplicationId is set
* missing space
* regenerate md file
* Rename
* Update link
---------
Co-authored-by: jolov <jolov@microsoft.com>
* add close_vnext_issue function
* add close_vnext_issue function to ci checks that create issues
* add strict sphinx
* log GH issue number we're closing
* Add ConflictedFile to git-helpers.ps1, add git-helpers.tests.ps1 to exercise basic functionality.
* Add `resolve-asset-conflict.ps1` a script that can autoresolve an assets.json file.
---------
Co-authored-by: Scott Beddall (from Dev Box) <scbedd@microsoft.com>
Co-authored-by: Scott Beddall <45376673+scbedd@users.noreply.github.com>
Co-authored-by: Ben Broderick Phillips <bebroder@microsoft.com>
* Added script and pipeline for spec location validation
SDK release pipeline would run this validation to ensure the spec comes from
the main branch of Azure/azure-rest-api-specs repo
* Update parameter
* Use github rest api to validate commit
* Added token parameter
* Support more yaml cases and other languages
* Removed the default setting in yaml template
* Only validate in case of GA package
* Follow APIView to retrieve package version for verification
* Get github token from env variable
* Removed obsolete parameter
---------
Co-authored-by: raychen <raychen@microsoft.com>
* Add package filter parameter to select recursively found packages in release
* Handle empty value for packageFilter
---------
Co-authored-by: Ben Broderick Phillips <bebroder@microsoft.com>
* remove 3.7
* require pygithub (and from there pynacl) from the default requirements set. this should allow testing on windows pypy39 to successfully install requirements
* remove python_version spec
* rebalance to force windows onto py310. there iwn't a wheel for pywin32 that works with pypy
* Update tools/azure-sdk-tools/setup.py
* Image Analysis Python SDK
* Fix ci.yml name and add code owners
* Update cspell.json and CODEOWNERS
* Root README.md: Use full-path links, fix broken links, and some other minor text correction
* Fix `Run Pylint` issues. Add README.md on hand-customization
* More pylint fixes
* Fix samples errors in `Run MyPy` job, and update root README.md
* mypy fixes in test
* More mypy fixes in test
* More mypy fixes in test
* More mypy fixes in test
* Fix Run Pyint
* Recordings for sync tests
* Test recordings for async
* Push test recordings to azure-sdk-assets
* Correct build of path to load sample.jpg
* Add 'TestProxy: true' to ci.yml
* Add mypy.ini file to suppress errors from auto-generated _models.py
* 2nd attempt to suppress MyPy errors
* Add samples and tests README.md files
* Fix `Verify Readmes` by excluding README.md in the test folder
* Set version to 0.16.0b1
* Changed my mind... going back to version 1.0.0b1
* Fix sphinx issues
* Fix pylint
* Move customization to _patch.py files
* Suppress MyPy errors on sample code. The error message was: `error: ImageAnalysisClient has no attribute analyze [attr-defined]`
* Update root README.md
* Address review comments from xiangyan99. Thank you Xiang!
* Revert back to Python 3.7 as required minimum version instead of 3.8, size ADO pipeline still uses 3.7 for Windows tests
* Updates to MyPy error suppression
* Add notes in root README.md to mention Document Intelligence service
* Updates samples: closing bracket in a new line
* Remove the call to client.close() from sync samples. Add one more async sample. Fix docs for VisualFeature
* Fix typo in samples README.md
* Minor updates, based on review comments from the Java SDK PR
* Update release date and comment in CHANGELOG.md
* Fix Lint CODEOWNERS issue (unrelated to this PR)
* Fix typo
* Remove unneeded `f` from print(f...) when no argument specified
* Update code-snippets in package README.md following previous commit to sample code
* No need for `bytes` in the call to `bytes(f.read())`. Also fix broken sample_ocr_image_url_async.py
* Use aka.ms links for ref-doc and packages. Also update aka.ms link for sample.jpg
* Pick up new TypeSpec commit, where one ref-doc sentence was removed
* Use overloads with image_url and image_data as inputs
* fix `tox run -e pyright` error
* Fix pylint error, that was a result of my pyright fix...
* Attempt to workaround ref-doc issue tool https://github.com/Azure/autorest.python/issues/1315
* Do the same as previous commit, but for the async client
* Fix Pylint issue (missing distributed_trace_async)
* Make sure analyze overload ref-docs appear
* make sure client constructor ref-docs appear
* check for the presence of a compatible powershell. ensure that we always return a list of tags
* allow the script to require pshell6+
* remove the en-us from the link
---------
Co-authored-by: Scott Beddall (from Dev Box) <scbedd@microsoft.com>
* add strict-sphinx for issue creation
* add vnext_issue creator to run_sphinx_build
* add GH_TOKEN to generate docs to step
* update template
* update date to april deadline
* don't need args
* only open issues if running in analyze-weekly
* add in rohit's feedback
* try ci_enabled flag
* try using a gh env var
* fix import
* set env var, add filter in discover_targeted_packages
* add Public param to ci.yml test
* retry setting env var
* pass through template
* missing paren
* don't look for Public in ci.yml
* try again
* remove unrecognized arg
* print vars
* try checking build.reason
* few fixes + prints
* try testing skip
* try more prints
* try more prints
* try more prints
* try nonempty packages list
* ignore discover_targeted_packages for now
* try again
* try again
* try no parameter
* missed import
* accidentally deleted other var
* try again
* fix
* test set PULLREQUEST
* missed var
* set var correctly
* don't fail docs step
* remove condition
* comment
* fake pull request run
* with discover targeted packages filter run
* remove print debugs
* try only publish artifacts if they exist for docs
* remove filter for now
* try again
* set in right tempalte
* switch to a service we actually want to disable
* formatting
* feedback
* block on release if ci_enabled=false
* test disabling ci for template, should block on release
* remove test setting from azure-template
* remove unused import and add small doc
* Update organization of the eng/common/testproxy folder
* Add merge-proxy-tags.ps1 and readme to eng/common/testproxy/scripts/tag-merge/
* Extract common assets script functionality to common-asset-functions.ps1
---------
Co-authored-by: Scott Beddall (from Dev Box) <scbedd@microsoft.com>
Http Status code 401 just be unauthorized and not necessarily that the link isn't valid. Removing this from the list of codes to error from.
Co-authored-by: Wes Haggard <weshaggard@users.noreply.github.com>
* Create new pipeline to create package work item
* Update powershell script to pass tag
* Fixes as per review comments
* Update as per review comments
* Login as az devops
* Create new entry point script to create package work item
* Load common ps module
* Add devops login step
* Pipe login token to devops login
* Pipe login token to devops login
* Add looging
* more logging
* Remove duplicate login from new script and add more logging
* More logging to debug create work item
* Remove script added for debugging
* Skip az interactive login when PAT is passed
* Remove debug logging
---------
Co-authored-by: praveenkuttappan <praveenkuttappan@gmail.com>
* Force capitalize all deployment/env outputs in live test
* Update eng/common/TestResources/New-TestResources.ps1
Co-authored-by: Heath Stewart <heaths@outlook.com>
---------
Co-authored-by: Ben Broderick Phillips <bebroder@microsoft.com>
Co-authored-by: Heath Stewart <heaths@outlook.com>
* pull out weekly analyze job into its own template
* fix yaml errors?
* job name
* add service directory
* remove extra stages
* revert
* fix
* refactor archetype-sdk-tests.yml to use python-analyze-weekly.yml template
* add note in service tests.yml
* Update sdk/anomalydetector/tests.yml
Co-authored-by: Ben Broderick Phillips <ben@benbp.net>
---------
Co-authored-by: Ben Broderick Phillips <ben@benbp.net>
* Add int environment to test scope
* Fix int test pipeline configuration file name
* Add coverace config to sms package
* Remove sms/_shared files from global coverage report
* Update livetest pipeline to use sms specific configuration for int environment
* Implement extra sms client tests
* Implement extra sms client async tests
* Replace connection string environment variable name to be more consistent with other SDKs
* updates to eng/ci_tools and eng/test_tools.txt to allow necessary additions for compatibility
* added new namespace to azure-sdk-tools: ci_tools.scenario.
* ci_tools.scenario is used to emplace any code that actually does the action of installing a dependency, replacing requirements, building on the fly, etc. This means that create_package_and_install and replace_dev_reqs both are moved into this module
* created tox environment 'optional'. This tox environment utilizes array items of pyproject.toml config item 'tool.azure-sdk-build.optional' to install requirements for specific test scenarios before invoking tests against them. These tests are run within a custom venv for each optional configuration item in pyproject.toml, location .tox/optional/<envname>/
* the new 'optional' environment is enhanced to allow users to pass in the target environment EG: 'tox -e optional --root . -c ../../../eng/tox/tox.ini -- --optional no_requests'
Co-authored-by: Laurent Mazuel <laurent.mazuel@gmail.com>
Co-authored-by: McCoy Patiño <39780829+mccoyp@users.noreply.github.com>
James Suplizio
iscai-msft
Daniel Jurek
Azure SDK Bot
Wes Haggard
Scott Beddall
Yuchao Yan
Jacob Lauzon
Patrick Hallisey
Paul Van Eck
Krista Pratico
Praven Kuttappan
Xiang Yan
Ben Broderick Phillips
mccoyp
Travis Prescott
ChenxiJiang333
swathipil
Scott Beddall (from Dev Box)
Libba Lawrence
Kushagra Thapar
catalinaperalta
Ray Chen
McCoy Patiño
Darren Cohen
gfeitosa-msft