зеркало из
1
0
Форкнуть 0
Граф коммитов

2002 Коммитов

Автор SHA1 Сообщение Дата
praveenkuttappan e59d4b2f4c
Simplify external package requirements for CI and tox env (#9257)
* Simplify external package requirements for CI and tox env
2020-01-02 10:29:48 -08:00
praveenkuttappan e2eb02c514 Enable Cosmos emulator test (#9197) 2019-12-17 13:36:33 -08:00
Krista Pratico 647f54445c
[textanalytics] Moves textanalytics track2 and renames namespace/package (#9149)
* moves text analytics track 2 to sdk/textanalytics and renames to azure-ai-textanalytics

* more renames

* fix env var name for async testcase

* bump azure-core version in setup.py

* update shared reqs

* readme.rst -> readme.md for nspkg

* pylint fixes for nspkg

* change nspkg version

* update nspkg manifest.in

* temp add azure-ai-nspkg to dev_requirements.txt until pkg released

* update code from swagger fixes

* review updates
2019-12-16 15:34:57 -08:00
praveenkuttappan bc8275fe4d
Downgrade coverage package to fix pipelines due to coverage issue (#9171)
* Downgrade coverage package to fix pipelines due to coverage issue
2019-12-16 14:45:18 -08:00
Yijun Xie 78d2ddfb3c
Enable Mypy for eventhubs (#9154) 2019-12-13 17:19:03 -08:00
praveenkuttappan ba164e0aca
Disable Cosmos emulator test for PR validation (#9124)
* Disable Cosmos emulator test for PR validation
2019-12-12 14:18:49 -08:00
Krista Pratico c6fb69fd74
Revert "[cognitiveservices] Text Analytics track 2" (#9118)
* Revert "[cognitiveservices] Text Analytics track 2 (#8568)"

This reverts commit ea199172e4.

* Packaging update of azure-cognitiveservices-language-textanalytics
2019-12-12 14:07:37 -08:00
Mike Harder 341a2035c2
Publish test results even if build is canceled (#9123)
- If build is canceled due to agent timeout, some tests results may have already been generated and should still be published
2019-12-12 12:55:12 -08:00
praveenkuttappan 34d5170ec5
update PR to install azure-devtools[ci-tools] (#9101)
* update PR to install azure-devtools[ci-tools]
2019-12-12 12:04:55 -08:00
praveenkuttappan 39244d4a9c
New script to filter relative dev requirements (#9024) 2019-12-12 10:58:15 -08:00
praveenkuttappan ebd73c3fc2
Update_pr is not installing azure-devtools (#9095) 2019-12-11 13:31:24 -08:00
Scott Beddall 58f395913c
azure-devtools should never install the upstream pypi version. removing implicit dependency to ensure that (#9065)
adding sdk tools and dev tools as default
2019-12-10 13:26:48 -08:00
praveenkuttappan aef65f5849
Updated to version string to use double quote to match black formatting style (#9063) 2019-12-09 17:58:39 -08:00
Mitch Denny 60e04c17a0
Unified Pipelines clean-up. (#8364)
* Unified Pipelines clean-up.

* Add eng folder to core build triggers.
2019-12-10 11:21:48 +11:00
praveenkuttappan 7df57f3dd5
Reduce PR test matrix to python 2.7, 3.5 and 3.8 (#9031)
* Reduce PR test matrix to python 2.7, 3.5 and 3.8
2019-12-06 14:02:31 -08:00
Krista Pratico ea199172e4
[cognitiveservices] Text Analytics track 2 (#8568)
* adding generated code for TA v3-p1

* started work on convenience layer for detect entities

* working on batched operations

* fixes the document language model, swagger needs update

* working on single operations

* updated generated code, working on error handling

* more error handling work

* error handling for entities

* fixes results and errors combined response

* adds autosegmentation of batches and renames operations

* fix policy

* adds async client, refactoring, and ran black

* whole batch error handling

* fix async client

* fix error handler, fix testcase

* update generated code - commit c0df36f

* adds azure core to setup and updates to Error model

* add docstrings and fix python 2 errors

* fix bug in validate input

* add request id policy, update docstrings, and version

* fix python 2

* adds some tests and single operation samples

* add conftest

* fix python 2

* enable pylint in CI for textanalytics

* fix pylint mistake

* add another test

* fix single method raised errors and unskip tests

* more samples and a few fixes

* refactor error method

* re-generated code at commit 013ee15 and fixes as a result

* feedback - single operations return same type as batch

* simplify policy

* fix test for python 2

* add async single methods, samples, tests

* add samples to manifest.in

* DocumentLanguage returns a single DetectedLanguage per document

* support batch language/country hint

* models inherit from dictmixin + a few tests

* ignore samples readme and fix type hints

* aad support

* review feedback and wip readme

* fix readme

* fix readme again

* mypy clean and enabled mypy failures in CI

* default country and language hint + tests

* revert documentlanguage returning a single detectedlanguage per document

* add literalincludes to samples

* update history and convert .rst to .md

* renamed detect_language to detect_languages

* renames LanguageInput -> DetectLanguageInput and MultiLanguageInput -> TextDocumentInput

* review feedback

* update shared reqs for msrest
2019-12-06 11:19:04 -08:00
praveenkuttappan 368e29c9ff
Cleanup yaml in .azure-pipelines folder (#9018) 2019-12-05 15:12:26 -08:00
praveenkuttappan fdd1621922
New tox to verify package with dev build (#8919)
* New tox to verify package with dev build
2019-12-05 10:56:30 -08:00
praveenkuttappan 84df60d1d6
Integrate dev build into pipeline and fixes in versioning to run on Python 2.7 and 3.5 (#8778)
* Build daily dev build and publish it to devops feed
2019-11-25 16:30:24 -08:00
Scott Beddall 61d2ab9a60
aligning artifact name with javascript doc artifact name (#8825) 2019-11-22 16:33:44 -08:00
praveenkuttappan 52aaafd402
Verify whl and sdist (#8682)
*verify whl and sdist
2019-11-20 16:52:34 -08:00
praveenkuttappan 382bde3500
Live test is failing due to missing python 3.8 yml (#8739)
* Update live test yml to use python 3.8 image
2019-11-20 14:19:42 -08:00
Daniel Jurek 8524a8f3d2
Version manipulation tools (#8639)
* version manipulation scripts
* update batch
* update core-tracing-opencensus
* update eventhubs
* update identity
* update keyvault
* update servicebus
* update azure-storage-file-datalake
* update template
* update version strategy to follow https://github.com/Azure/azure-sdk/pull/782/files
* add versioning requirements
* update azure-common
* exclude nspkg and metapackages

* fix a few linting/code change errors
batch: fix version import
add newline to fix lint error
fix linting errors for opencensus
fix lint errors for eventhub
fix lint errors for keyvault
fix keyvault error: spell version correctly

* pad dev build version from this discussion: https://github.com/Azure/azure-sdk/pull/782/files#r346089367
including length validation
fix remaining lint/other errors
[skip ci]
* correct lint errors [skip ci]

* fix a few linting/code change errors
batch: fix version import
add newline to fix lint error
fix linting errors for opencensus
fix lint errors for eventhub
fix lint errors for keyvault
fix keyvault error: spell version correctly

* pad dev build version from this discussion: https://github.com/Azure/azure-sdk/pull/782/files#r346089367
including length validation
fix remaining lint/other errors

* add some features to find_invalid_versions.py and add a step to archetype-sdk-nightly.yml to start validating package versioning

Revert "update azure-common"

This reverts commit e6f8fd9690954f6278f745c1eff13b04be5cd9e1.

Discussion: https://github.com/Azure/azure-sdk-for-python/pull/8639#discussion_r347023057

* add ability to filter by service directory, improve outputs, move into analyze template
* remove extra imports that got pulled in from a rebase in eventhubs
* add validation and use zero-fill of 3
* add back in import from ._common... too much was removed
* add comment about using --always-succeed when checking for valid package versioning
* remove extra whitespace
2019-11-20 09:33:27 -08:00
praveenkuttappan a12f002a75
Enable python 3.8 test using devops image for 3.8 (#8713)
* Add python 3.8 to test matrix
2019-11-19 12:11:57 -08:00
Scott Beddall 19ecc77aa5
ignoring the azure folder directly (#8673) 2019-11-15 13:58:55 -08:00
praveenkuttappan a0d82dc741
Python 3.8 test pipeline is not cancelled when build is cancelled (#8544)
* Skip python 3.8 testing when CI is cancelled
2019-11-14 10:50:11 -08:00
praveenkuttappan a170256602
Get Package namespace by parsing setup.py (#8461) 2019-11-11 13:45:39 -08:00
Daniel Jurek e8993089a8 move remaining smoketest files out of samples folder (this branch was open a long time ago and the new files were missed in a rebase)
add remaining KV smoke tests back in

add to requirements

allow for other versions of python 3.7

update to use older interfaces

fix up smoke tests for september 2019 preview

name the matrix entry properly

do not wait for cert creation in b3
2019-11-08 15:10:35 -08:00
Xiaoxi Fu 638969c03e
ADLS Gen2 API Implementation (#8473)
* ADLS Gen2 API Implementation (#8473)
2019-11-07 16:29:22 -08:00
praveenkuttappan eb2f599e19
New CI to check autorest when changes are made in azure-core (#8509) 2019-11-07 15:57:46 -08:00
Daniel Jurek 34a61373ee move smoke tests
update smoke-test.yml

move smoketests to common folder
2019-11-07 10:31:45 -08:00
Scott Beddall 1ad000af6a
bump warden version (#8460) 2019-11-06 11:36:46 -08:00
praveenkuttappan 335c31b445 Disable depends test (#8440) 2019-11-05 17:41:43 -08:00
praveenkuttappan 9fb0849353
Enable depends check during CI (#8324)
* Enable depends check during CI
2019-11-05 15:44:50 -08:00
praveenkuttappan c648cc4d18
Install psutil package (#8375)
* Install psutil package
2019-11-04 15:10:09 -08:00
Scott Beddall ab0eda56c4
Classifying a Bunch of Management Packages (#8311)
* updating 20 or so management packages with proper service classification. also handling missing namespaces when generating documentation.
* fixed the package omission list when building docs
* now outputting all packages with categorization
2019-11-01 21:20:05 -07:00
Scott Beddall 2d28175a70
Enable azure-keyvault metapackage during build (#8353)
* enable azure-keyvault metapackage. ignore pylint errors. mypy has not opted in. Allow pytest code 5 for azure-keyvault
2019-11-01 16:23:58 -07:00
praveenkuttappan 93796440c2
Run mypy and pylint as separate jobs (#8330)
* Run mypy and pylint as separate jobs
2019-11-01 14:09:40 -07:00
Laurent Mazuel bc6575e6bb
azure-keyvault meta-package (#8024)
* azure-keyvault meta-package

* Mismatch quote

* Fix MD

* COC link

* Missing word

* Feedback from @chlowell

* Update incorrect setup.py

* Add missing MANIFEST.in

* Dep analysis fix

* Update README.md

* Skip CI for azure-keyvault

* Move to stable and remove certificates

* Stable classifier

* Fix req file

* 4.0.0
2019-11-01 12:03:12 -07:00
Scott Beddall 8109abcf96
Small Documentation Bugs (#8247)
* allowing namespace != package name exceptions when generating tox
* adding additional reroutes for two other extension packages
2019-10-28 22:41:09 -07:00
Laurent Mazuel b42ad2781d Sphinx API docs should generate module doc first (#8242) 2019-10-28 18:11:12 -07:00
praveenkuttappan a9611040d0
Verify change log as part of analyze CI (#8213)
* Verify change log as part of analyze CI
2019-10-28 14:15:06 -07:00
annatisch a020509809
[Storage] File SDK rename (#8164)
* Renamed package dir

* Renamed namespace dir

* Some packaging updates

* Renamed ShareServiceClient

* Renamed _share_service_client

* Renamed ShareDirectoryClient

* Renamed ShareFileClient

* Updated namespace references

* Some fixes

* Other repo components

* Synced shared models

* More repo components

* Pylint fix

* Updated user agent

* Unique share names

* Revert "Unique share names"

This reverts commit 5702cb1eb9.

* Classmethod return types

* Updated release notes

* Merge fix

* Updated namespace references

* Updated readme

* Manual sample merge

* Updated samples

* Merge fix
2019-10-25 15:13:04 -07:00
Scott Beddall 4856ccfcfd
Package Index Generation (#7854)
* adding generate_versioned_index that can be used to generate an index page
* confirmed that original doc build is still working
* updated templating to allow for injection of drop downs on individually rendered doc artifacts
* allow presence of `<packagename>/doc` folder that will take precedence over running `sphinx-apidoc`
* Build ymls supporting generating a subset of docs and the index page
* updates to archtype-sdk-client to pass in a named docArtifact
2019-10-24 20:07:52 -07:00
praveenkuttappan 8f58606ebf
Live test job name issue for python 3.8 (#8178)
* Live test for Python 3.8 is not triggered until all other tests are completed for other python versions.
2019-10-24 12:03:16 -07:00
praveenkuttappan 9cd06b820b
Python 3.8 testing (#8082) 2019-10-23 18:31:33 -07:00
Laurent Mazuel db402b1525 Feature/storage preview5 (#8049)
* Fix SubStream to respect IOBase protocol (#7843)

* removes NoRetry policy (#7845)

* [storage] Makes signed_identifiers a required param (#7844)

* makes signed_identifiers a required param

* fix tests and update history

* removes unecessary check

* fix files and queues tests

* [storage] Changes `file_permission_key` param to `permission_key` (#7841)

* changes file_permission_key param to permission_key

* update history

* Change the param directive to keyword in docstrings (#7855)

* Change the directive to keyword in docstrings

* pylint :(

* [storage] Adds from_string to models (#7870)

* adds from_string to models

* fixes to naming and history

* remove _str in docstrings

* pylint

* [storage-file] await async poller (#7872)

* await files async poller

* fix docstrings

* fix type hints

* [File and Queue] Client constructors (#7853)

* from_queue_url

* file client constructors

* update CHANGELOG

* fix test

* lint fix

* some doc changes

* queue docs

* blob docs

* [storage-queue] rename queue messages (#7895)

* rename queue messages

* update history

* [Storage-Queue][Storage-File] Kwargify positional params (#7877)

* Queue kwargification

* kwargify Files

* small fix

* minor fix

* comments + lint

* some changes

* pylint

* [storage-file, queue] moves param protocol to kwargs in gen_shared_access_signature() (#7897)

* moves protocol in gen_sas to kwargs

* delete whitespace

* [storage] Unexposes models from aio (#7881)

* unexposes models from aio

* unexpose all except clients and pylint fixes

* update history

* unexpose sync paged models

* update history phrasing

* [Storage-queue] Allow None message encode policy (#7898)

* Don't expose NoEncode policies

* Support None value for encode/decode policies

* Updated tests

* Updated sync encryption tests

* Updated async encryption tests

* Updated async encoding tests

* Fixed test

* Fix test

* Updated release notes

* Rename enqueue_message to send_messgae (#7928)

* [storage-blob, queue] Renames Logging to <ServiceName>AnalyticsLogging (#7921)

* renames logging to ServiceAnalyticsLogging

* changes param logging to analytics_logging

* fixes tests due to param name change

* [Blob][File][Encryption]Fix Download Encrypted Blob/File Bug (#7965)

https://github.com/Azure/azure-sdk-for-python/issues/7957

* Consolidate offset - length behavior in files (#7942)

* Initital Commit

* length changes

* some test changes

* some more changes

* history.md

* Update a couple of recrodings

* comments address

* ops

* Stop modifying internal_response body (#7958)

* Stop modifying internal body

* Replicate for queues and files too

* [Storage] Relocated SAS generation (#7955)

* Expose account name on clients

* Updated blob sas gen

* Updated file sas gen

* Update queue sas gen

* Updated docstrings

* Some pylint fixes

* More pylint

* More pylint

* Reverted auth change

* Added release notes

* Fixed kwarg docstring

* [Storage] Updated close handles (#7940)

* Updated close handles

* Pylint fixes

* Fix tests

* Review feedback

* Missing recursive parameter

* Added release notes

* [Storage] Conditional etag parameters (#8047)

* Updated clients

* Process conditional headers

* Updated tests

* Fixed test

* Updated error scenarios

* Updated release notes

* Revert skipped tests

* [Storage] Download stream refactor (#7848)

* Refactored download stream API

* Unskip tests

* Test warnings

* Missing await

* Fixed append tests

* Fixed page tests

* Pylint

* Py2.7 iter support

* Refactor downloaders

* Added missing async module functions

* Updated release notes

* Keyword params

* Documented more keyword options

* Added module functions to exports

* Fixed merge

* Fix for Files download stream

* Pylint fix

* Updated File stream downloads

* Fix tests

* Updated error message

* Added Files release notes

* Pylint fix

* Download stream error handling

* Fixed some tests

* Design Pipeline ownership (#7981)

* Initital Commit

* Pipeline Ownership

* slight modifications

* pipeline ownership for queues and files

* fixes tests, adds docstrings to wrapper classes

* pylint

* Batching APIs Raise on Any Failure (#7963)

* Raise on Single Failure

* some changes

* lint

* some changes

* oops

* comments + lint

* some optimization

* history

* comments

* lint

* recording

* Plug HttpLoggingPolicy to Storage (#8081)

* Plug HttpLoggingPolicy to Storage

* Update dependencies

* Skip depends job for Storage

* Fix shared req

* [storage] make storage files _internal (#7949)

* blobs internal

* files internal

* queues internal

* some fixes to docstrings

* update history.md

* fix async test import

* some file mypy fixes

* some queue mypy fixes

* some blob mypy fixes

* fix mistake in type annot

* history edits

* Merge fix

* Revert "Merge fix"

This reverts commit 748fbd68d9.

* Better merge fix

* fix some tests (#8100)

* Fix tests (#8103)

* minor fix special char

* fix auth

* comments

* [Storage] Bumped version + Pipeline fix (#8089)

* Bumped version

* Docs tweak

* Re-bumped version

* Added 3.8 classifier

* Added proxy policy to pipeline

* Synced base clients

* Added batch exception

* Comment the echo check to workaround batch headers issue (#8118)

* Fix 8091: expose generated enum to customers (#8117)

* Fix #8091

* Add one in file
2019-10-22 17:05:56 -07:00
Laurent Mazuel 85c2a05d1f
Add azure-core into mypy_hard_failure_packages.py (#7943)
* Update mypy_hard_failure_packages.py

* Fix MyPy

* Run mypy for specified package only

* Updated dev_requirements to trigger CI

* Run mypy for only python 3.7

* Trigger CI for azure-core

* Fix latest mypy errors
2019-10-21 16:00:02 -07:00
Charles Lowell 82785eb5aa Use HttpLoggingPolicy (#8056)
* use HttpLoggingPolicy in azure-identity

* use HttpLoggingPolicy in azure-keyvault-*

* ... tracing policy takes kwargs now (identity)

* ... tracing policy takes kwargs now (keyvault)

* allow keyvault header in logging

* fix typo

* update azure-core dependency

* exclude azure.identity from dependency test

* remove shared_requirements overrides
2019-10-21 14:18:06 -07:00
Scott Beddall 0e53a3792b
disabling the import_all check. no dev feeds means that this feature technically can't work correctly. will re-enable with another source for the packages (#8086) 2019-10-21 13:05:39 -07:00
Xiang Yan 7248645bcb
update docs (#8023)
* update docs

* update doc

* enable HttpLoggingPolicy
2019-10-19 18:18:05 -07:00
Scott Beddall f9261ecd81
properly handling condition for job run (#8050) 2019-10-18 18:34:15 -07:00
iscai-msft 83e5d2b1bb
Key Vault: tests using unique identifying env variable (#7307)
* implemented unique recording that always relys on RUN_IDENTIFIER

* recorded test files, passing

* implemented unique recording in secrets

* recorded secret test files, passing

* fixed file reading code

* added try catch for file reading

* switched from hash to seeding, working

* implemented with urlsafe b64 encoding

* moved seed file to tests folder

* switched to using integer encoding of unicode characters

* got rid of pytest fixture, re-recorded key tests to test live

* added live testing file

* moved logic into try except block

* here's a thought

* added logic to get unique identifying environment variable

* implemented Charles' comments

* added environment variables

* making live pipeline record

* added live testing environment variable

* addded os imports

* added subscription id env variable

* switched to getting tenant id through function

* converted to using md5 hashing

* re-recorded tests

* make pipeline platforms run serially

* got rid of os abspath joining

* added additional test args to pipeline yaml file

* increased waiting time for deleting certificates

* adding xdist loadscope

* increased waiting time after purging certificates

* started adding name prefix to resource group creation

* added hashing of run identifier into rg name for secrets

* added hashing of run identifier into rg name for keys

* added prefix to resource groups, one failing

* updating to comply with new pipeline changes

* re-recorded tests with new run identifier

* ran black on certificates

* replaced recordings with recordings from origin master

* re-recorded tests, one certificate test failing

* separate by package

* add unique job names

* skipping async test of async_request_cancellation_and_deletion
2019-10-17 10:57:53 -07:00
praveenkuttappan c11cd596e8
Verify package dependency by importing all modules (#7907)
* New tox environment to verify package dependency
2019-10-16 11:37:25 -07:00
praveenkuttappan b12c355b56
Option at package level to opt in to fail CI when mypy fails (#7927)
* Option at package level to opt in to fail CI when mypy fails
2019-10-16 10:36:59 -07:00
praveenkuttappan a8c9185604
No-cov is added in tox in addition to parameters to tox (#7856)
Code coverage test to exclude test and examples
2019-10-14 16:35:19 -07:00
praveenkuttappan 56a0b817dc Disable import all for now (#7878) 2019-10-14 15:14:27 -07:00
praveenkuttappan f4cceaa161
PackageDependencycheck (#7636)
* New tox to verify package dependency by importing all modules
2019-10-14 14:05:53 -07:00
Mitch Denny b4fcd27012
Reduce min check runs to 1. (#7824) 2019-10-11 22:54:26 +11:00
Scott Beddall 118120ce19
Adjustment to pylint exclusion list. (#7706)
* all mgmt packages are excluded from pylint by default.
2019-10-08 18:33:58 -07:00
Mitch Denny 94aaa99c41
Add skip conditions on test and analyze jobs. (#7658) 2019-10-08 05:39:31 +11:00
Mitch Denny 133ef07107
Publish the packages artifact. (#7643) 2019-10-07 10:46:37 +11:00
Scott Beddall c7fadc5efe
extending pypy timeout. (#7640) 2019-10-05 13:37:00 -07:00
Mitch Denny 6d7dd2f818
Setup cosmos for release via unified pipelines. (#7581) 2019-10-04 09:47:22 +10:00
Mitch Denny 5471d9e146
Feature/unified pipelines (#7554)
* Basic skeleton for unified pipeline in Python.
2019-10-03 13:16:19 +10:00
Scott Beddall 7ef04a6365
Adding Sphinx Output to CI (#7561)
* support for single package site gen using tox. tox -e sphinx

* updating manifest files to include tests in the source distribution. this means that the examples will also be renderable on docs.ms

* Added steps to CI to generate documentation for targeted servicedirectory
2019-10-02 18:25:30 -07:00
praveenkuttappan 680aaf7f79
Add pypy for live tests (#7541) 2019-10-01 16:19:04 -07:00
Laurent Mazuel 0e5a2748d4
Install pytest-asyncio (#7530)
* Install pytest-asyncio

* removing duplicate requirements for asyncio

* touch azure-core to force a re-run of the checks

* remove pytest from identity dev_requirements
2019-10-01 10:28:08 -07:00
Chidozie Ononiwu 259157f3a6
Update to Powershell6 (#7505) 2019-09-30 14:34:36 -07:00
Chidozie Ononiwu c9e6ded7e9
Update SDK Tools Consumption (#7148) 2019-09-27 13:19:12 -07:00
Daniel Jurek 3de5e34697 use xdist in live tests (optional) and in nightly tests (default) (#7380)
* use xdist in live tests (optional) and in nightly tests (default)

* make parallelism 8 instead of the number of procs

* remove xdist from nightly runs for now... it should be pretty easy to add these back in when the client build is succeeding and we know we aren't introducing additional problems
2019-09-23 11:20:02 -07:00
Mitch Denny 1721ea5073
Enable check enforcer. (#7331)
* Enable check enforcer.

* Moved location of CHECKENFORCER.

* Removed redundant flag.
2019-09-19 10:55:56 +10:00
Scott Beddall e461f032d1
Resolve faulty package filter when building for release (#7297)
* originally removed this method due to a 'brilliant simplification' only to realize that kinda missed an essential filter during a build for a release
2019-09-16 12:17:55 -07:00
Scott Beddall d73d926684
Address nspkg Failures (#7243)
* increase timeout for pypy, adjust error output in create_install_wheel.py
* updating build-artifacts to generate python2 nspkgs if any exist
2019-09-12 16:36:29 -07:00
Daniel Jurek 56c39bbf2c
Cosmos Pipeline Refactor (#7227)
* add emulator to ci.yml
* mark globaldb tests, try removing emulator from live tests
* use the accepted gating cosmos emulator url
* live tests
* remove redundant BuildTargetingString
* make coverage arg into a variable because of build-test.yml's construction
* remove extra comment, extra templates don't add value here given that this file is cosmos-specific already
* remove old cosmos pipelines
* remove extra comment
2019-09-12 15:17:03 -07:00
Daniel Jurek 977cbdad2d
add ability to specify job timeout (#7237)
* add ability to specify manual timeout

* use accepted spelling of "parameters"
2019-09-12 14:25:30 -07:00
Scott Beddall ab3f145f1c
Disable dev-setup "Develop" mode in CI checks (#7162)
* update sdist to not install in develop

* allowing CI to run dev_setup without develop mode

* updating appconfiguration manifest so that the sdist can properly install

* update applicationinsights manifest so that the sdist can properly install

* bugfix in dev_setup.py, bad syntax. adding 'develop' environment to the tox.ini

* datalake analytics packages have bad manifests

* repair manifest for sdist azure-eventhub

* adding manifest for identity

* updating manifest for scheduler

* repair manifest for servermanager
2019-09-10 20:02:48 -07:00
Scott Beddall 7354bbdfef
Skip Building on incompatible Python Versions (#7160)
* removing --universal argument in build_packages.py
* extending common_tasks.py. now we filter package set ALSO by CI compatibility
* adding additional dependencies during build to allow targeting to successfully work
2019-09-10 19:09:23 -07:00
Chidozie Ononiwu 40ff15c82e
Update Windows VMImage Version (#7057) 2019-09-06 10:40:41 -07:00
Scott Beddall e9c35b4fc6
resolve mypy errors (#7082) 2019-09-05 15:25:12 -07:00
Scott Beddall e83b0cd698
Adjustment to Pylint Skip Check (#7052)
* adjusting skip logic to account for wrong assumptions about what gets passed from CI
* adding storagecache to the pylint skip list
2019-09-03 17:40:54 -07:00
Scott Beddall 1773e223a5 Pylint Now Fails Builds (#7004)
* enabling pylint to fail builds

* removing extraneous and() in parameter
2019-09-03 10:45:29 -07:00
Scott Beddall 12383afd5a
Updating Coverage Across nightly, pr, live Builds(other than py2.7 and py3.7) (#6993)
* updating coverage on nightly run to only run against py2.7 and py3.7
* re-enabling code-coverage on PR builds
* updating `live` skeleton to properly pass no-cov arguments
* updated both `test-nightly.yml` and `build-test.yml` to reference a common `publish-coverage.yml` and allow coverage enable/disable to be be passed as part of the matrix
2019-08-30 21:03:34 -07:00
Scott Beddall e25235b439
resolving steps issue that causes analyze to not run (#7024) 2019-08-30 15:28:19 -07:00
Krista Pratico 34b3780889
adds to blacklist, changes to lint (#6959) 2019-08-27 16:24:12 -07:00
Scott Beddall 21e442f601
Tox Workflow (#6624)
* Swapping CI to Leverage Tox Workflow
2019-08-27 13:39:32 -07:00
Jonathan Cárdenas 597f507396
Smoke Test Pipeline (#6769)
* Create smoke-test.yml

* Update smoke-test.yml

* Update smoke-test.yml

* Update smoke-test.yml

* Update smoke-test.yml

* Update smoke-test.yml

* Update smoke-test.yml

* Update smoke-test.yml

* 'requirements' misspelled
2019-08-13 11:09:20 -07:00
Scott Beddall 4f3eb73fc3
Set up environment once, run tests one at a time (#6710)
* Updating `setup_execute_tests.py` to run pytest one at a time, then combine coverage once all tests have executed. This means that individual test projects can't mess with each other's configurations. However, we're still testing for a stomped namespace due to the fact that all are installed alongside each other.
2019-08-11 19:36:14 -07:00
annatisch 7202249694
[storage] Preview 2 (#6442)
* [storage] Add async APIs for Files SDK (#6405)

* Refactored blob shared utils

* Refactored file shared utils

* Refactored queue shared utils

* Refactored downloads

* Refactored file downloads

* Started async downloads

* Async Files API

* Flatten copy polling

* Renamed uploads

* Fixes samples based on vendor feedback (#6357)

* fixed import statements for sync samples

* fixed secrets readme samples

* fixed keys readme samples

* deduped secret names across samples

* Upload refactor

* Release approval docs (#6361)

* updating dev documentation with approval details

* Updated async pipeline

* Avoid surprising aiohttp with unexpected kwargs (#6355)

* Add challenge authentication to azure-keyvault-keys (#6244)

* Add decorator (#6299)

* add opencensus impl

* dont need to check for noop tracer

* get rid of span and trace id

* fix span instance

* added documentation

* added documentation and refactor names of a few variables

* write test for opencensus wrapper

* put opencensus in the dev requirements

* initial common

* only import the wrapper when necessary

* add check for the exporter

* rework logic and fix some settings

* added initial decorator

* some mroe documentation

* added decorators

* small change

* some minor fixes

* test patch happening

* fix space

* share a function

* clearer logic for setting span context

* better logic

* better logic

* fix environ variable

* test the way opencensus does it

* middle of tests

* only load if opencensus has already been imported

* fix spelling mistake

* temp

* finish writing tests for common

* charles fixes

* fix tests

* fix test settings

* to header should not take a dict

* from header should be class method

* initial tests

* dont create trace and get rid of end_tracer

* dont need to save the trace

* more little fixes

* some intermediatary changes

* fix type annotations

* rst fix types

* add :class:annotations

* fix line wrapping

* added tests for decorator

* rename opencensus wrapper

* intermediate changes

* use spans the right way

* some formatting

* some grammar

* restructure settings and make tests pass

* rename get_parent

* fix typings

* use protocol and from_headers becomes links

* ramifications of opencensus wrapper being a protocol

* add tests for link

* added async tests

* delete the unit test thing

* added add_attribute

* added add_attribute

* added tests for add attributes

* remove unused import

* added docstrings

* minor docstring formatting

* fix pylint errors

* don't rely on opencensus children to check

* use exporter to not rely on parent.children

* test should only propagate

* made test tracing helper

* decrease flakiness of test

* simplify get parent

* calling a decorator decorator is redundant

* fix settings

* more elegant code

* add await for async

* should only have to wait a 1/1000 of a second

* fix tests spans too short

* accidentally deleted setup.cfg

* Added async file tests

* Consolidate Key Vault shared code (#6384)

* Download tests

* Service property tests

* No recordings

* Add credential wrapping MSAL ConfidentialClientApplication (#6358)

* Add policy (#6379)

* add opencensus impl

* dont need to check for noop tracer

* get rid of span and trace id

* fix span instance

* added documentation

* added documentation and refactor names of a few variables

* write test for opencensus wrapper

* put opencensus in the dev requirements

* initial common

* only import the wrapper when necessary

* add check for the exporter

* rework logic and fix some settings

* added initial decorator

* some mroe documentation

* added decorators

* small change

* some minor fixes

* test patch happening

* fix space

* share a function

* clearer logic for setting span context

* better logic

* better logic

* fix environ variable

* test the way opencensus does it

* middle of tests

* only load if opencensus has already been imported

* fix spelling mistake

* temp

* finish writing tests for common

* charles fixes

* fix tests

* fix test settings

* to header should not take a dict

* from header should be class method

* initial tests

* dont create trace and get rid of end_tracer

* dont need to save the trace

* more little fixes

* some intermediatary changes

* fix type annotations

* rst fix types

* add :class:annotations

* fix line wrapping

* added tests for decorator

* rename opencensus wrapper

* intermediate changes

* use spans the right way

* some formatting

* some grammar

* restructure settings and make tests pass

* rename get_parent

* fix typings

* use protocol and from_headers becomes links

* ramifications of opencensus wrapper being a protocol

* add tests for link

* added async tests

* delete the unit test thing

* added add_attribute

* added add_attribute

* added tests for add attributes

* add initial policy

* remove unused import

* added docstrings

* minor docstring formatting

* fix pylint errors

* don't rely on opencensus children to check

* use exporter to not rely on parent.children

* added documentation and span attributes

* added test tracing policy

* test should only propagate

* made test tracing helper

* decrease flakiness of test

* simplify get parent

* calling a decorator decorator is redundant

* middle of writing tests

* fix settings

* add tests

* test propogation also happens

* more elegant code

* await async stuff

* add await for async

* should only have to wait a 1/1000 of a second

* fix tests spans too short

* accidentally deleted setup.cfg

* add component

* add set_http_attributes

* fix span network name

* fix http request types

* fix more types

* bryan fixes

* more efficient tests

* non flakey tests

* make tracing only use my context

* test user agent on exception

* pylint formatting

* delete unused import

* fix spelling

* pylint

* adding dockerfile (#6393)

* Update cheatsheet.md

* Async share tests

* Async directory tests

* Fixed some tests

* aiohttp socket timeout

* Patch azure core

* CI fixes

* Fix async tests for py35

* Python 3.5 support

* Clean pylint

* Async implementation for storage queues. (#6360)

* Async Queues + tests port

* More tests plus changes

* pytest conf

* Port shared folder

* remove warnings from tests

* Latest shared code

* change destination

* some more changes

* ..and some more

* fix tests

* pylint  + mypy

* some more lint

* A couple of test fixes

* Fixed fake settings mode

* Refactored queue utils

* change conf ignore

* minor change

* Fix for urlencoding SAS tokens

* Merge latest azure-core changes

* Updated shared blob client

* add decorator and policy to storage_files and propagate context for it (#6454)

* add decorator and policty to files

also propagated context!

* added decorator to pollers

* finished should also be traced

* polling method does not need to be decorated

* add tracing policies

* propagate context

* no decorator for generate_shared_access_signature

* added decorators to async libs

* Trace storage queue (#6449)

* decorators and policy added

* properly clear context

* dont decorate private stuff

* added policy

* decorated async

* get rid of those that dont make netowrk calls

* propagate context

* Trace storage blob (#6478)

* properly clear context (#6448)

* added decorators to keyvault-keys (#6381)

* Remove default development settings (#6376)

* Trace decorator optional arguments (#6459)

* add optional parameters to decorators

* added type hints

* Use tracing policy (#6390)

* Remove config public API for KV keys (#6418)

* Remove config public API for KV keys

* Make create_config private

* Sync _shared keys/secrets

* Type annotation fix

* Adapt secrets tests for no config

* Update README.md

* decorate polling

* decorate lease

* decorate container client

* trace blob service client

* polling method does not need to be decorated

* decorate blob client

* add policy

* added policy to the blob

* Update root README.md

Updating the Contributing section according to the guidelines

* get rid of util and propagate context properly.

* get rid of functions that do not do a network call

* propagate context

* Revert "propagate context"

This reverts commit 1bd07edc5b.

* New paging to storage preview2 branch (with async) (#6493)

* Update root README.md

Updating the Contributing section according to the guidelines

* Update CODEOWNERS

* more code owners

* add policy and decorators for secrets (#6453)

* Smoke test for Python (#6412)

* Smoke Test Sample for Track 2 libraries

Smoke Test for Indentity, Key Vault Secrets, Storage Blobs, Event Hubs and Cosmos DB

* simpleQuery method added

* Method's names updated

* Create README.md

* Update README.md

* Commented lines deleted

* README.md moved to correct folder

* Create requirements.txt

* Update README.md

* Update README.md

* Imports changed

* Use of literals instead of append

* Database Name variable to class level.

* Use of Pythonic with statements

* Update requirements.txt

* Revert "Update requirements.txt"

This reverts commit 4b79c6a847.

* Revert "Use of Pythonic with statements"

This reverts commit 81adc4ca46.

* Revert "Revert "Use of Pythonic with statements""

This reverts commit 27b2a2d635.

* requiriments.txt encoded as a txt file

* requirements.txt as text file

* Misspelling in "Key concepts"

* Update .docsettings.yml to match the tittle of Smoke Test

* Went trought Suyog comments

* Revert "Went trought Suyog comments"

This reverts commit 35c62232f8.

* Gone trought Suyog comments

* use of snake case in file names

* Paging v2 (#6420)

* First version of paging

* Clean sync paging

* Async paging

* Name AsyncList without underscore

* MyPy happyness

* pylint

* black

* PageIterator as conf

* Simplify ItemPaged

* Use chain to link iterable

* Make Paging more open

* Docstring

* pylint / mypy / black

* Regenerate KV with latest Autorest + Paging branch (#6479)

* Regenerate KV with latest Autorest + Paging branch

* Remove unused import in tests

* Make the async adapter more generic

* Regeneration after operation mixin fix in Autorest

* COmmit changes forgotten in #6418

* Fixing syntax for 2.7

* Move Storage Queue to new Paging (#6447)

* Move Storage Queue to new Paging

* Working Storage queue on new paging

* Fix types

* First shot of blob tests update

* Fixing blob tests

* File to new paging

* Doc fix

* Feedbacks from @annatisch

* Fix last @annatisch comment

* Simplify paging contract

* Fix storage queue after new paging contract

* Fixed incorrect auto-merge

* Fix docstring

* Port aio to new async paging

* Adapt async tests

* Missing by_page

* Fix async tests

* Fix continuation token bug

* Support for aiohttp records from vcrpy (#6552)

* Async recording for Storage (#6560)

* Aiohttp is the only default for async clients (#6561)

* seed tests.yml (#6645)

* [storage] Blob async APIs (#6489)

* Updated blobs shared code

* Started blob refactor

* Refactoring upload

* Updated shared code

* Started fixing tests

* Refactored sync blobs

* Added blob async APIs

* Some fixes

* Append blob async tests

* blob access async tests

* Blob client async tests

* encryption async tests

* Patch for azure core exception

* blob retry async

* Retry async tests

* Get blob async tests

* Bug fix for clear page operation

* More async tests + upload fix

* Merged blobs

* Updated Files shared code

* Updated queue shared code

* async tests pass except 2 common blob tests

* adds async paging to blobs and some async tests (not all pass)

* initial commit

* block_blob_tests

* page blob tests

* fix for special chars, some tests, and recordings

* add to shared storage and fix import

* adding more tests/recordings

* more tests/recordings

* rerecord tests, fix imports

* fix import again

* blacklist azure-servicemanagement-legacy

* get CI to run

* rerecord all async tests

* testing

* add variable indirection for storage live tests. this is a temporary measure to create live test pipelines for this particular framework

* newline

* print envar

* remove testing

* adjust pypy testing

* Storage Recordings For Queues and Files (#6629)

* initial commit

* recordings

* fix all tests

* update queue recordings

* file recordings

* queue recordings

* fix for encoding tests

* small fix

* change conftest

* remove recordings

* oops

* new recordings

* some fixes

* more fixes

* and more fixes

* and one more fix

* allowing specific project targeting for storage livetests

* allowing BuildTargetingString to flow through for templates following 'archtype-sdk-tests'

* passing service directory to setup task

* Support for Live storage tests (#6663)

* play

* playing

* some prints

* some tweaks

* try-345

* fix

* tweak for queue and file

* remove prints

* [storage] Preview2 updates (#6658)

* Updated change logs

* Bumped versions

* Some test fixes

* Fix for file handle next marker

* Fixed error in release notes

* Updated core version

* Updated azure-core shared dep

* Updated release notes

* fix test (#6674)

* Fix for queue models (#6681)

* [storage] Readme tweaks (#6697)

* Fix for queue models

* Docs cleanups

* Some final tweaks (#6687)

* Some final tweaks

* oops

* comments

* little better

* Pylint

* [storage] Better async import error message (#6700)

* Fix for queue models

* Docs cleanups

* Better async import error
2019-08-07 09:46:49 +12:00
Mitch Denny 33d6e4a8cb
Minimal change to disable code coverage publishing for PRs. (#6614) 2019-08-01 14:15:11 -07:00
Scott Beddall 873ccb7401
Moving Package Installation to a step _before_ the test runs (#6468)
* splitting install and run steps into separate executions. extending setup_execute_tests.py so that you can optionally run just setup, just execute, or (default) both.
2019-07-24 12:35:06 -07:00
bsiegel 2c5804a030
Apply tag to scheduled builds (#6214) 2019-07-03 12:23:50 -07:00
Mitch Denny 0a47a35756
Add missing ci.yml files. (#5906)
* Add missing ci.yml files.
2019-06-21 10:41:13 -07:00
Daniel Jurek 92e0e13297
use parameter for BuildTargetingString (#5932)
* use parameter for BuildTargetingString
* add BuildTargetingString to build-test.yml
* ensure BuildTargetingString is in all steps
2019-06-18 13:20:55 -08:00
Daniel Jurek 76835cddac
Refactor tests and yml files (#5860)
* remove old client.yml and tests.yml files from .azure-pipelines
* refactor archetype-sdk-client.yml and add a cleaner client.yml file to /eng/pipelines
* DRY up pipeline YAML
* create tests.yml for eventhub and servicebus
* rename CoverageParam -> AdditionalTestArgs
2019-06-17 15:39:00 -08:00
Mitch Denny 6cb02ca248
Disabled cosmos emulator tests for PR/CI validation. (#5846)
* Disabled cosmos emulator tests for PR/CI validation.

* passes test mark argument through
2019-06-13 14:08:46 -07:00
Mitch Denny f9ab3d28a0
First pass at swapping to specifying service directory. (#5490)
* First pass at swapping to specifying service directory.

* Adds/updates ci.yml files for everything currently in sdk/

* Added dev requirements to fix keyvault.

* Updated dev requirements for azure-keyvault module.

* Adding aiohttp to list of dependencies.

* Simplify ServiceDirectory parameter.
2019-05-28 20:08:19 -07:00
Scott Beddall 7c4b6eacb3
allow coverage xml to fail, leading to yellow build (#5503)
Setting `continueOnError` for coverage publishing in Mitche's CI.yml stuff.
2019-05-28 15:37:44 -07:00
Mitch Denny 6a4fc46b30 Fix ci.yml for applicationinsights (#5476)
* Had a ci.yml file in the wrong place.

* Turns on CG skip since we have it explicitly in the analyze step.
2019-05-28 12:03:06 -07:00
Mitch Denny a6fd83099c Introduces ci.yml files for all files in sdk/ folder. (#5426) 2019-05-24 15:03:55 -07:00
Mitch Denny 4d9560cfd5
Removed Python_Alpha from the PR validation builds. (#5296) 2019-05-21 17:55:16 -07:00
Mitch Denny b6f93ba593 PR validation pipelines for Python repo. (#5234)
* Initial layout for PR validation pipelines.

* Fixing path filter, and clearing some whitespace.

* Added ci file for service bus.

* moved ci.yml file for servicebus.

* Fixed up trigger path.

* Fixed up template relative path.

* Trying a different targetting string.

* Target string fix and enabling coverage collection under /sdk.
2019-05-17 10:23:27 -07:00