* moves text analytics track 2 to sdk/textanalytics and renames to azure-ai-textanalytics
* more renames
* fix env var name for async testcase
* bump azure-core version in setup.py
* update shared reqs
* readme.rst -> readme.md for nspkg
* pylint fixes for nspkg
* change nspkg version
* update nspkg manifest.in
* temp add azure-ai-nspkg to dev_requirements.txt until pkg released
* update code from swagger fixes
* review updates
* adding generated code for TA v3-p1
* started work on convenience layer for detect entities
* working on batched operations
* fixes the document language model, swagger needs update
* working on single operations
* updated generated code, working on error handling
* more error handling work
* error handling for entities
* fixes results and errors combined response
* adds autosegmentation of batches and renames operations
* fix policy
* adds async client, refactoring, and ran black
* whole batch error handling
* fix async client
* fix error handler, fix testcase
* update generated code - commit c0df36f
* adds azure core to setup and updates to Error model
* add docstrings and fix python 2 errors
* fix bug in validate input
* add request id policy, update docstrings, and version
* fix python 2
* adds some tests and single operation samples
* add conftest
* fix python 2
* enable pylint in CI for textanalytics
* fix pylint mistake
* add another test
* fix single method raised errors and unskip tests
* more samples and a few fixes
* refactor error method
* re-generated code at commit 013ee15 and fixes as a result
* feedback - single operations return same type as batch
* simplify policy
* fix test for python 2
* add async single methods, samples, tests
* add samples to manifest.in
* DocumentLanguage returns a single DetectedLanguage per document
* support batch language/country hint
* models inherit from dictmixin + a few tests
* ignore samples readme and fix type hints
* aad support
* review feedback and wip readme
* fix readme
* fix readme again
* mypy clean and enabled mypy failures in CI
* default country and language hint + tests
* revert documentlanguage returning a single detectedlanguage per document
* add literalincludes to samples
* update history and convert .rst to .md
* renamed detect_language to detect_languages
* renames LanguageInput -> DetectLanguageInput and MultiLanguageInput -> TextDocumentInput
* review feedback
* update shared reqs for msrest
* version manipulation scripts
* update batch
* update core-tracing-opencensus
* update eventhubs
* update identity
* update keyvault
* update servicebus
* update azure-storage-file-datalake
* update template
* update version strategy to follow https://github.com/Azure/azure-sdk/pull/782/files
* add versioning requirements
* update azure-common
* exclude nspkg and metapackages
* fix a few linting/code change errors
batch: fix version import
add newline to fix lint error
fix linting errors for opencensus
fix lint errors for eventhub
fix lint errors for keyvault
fix keyvault error: spell version correctly
* pad dev build version from this discussion: https://github.com/Azure/azure-sdk/pull/782/files#r346089367
including length validation
fix remaining lint/other errors
[skip ci]
* correct lint errors [skip ci]
* fix a few linting/code change errors
batch: fix version import
add newline to fix lint error
fix linting errors for opencensus
fix lint errors for eventhub
fix lint errors for keyvault
fix keyvault error: spell version correctly
* pad dev build version from this discussion: https://github.com/Azure/azure-sdk/pull/782/files#r346089367
including length validation
fix remaining lint/other errors
* add some features to find_invalid_versions.py and add a step to archetype-sdk-nightly.yml to start validating package versioning
Revert "update azure-common"
This reverts commit e6f8fd9690954f6278f745c1eff13b04be5cd9e1.
Discussion: https://github.com/Azure/azure-sdk-for-python/pull/8639#discussion_r347023057
* add ability to filter by service directory, improve outputs, move into analyze template
* remove extra imports that got pulled in from a rebase in eventhubs
* add validation and use zero-fill of 3
* add back in import from ._common... too much was removed
* add comment about using --always-succeed when checking for valid package versioning
* remove extra whitespace
add remaining KV smoke tests back in
add to requirements
allow for other versions of python 3.7
update to use older interfaces
fix up smoke tests for september 2019 preview
name the matrix entry properly
do not wait for cert creation in b3
* updating 20 or so management packages with proper service classification. also handling missing namespaces when generating documentation.
* fixed the package omission list when building docs
* now outputting all packages with categorization
* adding generate_versioned_index that can be used to generate an index page
* confirmed that original doc build is still working
* updated templating to allow for injection of drop downs on individually rendered doc artifacts
* allow presence of `<packagename>/doc` folder that will take precedence over running `sphinx-apidoc`
* Build ymls supporting generating a subset of docs and the index page
* updates to archtype-sdk-client to pass in a named docArtifact
* Update mypy_hard_failure_packages.py
* Fix MyPy
* Run mypy for specified package only
* Updated dev_requirements to trigger CI
* Run mypy for only python 3.7
* Trigger CI for azure-core
* Fix latest mypy errors
* implemented unique recording that always relys on RUN_IDENTIFIER
* recorded test files, passing
* implemented unique recording in secrets
* recorded secret test files, passing
* fixed file reading code
* added try catch for file reading
* switched from hash to seeding, working
* implemented with urlsafe b64 encoding
* moved seed file to tests folder
* switched to using integer encoding of unicode characters
* got rid of pytest fixture, re-recorded key tests to test live
* added live testing file
* moved logic into try except block
* here's a thought
* added logic to get unique identifying environment variable
* implemented Charles' comments
* added environment variables
* making live pipeline record
* added live testing environment variable
* addded os imports
* added subscription id env variable
* switched to getting tenant id through function
* converted to using md5 hashing
* re-recorded tests
* make pipeline platforms run serially
* got rid of os abspath joining
* added additional test args to pipeline yaml file
* increased waiting time for deleting certificates
* adding xdist loadscope
* increased waiting time after purging certificates
* started adding name prefix to resource group creation
* added hashing of run identifier into rg name for secrets
* added hashing of run identifier into rg name for keys
* added prefix to resource groups, one failing
* updating to comply with new pipeline changes
* re-recorded tests with new run identifier
* ran black on certificates
* replaced recordings with recordings from origin master
* re-recorded tests, one certificate test failing
* separate by package
* add unique job names
* skipping async test of async_request_cancellation_and_deletion
* support for single package site gen using tox. tox -e sphinx
* updating manifest files to include tests in the source distribution. this means that the examples will also be renderable on docs.ms
* Added steps to CI to generate documentation for targeted servicedirectory
* Install pytest-asyncio
* removing duplicate requirements for asyncio
* touch azure-core to force a re-run of the checks
* remove pytest from identity dev_requirements
* use xdist in live tests (optional) and in nightly tests (default)
* make parallelism 8 instead of the number of procs
* remove xdist from nightly runs for now... it should be pretty easy to add these back in when the client build is succeeding and we know we aren't introducing additional problems
* originally removed this method due to a 'brilliant simplification' only to realize that kinda missed an essential filter during a build for a release
* add emulator to ci.yml
* mark globaldb tests, try removing emulator from live tests
* use the accepted gating cosmos emulator url
* live tests
* remove redundant BuildTargetingString
* make coverage arg into a variable because of build-test.yml's construction
* remove extra comment, extra templates don't add value here given that this file is cosmos-specific already
* remove old cosmos pipelines
* remove extra comment
* update sdist to not install in develop
* allowing CI to run dev_setup without develop mode
* updating appconfiguration manifest so that the sdist can properly install
* update applicationinsights manifest so that the sdist can properly install
* bugfix in dev_setup.py, bad syntax. adding 'develop' environment to the tox.ini
* datalake analytics packages have bad manifests
* repair manifest for sdist azure-eventhub
* adding manifest for identity
* updating manifest for scheduler
* repair manifest for servermanager
* removing --universal argument in build_packages.py
* extending common_tasks.py. now we filter package set ALSO by CI compatibility
* adding additional dependencies during build to allow targeting to successfully work
* updating coverage on nightly run to only run against py2.7 and py3.7
* re-enabling code-coverage on PR builds
* updating `live` skeleton to properly pass no-cov arguments
* updated both `test-nightly.yml` and `build-test.yml` to reference a common `publish-coverage.yml` and allow coverage enable/disable to be be passed as part of the matrix
* Updating `setup_execute_tests.py` to run pytest one at a time, then combine coverage once all tests have executed. This means that individual test projects can't mess with each other's configurations. However, we're still testing for a stomped namespace due to the fact that all are installed alongside each other.
* [storage] Add async APIs for Files SDK (#6405)
* Refactored blob shared utils
* Refactored file shared utils
* Refactored queue shared utils
* Refactored downloads
* Refactored file downloads
* Started async downloads
* Async Files API
* Flatten copy polling
* Renamed uploads
* Fixes samples based on vendor feedback (#6357)
* fixed import statements for sync samples
* fixed secrets readme samples
* fixed keys readme samples
* deduped secret names across samples
* Upload refactor
* Release approval docs (#6361)
* updating dev documentation with approval details
* Updated async pipeline
* Avoid surprising aiohttp with unexpected kwargs (#6355)
* Add challenge authentication to azure-keyvault-keys (#6244)
* Add decorator (#6299)
* add opencensus impl
* dont need to check for noop tracer
* get rid of span and trace id
* fix span instance
* added documentation
* added documentation and refactor names of a few variables
* write test for opencensus wrapper
* put opencensus in the dev requirements
* initial common
* only import the wrapper when necessary
* add check for the exporter
* rework logic and fix some settings
* added initial decorator
* some mroe documentation
* added decorators
* small change
* some minor fixes
* test patch happening
* fix space
* share a function
* clearer logic for setting span context
* better logic
* better logic
* fix environ variable
* test the way opencensus does it
* middle of tests
* only load if opencensus has already been imported
* fix spelling mistake
* temp
* finish writing tests for common
* charles fixes
* fix tests
* fix test settings
* to header should not take a dict
* from header should be class method
* initial tests
* dont create trace and get rid of end_tracer
* dont need to save the trace
* more little fixes
* some intermediatary changes
* fix type annotations
* rst fix types
* add :class:annotations
* fix line wrapping
* added tests for decorator
* rename opencensus wrapper
* intermediate changes
* use spans the right way
* some formatting
* some grammar
* restructure settings and make tests pass
* rename get_parent
* fix typings
* use protocol and from_headers becomes links
* ramifications of opencensus wrapper being a protocol
* add tests for link
* added async tests
* delete the unit test thing
* added add_attribute
* added add_attribute
* added tests for add attributes
* remove unused import
* added docstrings
* minor docstring formatting
* fix pylint errors
* don't rely on opencensus children to check
* use exporter to not rely on parent.children
* test should only propagate
* made test tracing helper
* decrease flakiness of test
* simplify get parent
* calling a decorator decorator is redundant
* fix settings
* more elegant code
* add await for async
* should only have to wait a 1/1000 of a second
* fix tests spans too short
* accidentally deleted setup.cfg
* Added async file tests
* Consolidate Key Vault shared code (#6384)
* Download tests
* Service property tests
* No recordings
* Add credential wrapping MSAL ConfidentialClientApplication (#6358)
* Add policy (#6379)
* add opencensus impl
* dont need to check for noop tracer
* get rid of span and trace id
* fix span instance
* added documentation
* added documentation and refactor names of a few variables
* write test for opencensus wrapper
* put opencensus in the dev requirements
* initial common
* only import the wrapper when necessary
* add check for the exporter
* rework logic and fix some settings
* added initial decorator
* some mroe documentation
* added decorators
* small change
* some minor fixes
* test patch happening
* fix space
* share a function
* clearer logic for setting span context
* better logic
* better logic
* fix environ variable
* test the way opencensus does it
* middle of tests
* only load if opencensus has already been imported
* fix spelling mistake
* temp
* finish writing tests for common
* charles fixes
* fix tests
* fix test settings
* to header should not take a dict
* from header should be class method
* initial tests
* dont create trace and get rid of end_tracer
* dont need to save the trace
* more little fixes
* some intermediatary changes
* fix type annotations
* rst fix types
* add :class:annotations
* fix line wrapping
* added tests for decorator
* rename opencensus wrapper
* intermediate changes
* use spans the right way
* some formatting
* some grammar
* restructure settings and make tests pass
* rename get_parent
* fix typings
* use protocol and from_headers becomes links
* ramifications of opencensus wrapper being a protocol
* add tests for link
* added async tests
* delete the unit test thing
* added add_attribute
* added add_attribute
* added tests for add attributes
* add initial policy
* remove unused import
* added docstrings
* minor docstring formatting
* fix pylint errors
* don't rely on opencensus children to check
* use exporter to not rely on parent.children
* added documentation and span attributes
* added test tracing policy
* test should only propagate
* made test tracing helper
* decrease flakiness of test
* simplify get parent
* calling a decorator decorator is redundant
* middle of writing tests
* fix settings
* add tests
* test propogation also happens
* more elegant code
* await async stuff
* add await for async
* should only have to wait a 1/1000 of a second
* fix tests spans too short
* accidentally deleted setup.cfg
* add component
* add set_http_attributes
* fix span network name
* fix http request types
* fix more types
* bryan fixes
* more efficient tests
* non flakey tests
* make tracing only use my context
* test user agent on exception
* pylint formatting
* delete unused import
* fix spelling
* pylint
* adding dockerfile (#6393)
* Update cheatsheet.md
* Async share tests
* Async directory tests
* Fixed some tests
* aiohttp socket timeout
* Patch azure core
* CI fixes
* Fix async tests for py35
* Python 3.5 support
* Clean pylint
* Async implementation for storage queues. (#6360)
* Async Queues + tests port
* More tests plus changes
* pytest conf
* Port shared folder
* remove warnings from tests
* Latest shared code
* change destination
* some more changes
* ..and some more
* fix tests
* pylint + mypy
* some more lint
* A couple of test fixes
* Fixed fake settings mode
* Refactored queue utils
* change conf ignore
* minor change
* Fix for urlencoding SAS tokens
* Merge latest azure-core changes
* Updated shared blob client
* add decorator and policy to storage_files and propagate context for it (#6454)
* add decorator and policty to files
also propagated context!
* added decorator to pollers
* finished should also be traced
* polling method does not need to be decorated
* add tracing policies
* propagate context
* no decorator for generate_shared_access_signature
* added decorators to async libs
* Trace storage queue (#6449)
* decorators and policy added
* properly clear context
* dont decorate private stuff
* added policy
* decorated async
* get rid of those that dont make netowrk calls
* propagate context
* Trace storage blob (#6478)
* properly clear context (#6448)
* added decorators to keyvault-keys (#6381)
* Remove default development settings (#6376)
* Trace decorator optional arguments (#6459)
* add optional parameters to decorators
* added type hints
* Use tracing policy (#6390)
* Remove config public API for KV keys (#6418)
* Remove config public API for KV keys
* Make create_config private
* Sync _shared keys/secrets
* Type annotation fix
* Adapt secrets tests for no config
* Update README.md
* decorate polling
* decorate lease
* decorate container client
* trace blob service client
* polling method does not need to be decorated
* decorate blob client
* add policy
* added policy to the blob
* Update root README.md
Updating the Contributing section according to the guidelines
* get rid of util and propagate context properly.
* get rid of functions that do not do a network call
* propagate context
* Revert "propagate context"
This reverts commit 1bd07edc5b.
* New paging to storage preview2 branch (with async) (#6493)
* Update root README.md
Updating the Contributing section according to the guidelines
* Update CODEOWNERS
* more code owners
* add policy and decorators for secrets (#6453)
* Smoke test for Python (#6412)
* Smoke Test Sample for Track 2 libraries
Smoke Test for Indentity, Key Vault Secrets, Storage Blobs, Event Hubs and Cosmos DB
* simpleQuery method added
* Method's names updated
* Create README.md
* Update README.md
* Commented lines deleted
* README.md moved to correct folder
* Create requirements.txt
* Update README.md
* Update README.md
* Imports changed
* Use of literals instead of append
* Database Name variable to class level.
* Use of Pythonic with statements
* Update requirements.txt
* Revert "Update requirements.txt"
This reverts commit 4b79c6a847.
* Revert "Use of Pythonic with statements"
This reverts commit 81adc4ca46.
* Revert "Revert "Use of Pythonic with statements""
This reverts commit 27b2a2d635.
* requiriments.txt encoded as a txt file
* requirements.txt as text file
* Misspelling in "Key concepts"
* Update .docsettings.yml to match the tittle of Smoke Test
* Went trought Suyog comments
* Revert "Went trought Suyog comments"
This reverts commit 35c62232f8.
* Gone trought Suyog comments
* use of snake case in file names
* Paging v2 (#6420)
* First version of paging
* Clean sync paging
* Async paging
* Name AsyncList without underscore
* MyPy happyness
* pylint
* black
* PageIterator as conf
* Simplify ItemPaged
* Use chain to link iterable
* Make Paging more open
* Docstring
* pylint / mypy / black
* Regenerate KV with latest Autorest + Paging branch (#6479)
* Regenerate KV with latest Autorest + Paging branch
* Remove unused import in tests
* Make the async adapter more generic
* Regeneration after operation mixin fix in Autorest
* COmmit changes forgotten in #6418
* Fixing syntax for 2.7
* Move Storage Queue to new Paging (#6447)
* Move Storage Queue to new Paging
* Working Storage queue on new paging
* Fix types
* First shot of blob tests update
* Fixing blob tests
* File to new paging
* Doc fix
* Feedbacks from @annatisch
* Fix last @annatisch comment
* Simplify paging contract
* Fix storage queue after new paging contract
* Fixed incorrect auto-merge
* Fix docstring
* Port aio to new async paging
* Adapt async tests
* Missing by_page
* Fix async tests
* Fix continuation token bug
* Support for aiohttp records from vcrpy (#6552)
* Async recording for Storage (#6560)
* Aiohttp is the only default for async clients (#6561)
* seed tests.yml (#6645)
* [storage] Blob async APIs (#6489)
* Updated blobs shared code
* Started blob refactor
* Refactoring upload
* Updated shared code
* Started fixing tests
* Refactored sync blobs
* Added blob async APIs
* Some fixes
* Append blob async tests
* blob access async tests
* Blob client async tests
* encryption async tests
* Patch for azure core exception
* blob retry async
* Retry async tests
* Get blob async tests
* Bug fix for clear page operation
* More async tests + upload fix
* Merged blobs
* Updated Files shared code
* Updated queue shared code
* async tests pass except 2 common blob tests
* adds async paging to blobs and some async tests (not all pass)
* initial commit
* block_blob_tests
* page blob tests
* fix for special chars, some tests, and recordings
* add to shared storage and fix import
* adding more tests/recordings
* more tests/recordings
* rerecord tests, fix imports
* fix import again
* blacklist azure-servicemanagement-legacy
* get CI to run
* rerecord all async tests
* testing
* add variable indirection for storage live tests. this is a temporary measure to create live test pipelines for this particular framework
* newline
* print envar
* remove testing
* adjust pypy testing
* Storage Recordings For Queues and Files (#6629)
* initial commit
* recordings
* fix all tests
* update queue recordings
* file recordings
* queue recordings
* fix for encoding tests
* small fix
* change conftest
* remove recordings
* oops
* new recordings
* some fixes
* more fixes
* and more fixes
* and one more fix
* allowing specific project targeting for storage livetests
* allowing BuildTargetingString to flow through for templates following 'archtype-sdk-tests'
* passing service directory to setup task
* Support for Live storage tests (#6663)
* play
* playing
* some prints
* some tweaks
* try-345
* fix
* tweak for queue and file
* remove prints
* [storage] Preview2 updates (#6658)
* Updated change logs
* Bumped versions
* Some test fixes
* Fix for file handle next marker
* Fixed error in release notes
* Updated core version
* Updated azure-core shared dep
* Updated release notes
* fix test (#6674)
* Fix for queue models (#6681)
* [storage] Readme tweaks (#6697)
* Fix for queue models
* Docs cleanups
* Some final tweaks (#6687)
* Some final tweaks
* oops
* comments
* little better
* Pylint
* [storage] Better async import error message (#6700)
* Fix for queue models
* Docs cleanups
* Better async import error
* splitting install and run steps into separate executions. extending setup_execute_tests.py so that you can optionally run just setup, just execute, or (default) both.
* remove old client.yml and tests.yml files from .azure-pipelines
* refactor archetype-sdk-client.yml and add a cleaner client.yml file to /eng/pipelines
* DRY up pipeline YAML
* create tests.yml for eventhub and servicebus
* rename CoverageParam -> AdditionalTestArgs
* First pass at swapping to specifying service directory.
* Adds/updates ci.yml files for everything currently in sdk/
* Added dev requirements to fix keyvault.
* Updated dev requirements for azure-keyvault module.
* Adding aiohttp to list of dependencies.
* Simplify ServiceDirectory parameter.
* Initial layout for PR validation pipelines.
* Fixing path filter, and clearing some whitespace.
* Added ci file for service bus.
* moved ci.yml file for servicebus.
* Fixed up trigger path.
* Fixed up template relative path.
* Trying a different targetting string.
* Target string fix and enabling coverage collection under /sdk.