Граф коммитов

1999 Коммитов

Автор SHA1 Сообщение Дата
Matias Quaranta ca4b969db0
[Internal] Pipelines: Adds rolling pipeline (#4460)
* adding opt-in flags

* adding pipeline
2024-04-30 13:03:41 -07:00
Nalu Tripician a33144864e
FaultInjection: Adds ReadFeed Operation Type (#4448)
* initial commit

* fixed tests

* nits

* small fixes

* fixed test
2024-04-30 13:49:53 -04:00
neildsh bda8290201
Switch non streaming order by to use flag from query plan instead of _streaming in the response (#4459) 2024-04-29 21:17:12 +00:00
Nalu Tripician bf2f5ee197
FaultInjection: Adds SendDelay ServerErrorType (#4447)
* Initial Commit

* nits
2024-04-28 09:50:45 -07:00
Aditya 14633455d2
Query: Fixes Persisted continuationToken issue by turning off ODE by default (#4413)
* Turn of ODE by default.

* Updated tests

* Update

* Test fix

* Added test for query resumption with ODE token with partition split container (failure case).

* Update.

* Update Benchmark

* Addressed comments.
2024-04-24 06:42:46 -07:00
neildsh 85a8444b84
Add a new capability for non streaming order by in QueryFeatures and add a new flag to QueryInfo that will be used by ServiceInterop to indicate non streaming order by queries (#4446) 2024-04-23 10:25:49 -07:00
Matias Quaranta 400abfd518
[Internal] Documentation: Adds details about retry backoff for 410/449 (#4445)
* Update SdkDesign.md

* Update SdkDesign.md
2024-04-22 22:03:37 +00:00
Maya Painter 61319986f1
Samples: Adds STJ LINQ Serializer Example (#4420)
* initial commit

* bump sample version

* update comments

* sln file fix

* update comment

* Update Microsoft.Azure.Cosmos/src/Serializer/CosmosLinqSerializer.cs

Co-authored-by: Matias Quaranta <ealsur@users.noreply.github.com>

* remarks fix

* xml fix

---------

Co-authored-by: Matias Quaranta <ealsur@users.noreply.github.com>
2024-04-18 22:03:54 +00:00
Aditya a76666dc5f
[Internal] ReleaseNotes : Adds known issue to list (#4434)
* Initial commit

* Update

---------

Co-authored-by: Matias Quaranta <ealsur@users.noreply.github.com>
2024-04-18 13:11:34 -07:00
Philip Thomas a8f4b7e80f
SDK 3.39.1/3.40.0-preview.1: Adds version bump and changelog. (#4430)
* SDK 3.39.1/3.40.0-preview.1: Adds version bump and changelog.

* Update changelog.md

Co-authored-by: Matias Quaranta <ealsur@users.noreply.github.com>

---------

Co-authored-by: Matias Quaranta <ealsur@users.noreply.github.com>
Co-authored-by: Sourabh Jain <sourabhjain@microsoft.com>
2024-04-18 07:08:35 +00:00
Debdatta Kunda de078b4ad1
[Internal] Flakey Tests: Fixes few Tests in `GatewayAddressCacheTests` (#4424)
* Code changes to fix one of the GW cache flakey tests.

* Code changes to fix some of the assertions.

* Code changes to use IsCompletedSuccessfully.
2024-04-17 22:50:23 +00:00
Philip Thomas c9de5a3557
ChangeFeedProcessor: Fixes ArgumentException when dealing with Legacy lease incremental documents that do not have a Mode property (#4426)
* fix for 4423

* fix comment

* some recommendation changes
2024-04-17 11:17:47 -07:00
leminh98 5efe2db046
[Internal] Query: Adds tests for LINQ GROUP BY Multi-value translations (#4403)
* init

* Added tests

---------

Co-authored-by: Minh Le (from Dev Box) <leminh@microsoft.com>
2024-04-17 00:14:06 +00:00
Matias Quaranta b875c61193
[Internal] Security: Fixes Azure.Identity dependency on Microsoft.Azure.Cosmos.Encryption.Custom (#4421)
* Bump dependency

* Bump Azure.Core
2024-04-16 21:27:40 +00:00
neildsh 08338af632
Fix bug in OrderByCrossPartitionQueryPipelineStage to ensure that failures in creating the inner pipeline stage are bubbled up to the higher stages (#4419) 2024-04-16 12:24:04 -07:00
dependabot[bot] bf4704f5cf
Bump OpenTelemetry.Instrumentation.Http (#4414)
Bumps [OpenTelemetry.Instrumentation.Http](https://github.com/open-telemetry/opentelemetry-dotnet) from 1.6.0-rc.1 to 1.8.1.
- [Release notes](https://github.com/open-telemetry/opentelemetry-dotnet/releases)
- [Commits](https://github.com/open-telemetry/opentelemetry-dotnet/compare/1.6.0-rc.1...Instrumentation.Http-1.8.1)

---
updated-dependencies:
- dependency-name: OpenTelemetry.Instrumentation.Http
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-04-15 18:36:27 +00:00
dependabot[bot] 36a35472df
Bump Azure.Identity (#4409)
Bumps [Azure.Identity](https://github.com/Azure/azure-sdk-for-net) from 1.10.2 to 1.11.0.
- [Release notes](https://github.com/Azure/azure-sdk-for-net/releases)
- [Commits](https://github.com/Azure/azure-sdk-for-net/compare/Azure.Identity_1.10.2...Azure.Identity_1.11.0)

---
updated-dependencies:
- dependency-name: Azure.Identity
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Matias Quaranta <ealsur@users.noreply.github.com>
2024-04-12 20:59:05 +00:00
dependabot[bot] 2c5ab47d94
Bump Azure.Identity in /Microsoft.Azure.Cosmos.Samples/Usage/Encryption (#4410)
Bumps [Azure.Identity](https://github.com/Azure/azure-sdk-for-net) from 1.10.2 to 1.11.0.
- [Release notes](https://github.com/Azure/azure-sdk-for-net/releases)
- [Commits](https://github.com/Azure/azure-sdk-for-net/compare/Azure.Identity_1.10.2...Azure.Identity_1.11.0)

---
updated-dependencies:
- dependency-name: Azure.Identity
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Matias Quaranta <ealsur@users.noreply.github.com>
2024-04-12 18:13:37 +00:00
Sourabh Jain ef719fb2ae
[Internal] Distributed Tracing: Fixes Client Config Test (#4406)
* Adds code to create activity even customer is not subscribed to the feature

* Added documentation
2024-04-12 05:36:49 +00:00
Nalu Tripician f335f6563b
update readme to make it more clear (#4399)
Co-authored-by: Kiran Kumar Kolli <kirankk@microsoft.com>
2024-04-12 01:06:54 +00:00
leminh98 0e066252cf
Query: Fixes ResponseMessage not parsing the IndexMetrics as text in latest sdk (#4397)
* Fix response message not parsing the index advice as text in latest sdk

* add test coverage

* address code review

---------

Co-authored-by: Minh Le (from Dev Box) <leminh@microsoft.com>
2024-04-11 19:09:05 +00:00
Nalu Tripician cb7f923a13
[Internal] Pipelines: Adds MultiRegion Test support for release pipelines (#4398) 2024-04-10 12:51:11 -07:00
Philip Thomas 496ddba88b
SDK 3.39.0: Adds version bump and changelog. (#4391)
* SDK 3.40.0-preview.0: Adds version bump and changelog.

* SDK 3.40.0-preview.0: Adds version bump and changelog.

* SDK 3.40.0-preview.0: Adds version bump and changelog.

* change version for release; create diffs

* added query PRs to changelog

* add note for Rename refactoring of ChangeFeedItemChange<T> to changelog

* removing 4281 since it was mislabeled. it should have been treated as Internal

* grammar error

* formatting

* case change

* Update changelog.md

Co-authored-by: Justine Cocchi <jucocchi@microsoft.com>

* removing 4317 from change log. should be internal

* add new regions to changelog. also Direct Package version update

* fixed linked to DP PR

* more changes based on review

---------

Co-authored-by: Justine Cocchi <jucocchi@microsoft.com>
2024-04-09 20:17:24 +00:00
joegoldman2 4b2196bc60
Distributed Tracing: Update operation name for non-generic feed iterator read operation (#4374)
* Distributed Tracing: Update operation name for non-generic feed iterator read operation

* Update tests

---------

Co-authored-by: joegoldman2 <147369450+joegoldman@users.noreply.github.com>
Co-authored-by: Matias Quaranta <ealsur@users.noreply.github.com>
2024-04-06 16:27:13 +00:00
Debdatta Kunda d1ff001bc9
[Internal] ContainerProperties: Adds Vector Embedding and Indexing Policy (#4379)
* Initial code changes to add vector embedding policy and index type in container.

* Code changes to add container builder for vector index type.

* Code changes to add and fix tests.

* Revert back client create and initialize test.

* Skipping some of the V2 tests for vector indexes.

* Code changes to fix GA and preview contracts.

* Code changes to address review comments part 1.

* Removed unnecessary JSON argument for vector index.

* Code changes to update contract changes.

* Code changes to update preview contract changes in tests.

* Code changes to address few review comments.

* Code changes to add few more tests to validate serialization and deserialization.

* Code changes to address some review comments for best practices.

* Code changes to fix test failures.
2024-04-05 15:39:17 -07:00
Nalu Tripician b882e26882
fixes bug (#4389) 2024-04-05 21:38:57 +00:00
Aditya 90b852611a
[Internal] Query: Fixes Client QL exception by dropping ClientQLCompatibilityLevel (#4387)
* Initial commit

* Added Test Coverage.
2024-04-04 23:33:41 +00:00
Taylor 61230f9999
[Internal] Regions: Adds new USSec Region (#4386)
Co-authored-by: Taylor Hamilton <tahamilt@microsoft.com>
2024-04-04 08:41:17 -07:00
Nalu Tripician 80647baea2
[Internal] Direct Package: Adds Support for Direct package version 3.33.0 (#4353)
* upgraded direct package version

* added Taiwan regions

* update contracts

* fix contracts

* fixed more contracts

* contracts change

* contract change remove

* changed baseline files

* added space

* added region name check test for future verification

* nits

---------

Co-authored-by: Sourabh Jain <sourabhjain@microsoft.com>
2024-04-03 12:27:00 -07:00
Aditya 1106cd7cfe
[Internal] Query: Fixes occasional hang while querying using partial partition key against a sub-partitioned container (#4359)
* Initial commit

* Suite0 fixes.

* Updated Test.
2024-04-02 15:51:01 -07:00
kevin-montrose e04ce514f8
Performance: Refactors query prefetch mechanism (#4361)
* sketch out improved ParallelPrefetcher; focus is on reducing allocations, but we also can't be substantially slower to start all tasks

* little more cleanup to further reduce allocations, and save a tiny amount of CPU

* start on testing

* some tweaks and testing for buffer management

* test exception handling; fix a bug in high concurrency case that would swallow exceptions

* test cancellation

* more testing, a little bit of cleanup

* test the case where the enumerator faults; fixes a couple leaks of Tasks and buffers that could occur in that some places

* tiny bit of cleanup

* cleanup and expand comments; code is tricky, it needs documentation

* address a whole bunch of style nits, just to keep compiler Message counts down

* address some feedback on comment clarity

* don't rely on finalizers for testing, it's too brittle; hold up was not allocating more in the non-test cases, but found a field to reuse; needs benchmarking

* complete ITrace proxy for testing

* style nits and a bit more commentary

* explicit test for concurrent access to the inner IEnumerator

* explicit test that IEnumerator is disposed

* explicitly implement all ITrace members

* address feedback: internal class members should be public or private

* address feedback: break test-only bits of ParallelPrefetch out into a partial

* address feedback: move const above type declarations

* address feedback: naming nits

* address feedback: use the existing NoOpTrace

* address feedback: remove pointless using

* update baseline trace text for QueryAsync test

---------

Co-authored-by: neildsh <35383880+neildsh@users.noreply.github.com>
2024-04-01 21:34:37 +00:00
leminh98 15d83a7d08
Query: Adds translation support for single key single value select GROUP BY LINQ queries (#4074)
* preliminary change

* Add some more boiler plate code

* move all linq test to the same folder; add some groupBy test

* fix references error in test refactoring

add code for group by substitution. Still need to adjust binding post groupby

* preliminary for the groupby functions with key and value selector

* trying to change collection inputs for group by

* WIP bookmark

* Successfully ignore "key"

* clean up code

* Sucessfully bind the case of group by with only key selector and no value selector followed by an optional select clause

* enable one group by test

* add support for aggregate value selector

* added baseline

* working on adding support for multivalue value selector and key selector

* code clean up

* more clean up

* more clean up

* update test

* Move test to separate file

* code clean up

* remove baseline file that got moved

* fix merge issue

* Changes test infrastructure to reflect changes from Master

* address code review part 1

* Address code review 2 and adds code coverage

* Addressed code review and added tests. Still a couple of bugs to iron out

* Fix group by translation issue and add more test

* update comments

* address pr comment

---------

Co-authored-by: Minh Le <leminh@microsoft.com>
Co-authored-by: Aditya <adityasa@users.noreply.github.com>
2024-04-01 19:18:15 +00:00
neildsh 578832669c
Query: Adds support for non streaming ORDER BY (#4362)
* Initial prep for adding a non streaming order by query pipline stage

* Change TracingAsyncEnumerator to be an adapter class between ITracingAsyncEnumerator and IAsyncEnumerator

* Move TracingAsyncEnumerator to product code

* Change ITracingAsyncEnumerator.MoveNext to take a CancellationToken, thereby removing the awkward method SetCancellationToken from IQueryPipelineStage

* draft implementation of non streaming order by pipeline stage

* Fix bug that drops first record on an initialized page

* Add a test class for non streaming order by unit tests

* remove unnecessary usings

* Add an emulator test for non streaming order by. Also lay groundwork for an alternative implementation for non streaming order by

* Remove the ResponseLengthInBytes property from QueryPage. This was being calculated incorrectly, and seems to be unused to boot.

* Add an ItemCount property to the Page class

* Add a multi level heap implementation for non streaming order by

* Add infrastructure for writing parity tests

* Fix a bug that caused the page enumerator to be dropped when we reach flat heap sizze limit

* When cloning OrderByQueryPartitionRangePageAsyncEnumerator as a fully buffered enumerator, make sure that we set the page size to maximum for the backend requests

* Simplify the non streaming pipeline stage, and add performance test

* Revert the changes for Headers.ItemCount Keep it as a string

* Avoid an allocation each time the OrderByItems property of OrderByQueryResult is touched

* Fix up the OrderByPipelineSatgeBenchmark to use fully materialized CosmosElements in the oages returned from MockContainer

* Add a few more unit tests for non streaming order by

* Add emulator tests for non streaming order by

* Add a few more integration test cases

* Fix up broken unit test

* Add more test coverage for the non streaming order by

* If there is no continuationtoken, assume that the response is streaming

* Add stronger validation to the non streaming order by unit tests

* Fix up broken unit tests to account for ItemCount

* fix up plumbing for index utilization, and incorporate code review feedback

* Minor clean up

* revert bug introduced in pursuit of more elegant code :)

* fix up broken unit test

* Fix up broken perf test

* Fix up broken IndexMetricsParserBaselineTest

* Minor bug fixes for OrderByCrossPartitionEnumerator
2024-04-01 17:21:53 +00:00
Philip Thomas 4855a6afd7
ChangeFeedProcessor: Refactors AVAD metadata Contract (#4380)
* refactoring for name change

* more refactoring and run UpdateContracts
2024-03-29 19:48:48 +00:00
jiajunpeng-msft dfee5ad2b0
integrated cache: make BypassIntegratedCache API GA (#4377)
Co-authored-by: Jiajun Peng <jiajunpeng@microsoft.com>
2024-03-29 18:07:35 +00:00
Philip Thomas 71e58ee833
ChangeFeedProcessor: Adds AllVersionsAndDeletes support to ChangeFeedProcessor (#4370)
* preview cfp ffcf

* ran updatecontracts

* including this in Encryption

* fixing name onChangesDelegate

* sdkproject on encryptioncontainer

* try this again

* try, try, try again

* with impl
2024-03-26 20:32:13 +01:00
Nalu Tripician 75a2e5f98a
[Internal] Pipelines: Fixes Multi-Region CI pipeline to include env variable (#4363)
* Fixes Multi-Region CI pipeline to include env variable

* fixed space

* added validation test

* string conversion

* temp

* temp2

* Update Microsoft.Azure.Cosmos/tests/Microsoft.Azure.Cosmos.EmulatorTests/ClientTests.cs

Co-authored-by: Matias Quaranta <ealsur@users.noreply.github.com>

* Update Microsoft.Azure.Cosmos/tests/Microsoft.Azure.Cosmos.EmulatorTests/ClientTests.cs

Co-authored-by: Matias Quaranta <ealsur@users.noreply.github.com>

* changed env location

* temp

* test

* space

* remove env

* possible fix

* test fix

* clean up

* changed enviroment variable get

* test

* test fix

* ensure multiregion tests do not run with regular emulator tests

---------

Co-authored-by: Matias Quaranta <ealsur@users.noreply.github.com>
2024-03-25 14:19:04 -07:00
Philip Thomas dbdf8064f5
ChangeFeedProcessor: Fixes when ChangeFeedMode is switched should throw an exception. (#4334)
* test to prove no exception, no documents when change feed more is changed.

* renaming

* throwing exception when changeFeedMode change on CFP with same lease container

* removed PREVIEW tags under advisement. Well create a PR later

* removed usings

* revert to old summary

* defaulting change feed mode to latestversion

* change feed mode exception on switching and tests based on last recommendation.

* more changes based on discussions

* some refactoring

* fixed some tests

* more changes based on recommendations

* another refactor

* change from CosmosException to ArgumentException

* removed CosmosException from comments

* fixin tests to account for extra GetAllLeasesAsync call

* some recommendation changes
2024-03-22 14:39:33 +00:00
Sourabh Jain d1f879fed1
Distributed Tracing Documentation : Fixes the default value mentioned in code doc (#4357)
* Distributed Tracing Dcoumentation : Changed the default value mentioned in comment

* Update Microsoft.Azure.Cosmos/src/CosmosThresholdOptions.cs

Co-authored-by: Matias Quaranta <ealsur@users.noreply.github.com>

* Update Microsoft.Azure.Cosmos/src/CosmosThresholdOptions.cs

Co-authored-by: Matias Quaranta <ealsur@users.noreply.github.com>

---------

Co-authored-by: Matias Quaranta <ealsur@users.noreply.github.com>
2024-03-21 18:26:54 -07:00
Nalu Tripician ab8017023d
[Internal] Pipelines: Adds yml Files for New Multi-region CI Pipelines (#4301)
* added yml files

* added TestCategory param

* fixed pipeline yml files

* Update templates/build-test.yml

Co-authored-by: Matias Quaranta <ealsur@users.noreply.github.com>

* suggested changes

---------

Co-authored-by: Matias Quaranta <ealsur@users.noreply.github.com>
2024-03-20 17:49:06 +00:00
Nalu Tripician 652b99d98c
added known issue (#4349) 2024-03-17 08:34:10 +05:30
Xavier f0953f69fc
Update ReplicaValidationDesign.md (#4352)
Fix spelling
2024-03-15 19:02:11 +00:00
Philip Thomas c064a79d29
[Internal] ChangeFeedEstimator: Fixes ChangeFeedProcessorState.EstimatedLag to 1 When CFP is Dormant after a Partition Split (#4324)
* adding a test to repro issue 4285

* fix plus e2e test

* not all request have cosmos exception

* add a quick unit test for ChangeFeedEstimatorIterator when Gone exception happens

* added a test description

* ignoring long running test. meant to be ran manually

* move long running tests to its own folder and category; check response and header for status/substatus

* one test category only, removed using, and exluding LongRunning category from build pipeline

* Update templates/build-test.yml

I am committing your suggestion. Also, the goal of this PR is not to executed long running tests. I will create a new PR for this. Because there are other unknowns that I need to answer. So for now, I just don't want it to be executed with the existing pipelines.

Co-authored-by: Matias Quaranta <ealsur@users.noreply.github.com>

* change name of connectionString ENV to something more intention revealing

---------

Co-authored-by: Matias Quaranta <ealsur@users.noreply.github.com>
Co-authored-by: Sourabh Jain <sourabhjain@microsoft.com>
2024-03-13 17:42:55 +00:00
Sourabh Jain deab135c9b
Distributed Tracing: Adds configuration to disable network level tracing in sdk permanently (#4333)
* disable network level tracing in sdk

* update sample

* remove network level tracing logic altogrther

* 'fix spelling
2024-03-06 17:58:49 -08:00
Sourabh Jain d1a7d49859
Diagnostics: Adds Client Configuration for Synchronization context cases (#4338)
* disable network level tracing in sdk

* Revert "disable network level tracing in sdk"

This reverts commit 627cba6404.

* Including Client Configuration in request Diagnostics for Sync calls also
2024-03-05 12:13:52 -05:00
Maya Painter bf0f6291f2
initial commit (#4323) 2024-02-23 07:19:27 +00:00
Sourabh Jain 23dac8b3f2
Client Telemetry: Refactors code to stop throwing an exception. (#4317)
* Remove all code related to throwing an exception from client telemetry module

* Update Microsoft.Azure.Cosmos/src/Telemetry/ClientTelemetryProcessor.cs

Co-authored-by: Matias Quaranta <ealsur@users.noreply.github.com>

* Update Microsoft.Azure.Cosmos/src/Telemetry/ClientTelemetryProcessor.cs

Co-authored-by: Matias Quaranta <ealsur@users.noreply.github.com>

* updated tests

* remove extra try catch

* updated message

* cosmetic changes

---------

Co-authored-by: Matias Quaranta <ealsur@users.noreply.github.com>
2024-02-16 23:52:30 +05:30
Aditya 40dfa25a8b
Initial commit (#4322) 2024-02-16 02:13:57 +00:00
Bala Perumalswamy cba93d3fad
[Internal] Query: Adds support for continuation using SqlQuerySpec (#3774)
* initial change to support sending continuation as resume value in query spec

* serialize resume value in continuation token.

* fix unit test that was failing. other minor refactors

* additional refactoring
update exception messages

* few minor changes

* additional tests

* code refactoring

* Create separate top level object to represent SqlQueryResumeValue. Different types of resume values are private in this object
Consolidate all the visitor and serialization of resume value to SqlQueryResumeValue
Other code review comments

* handle different continuation token for target partition

* update test for continuation from array and object values. other minor code refactors

* save resume value as CosmosElement instead of defining a separate derived objects.

update cosmosundefinedquerytests. other code review comments.

* support on CosmosNumber64. Other number types are not supported for resume value. unit tests for SqlQueryResumeValue.

* update cosmosundefinedquerytests to include arrays and object in order by and group by tests. reducing the document count to reduce execution time.

* revert change to have separate SqlQueryResumeValue objects as it is better symmetry for comparing arrays and objects.

* group resume value into 3 types: Undefined, Primitive and Complex

* minor fix

---------

Co-authored-by: Bala Perumalswamy <balaperu@ntdev.microsoft.com>
Co-authored-by: Aditya <adityasa@users.noreply.github.com>
2024-02-13 12:33:44 -08:00
Sourabh Jain caa1aebe84
Distributed Tracing: Refactors code to rename net.peer.name attribute to server.address (#4316)
* Marking Distributed tracing feature as stable and changed an attribute name

* remove it from emulator test

* marked stable as false

* fix tests

* updated changefeedxml

* remove statuscode and subsstatus from staic list

* regenerated xml files

* remove event counters events
2024-02-13 22:12:12 +05:30