This PR migrates the pipelines to 1ES pipelines. It adds 2 files - official-build.yml and build.yml. official-build.yml references build.yml and runs on any changes pushed to the main branch.
* draft
* fix handling of batchposition, and tolerate race condition for deleted blob
* address PR feedback
* fix incorrect handling of skipped events
* fix check that removes confirmed events and add detail-level tracing
* fix broken trace statement
* fix handling of blob deleted
* add more tracing to blob download
* do not process any more events if already shutting down
* address PR feedback (add comments)
* fix handling of missing blobs
* Update src/DurableTask.Netherite/TransportLayer/EventHubs/BlobBatchReceiver.cs
Co-authored-by: David Justo <david.justo.1996@gmail.com>
---------
Co-authored-by: David Justo <david.justo.1996@gmail.com>
* fix race condition on mutable list of new events inside OrchestrationRuntimeState.
* Apply suggestions from code review
Co-authored-by: David Justo <david.justo.1996@gmail.com>
---------
Co-authored-by: David Justo <david.justo.1996@gmail.com>
* wrap FASTER callbacks so exceptions are logged, and release semaphores prior to callback.
* address PR feedback, add two more lines of tracing, and use simpler trace message
* refactor control path for FASTER callbacks. Eliminate callbacks with nonzero error code.
* immediately cancel all requests waiting for the semaphore when partition is terminated
* cancel faster callbacks prior to disposing FasterKV and FasterLog (to prevent hangs)
* revert reorganization of cancellation since it appears to lead to issues with hanging dispose calls
* add simple log
* add detail column to FasterAzureStorageAccessCompleted
* refactor read range log
* pass just the position parameter instead of printing full details for FasterStorageAccessCompleted
* put position and id information into details
---------
Co-authored-by: sebastianburckhardt <sburckha@microsoft.com>
* do not cancel EH batch loading when partition is terminated, but only when EH processor shuts down
* Update src/DurableTask.Netherite/TransportLayer/EventHubs/EventHubsProcessor.cs
Co-authored-by: David Justo <david.justo.1996@gmail.com>
---------
Co-authored-by: David Justo <david.justo.1996@gmail.com>
* always release lease when a partition shuts down
* address PR feedback (add comment)
* recognize another empiric case of transient storage exception
* change default of partition checkpointing
* do not release lease if lease was already lost.
* fix fencing of checkpoints that caused occasional concurrent modification exceptions and can cause history corruption
* add more comments to explain sessions and fencing
* Update CreationRequestReceived.cs
* remove the faster-alternate data store and fix broken deserialization. (#308)
* fix and instrument commitlog serialization and deserialization. (#305)
* fix discard of packets so the next packet to expect is updated correctly (#302)
* New EventHubs performance tests (#178)
* rebase, and remove changes to scale monitor
* add hello cities test that prints the history of a nested orchestration
* implement a watchdog that terminates CompletePending quickly if it hangs (#318)
* add unique id to scale monitor constructor (#316)
* fix bugs from PR #302 (#315)
* fix cache size reporting (#321)
* added a comment
* update durable task package references to 2.15.1 and 2.12.0 (#317)
* update DT and DF package references
* update to latest
* sync dev w/ main (#324)
* Update GH automation (#303)
* initial commit (#290)
* Revert "initial commit (#290)" (#314)
This reverts commit 3a2d193e57.
* Bump Azure.Identity from 1.7.0 to 1.10.2 in /samples/TokenCredentialDTFx (#323)
Bumps [Azure.Identity](https://github.com/Azure/azure-sdk-for-net) from 1.7.0 to 1.10.2.
- [Release notes](https://github.com/Azure/azure-sdk-for-net/releases)
- [Commits](https://github.com/Azure/azure-sdk-for-net/compare/Azure.Identity_1.7.0...Azure.Identity_1.10.2)
---
updated-dependencies:
- dependency-name: Azure.Identity
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
* Terminate partition when FASTER refuses to checkpoint for over a minute (#301)
---------
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: Varshitha Bachu <vabachu@microsoft.com>
Co-authored-by: Sebastian Burckhardt <sburckha@microsoft.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
---------
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: Sebastian Burckhardt <sburckha@microsoft.com>
Co-authored-by: David Justo <david.justo.1996@gmail.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Sebastian Burckhardt
Varshitha Bachu
David Justo
Jaliya Udagedara
Naiyuan Tian
dependabot[bot]
Chris Gillum