f2a3fd0c13
version to 2.1.0 ( #436 )
2024-10-31 09:36:04 -07:00
68fb3e7abf
Implement detection and potential mitigation of recovery failure cycles ( #435 )
...
* implement detection of repeated recovery failures, and add triggers to boost tracing and disable prefetch during replay
* add comments as per PR feedback
* fix the disabling of prefetch, make more readable, improve tracing
* disable prefetch on every other attempt only, to make sure we are not permanently breaking anything
2024-10-31 09:34:26 -07:00
c9a0b7307a
fix missing ProcessPartitionEventAsync handler ( #432 )
2024-10-22 15:20:36 -07:00
40f722b7ce
Add automated release pipeline ( #429 )
2024-10-16 15:56:03 -07:00
4f17e74cac
Bump axios in /samples/Hello_Netherite_with_TypeScript ( #422 )
...
Bumps [axios](https://github.com/axios/axios ) from 1.6.7 to 1.7.7.
- [Release notes](https://github.com/axios/axios/releases )
- [Changelog](https://github.com/axios/axios/blob/v1.x/CHANGELOG.md )
- [Commits](https://github.com/axios/axios/compare/v1.6.7...v1.7.7 )
---
updated-dependencies:
- dependency-name: axios
dependency-type: indirect
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-10-02 14:27:51 -07:00
acb09ba7f3
add a configuration parameter for specifying the task hub parameters file ( #424 )
2024-10-02 14:27:11 -07:00
d00a2c60e2
increase major version (2.0.0) and update packages ( #425 )
...
* update to 2.0.0, remove netcoreapp2.2 target, update all package versions
* fix unit test that was broken because of xunit API change
* fix API change for blob bindings in PerformanceTests
* back out two of the major version changes
* revise solution
2024-10-02 14:24:57 -07:00
55045a2bd3
Debug hangs in CI ( #423 )
...
* revise checkpoint injection state machine and add tracing
* do not include timer tests in concurrent test scenario since timing is inherently nondeterministic
* fix version checking in CacheDebugger and FasterKV, to avoid false alarms that trip our unit tests
* improve text in error message
* address PR feedback (update comment)
2024-10-02 11:00:05 -07:00
6e10bdff2d
Update to latest event hubs client SDK ( #385 )
...
* update to latest event hubs client SDK.
* minor editing and renaming, catch startup cancellation, and ignore cancellation exceptions after cancellation
* address PR feedback
* Apply suggestions from code review
Co-authored-by: David Justo <david.justo.1996@gmail.com>
* optimization: cancel the wait when shutting down
* avoid race when opening partitions that are canceled immediately
* add test timeouts and fix handling of instant cancellation
* better logging of exceptions in partition shutdown
* adding more timeouts
* suggestion from PR review
Co-authored-by: David Justo <david.justo.1996@gmail.com>
* add more timeout wrappers
* remove dead code
* undo addition of redundant, coarse timeouts for tests that already have timeouts with nontrivial duration
* simplify code that seemed to be hanging in unit tests
* add statements to print progress to some of the unit tests, to facilitate analysis of hangs in CI
---------
Co-authored-by: David Justo <david.justo.1996@gmail.com>
2024-09-26 11:16:08 -07:00
2fd17d0272
Add codeQL GH action ( #414 )
2024-08-01 09:50:25 -07:00
f34dea3a4a
add readme and official build codeql ( #413 )
2024-08-01 08:17:56 -07:00
8e10bc85b2
add source link reconstruction ( #412 )
2024-07-31 10:54:04 -07:00
243a0695ed
rev to 1.5.4 ( #411 )
2024-07-29 11:52:21 -07:00
6e8f8a9b41
Implement defensive measure against compaction loops ( #409 )
...
* defensive measure against compaction loops
* add comments explaining compaction, and generate a more visible warning when compaction is ineffective.
2024-07-29 09:34:50 -07:00
ac1c2b2690
Clear cached exception when StartAsync is invoked ( #376 )
...
Co-authored-by: sebastianburckhardt <sburckha@microsoft.com>
2024-07-29 09:07:51 -07:00
3a73ae47d7
Bump Azure.Identity in /samples/TokenCredentialDTFx ( #403 )
...
Bumps [Azure.Identity](https://github.com/Azure/azure-sdk-for-net ) from 1.11.0 to 1.11.4.
- [Release notes](https://github.com/Azure/azure-sdk-for-net/releases )
- [Commits](https://github.com/Azure/azure-sdk-for-net/compare/Azure.Identity_1.11.0...Azure.Identity_1.11.4 )
---
updated-dependencies:
- dependency-name: Azure.Identity
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-07-26 14:50:40 -07:00
16fcd9b8b5
use CompactionType.Lookup instead of CompactionType.Scan ( #408 )
2024-07-26 08:59:18 -07:00
876d7f951d
fix build break by suppressing tfm build warnings ( #400 )
2024-07-23 14:38:24 -07:00
faded8c273
Migrate to 1ES pipelines ( #404 )
...
This PR migrates the pipelines to 1ES pipelines. It adds 2 files - official-build.yml and build.yml. official-build.yml references build.yml and runs on any changes pushed to the main branch.
2024-06-18 12:27:02 -07:00
8e23f3dd34
Make UnambiguousNetheriteProviderFactory constructor public ( #402 )
2024-06-06 07:26:02 -07:00
928f933a40
disambiguate Netherite constructor ( #401 )
2024-06-05 13:10:51 -07:00
6ee62e3f27
Complete FASTER sessions before releasing them during query processing ( #397 )
2024-06-04 23:30:57 -07:00
f3e5f2621f
Add code mirror pipeline ( #399 )
...
* add code mirror pipeline
* move within eng/ci as per convention
2024-05-30 16:41:36 -07:00
122885a5f8
Add initial integration tests for Durable Entities. ( #391 )
2024-05-30 15:52:22 -07:00
51c6b957c7
Auto-generate AssemblyInfo + refactor version into common props. ( #393 )
2024-05-09 15:19:36 -07:00
aa124cdf50
rev FASTER.Core to 2.6.5 ( #395 )
2024-05-07 16:30:59 -07:00
beb84a0a7c
Cleanup unnecessary references. ( #388 )
2024-05-03 16:31:10 -07:00
f8b5634746
Update Durable Dependencies to Latest Version ( #389 )
...
* Update DurableTask.Netherite.AzureFunctions.csproj
* increase durabletask extension ver and patch
* incre durabletask.core ver
* remove typo
2024-04-30 13:49:52 -07:00
24efd5478d
Add support for isolated entities ( #358 )
2024-04-26 09:31:15 -07:00
7ca60baec2
update to v1.5.0 ( #386 )
2024-04-22 14:43:44 -07:00
687071326d
Upgrade FASTER dependency to v2.6.4 ( #344 )
...
* initial commit
* added comment
* added readCopyOptions
* addressed PR feedback
* updated CheckpointVersionShift()
* updated Netherite version
* Update src/DurableTask.Netherite/StorageLayer/Faster/FasterStorageProvider.cs
* Update src/DurableTask.Netherite/DurableTask.Netherite.csproj
* update to FASTER v2.6.3
* update to FASTER 2.6.4
---------
Co-authored-by: Sebastian Burckhardt <sburckha@microsoft.com>
2024-04-22 14:43:30 -07:00
40a1f8c68f
Deduplicate CreationRequestReceived events ( #381 )
...
* always deduplicate CreationRequestReceived events
* Update src/DurableTask.Netherite/PartitionState/InstanceState.cs
Co-authored-by: David Justo <david.justo.1996@gmail.com>
---------
Co-authored-by: David Justo <david.justo.1996@gmail.com>
2024-04-22 13:07:27 -07:00
7e52cbe912
go back to version 1.4.3 for a patch release ( #382 )
2024-04-17 09:35:56 -07:00
a582ca576e
Make adjustments and add tracing ( #374 )
...
* adjust based on observations in stress testing, and add more tracing to FASTER callbacks
* another trace line
2024-04-16 11:26:56 -07:00
ab706eb79e
Fix blob batch persistence ( #369 )
...
* draft
* fix handling of batchposition, and tolerate race condition for deleted blob
* address PR feedback
* fix incorrect handling of skipped events
* fix check that removes confirmed events and add detail-level tracing
* fix broken trace statement
* fix handling of blob deleted
* add more tracing to blob download
* do not process any more events if already shutting down
* address PR feedback (add comments)
* fix handling of missing blobs
* Update src/DurableTask.Netherite/TransportLayer/EventHubs/BlobBatchReceiver.cs
Co-authored-by: David Justo <david.justo.1996@gmail.com>
---------
Co-authored-by: David Justo <david.justo.1996@gmail.com>
2024-04-16 11:24:38 -07:00
96b3ca5e97
Ignore duplicate client requests ( #379 )
...
* filter duplicate client requests
* Update src/DurableTask.Netherite/PartitionState/PrefetchState.cs
Co-authored-by: David Justo <david.justo.1996@gmail.com>
* fix whitespace
* address PR feedback: add warning when event is dropped
---------
Co-authored-by: David Justo <david.justo.1996@gmail.com>
2024-04-16 09:38:11 -07:00
2f94e765d5
fix race condition on OrchestrationRuntimeState.NewEvents ( #380 )
...
* fix race condition on mutable list of new events inside OrchestrationRuntimeState.
* Apply suggestions from code review
Co-authored-by: David Justo <david.justo.1996@gmail.com>
---------
Co-authored-by: David Justo <david.justo.1996@gmail.com>
2024-04-15 11:29:07 -07:00
b885bd4a8c
Bump undici in /samples/Hello_Netherite_with_TypeScript ( #373 )
...
Bumps [undici](https://github.com/nodejs/undici ) from 5.28.3 to 5.28.4.
- [Release notes](https://github.com/nodejs/undici/releases )
- [Commits](https://github.com/nodejs/undici/compare/v5.28.3...v5.28.4 )
---
updated-dependencies:
- dependency-name: undici
dependency-type: indirect
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-04-12 11:34:24 -07:00
86d36a16f4
Bump Azure.Identity in /samples/TokenCredentialDTFx ( #378 )
...
Bumps [Azure.Identity](https://github.com/Azure/azure-sdk-for-net ) from 1.10.4 to 1.11.0.
- [Release notes](https://github.com/Azure/azure-sdk-for-net/releases )
- [Commits](https://github.com/Azure/azure-sdk-for-net/compare/Azure.Identity_1.10.4...Azure.Identity_1.11.0 )
---
updated-dependencies:
- dependency-name: Azure.Identity
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-04-12 11:34:11 -07:00
5a2fdc3e38
Use OrchestrationAlreadyExistsException instead of InvalidOperationException ( #375 )
2024-04-05 14:46:11 -07:00
3399888400
update version to 1.5.0 ( #368 )
2024-03-18 16:26:11 -07:00
0c1ccbec4a
Add variable-sized generic entity benchmark ( #366 )
...
* add a store entity to the performance benchmarks, for testing
* update http triggers
2024-03-18 15:41:46 -07:00
a72a1abdba
Bump follow-redirects in /samples/Hello_Netherite_with_TypeScript ( #367 )
...
Bumps [follow-redirects](https://github.com/follow-redirects/follow-redirects ) from 1.15.5 to 1.15.6.
- [Release notes](https://github.com/follow-redirects/follow-redirects/releases )
- [Commits](https://github.com/follow-redirects/follow-redirects/compare/v1.15.5...v1.15.6 )
---
updated-dependencies:
- dependency-name: follow-redirects
dependency-type: indirect
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-03-18 09:54:38 -07:00
84b45a89b2
add README.md and some historic results to the performance tests folder ( #362 )
2024-03-18 09:49:40 -07:00
7e16a84d12
Improve error handling for FASTER IO completion callbacks ( #349 )
...
* wrap FASTER callbacks so exceptions are logged, and release semaphores prior to callback.
* address PR feedback, add two more lines of tracing, and use simpler trace message
* refactor control path for FASTER callbacks. Eliminate callbacks with nonzero error code.
* immediately cancel all requests waiting for the semaphore when partition is terminated
* cancel faster callbacks prior to disposing FasterKV and FasterLog (to prevent hangs)
* revert reorganization of cancellation since it appears to lead to issues with hanging dispose calls
2024-03-18 09:49:13 -07:00
a74178bc6b
loosen azure storage semaphores ( #365 )
2024-03-18 09:48:09 -07:00
d71a5a1ba8
Fix hanging blob creation ( #351 ) ( #364 )
...
* fix hanging blob creation
* remove unnecessary try-catch
2024-03-15 13:21:42 -07:00
a6924c01dd
handle long or infinite timeout argument in WaitForOrchestrationAsync ( #357 )
2024-03-15 12:59:34 -07:00
37f49adde5
Add RecoveryTester feature ( #341 )
...
* refactor partition management options, remove Scripted partition manager, and add RecoveryTester feature
* prevent creation of fresh taskhub in partition recovery mode
2024-03-15 12:57:01 -07:00
230ada9c11
Bump the npm_and_yarn group group ( #360 )
...
Bumps the npm_and_yarn group group in /samples/Hello_Netherite_with_TypeScript with 2 updates: [durable-functions](https://github.com/Azure/azure-functions-durable-js ) and [axios](https://github.com/axios/axios ).
Updates `durable-functions` from 1.5.4 to 3.1.0
- [Release notes](https://github.com/Azure/azure-functions-durable-js/releases )
- [Changelog](https://github.com/Azure/azure-functions-durable-js/blob/v3.x/azure-pipelines-release.yml )
- [Commits](https://github.com/Azure/azure-functions-durable-js/compare/1.5.4...v3.1.0 )
Updates `axios` from 0.21.4 to 1.6.7
- [Release notes](https://github.com/axios/axios/releases )
- [Changelog](https://github.com/axios/axios/blob/v1.x/CHANGELOG.md )
- [Commits](https://github.com/axios/axios/compare/v0.21.4...v1.6.7 )
---
updated-dependencies:
- dependency-name: durable-functions
dependency-type: direct:production
dependency-group: npm_and_yarn-security-group
- dependency-name: axios
dependency-type: indirect
dependency-group: npm_and_yarn-security-group
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-03-05 10:00:54 -08:00
Sebastian Burckhardt
David Justo
dependabot[bot]
Varshitha Bachu
Jaliya Udagedara
Naiyuan Tian
Chris Gillum