Граф коммитов

395 Коммитов

Автор SHA1 Сообщение Дата
Sebastian Burckhardt c5aefce2ef
fix race on index data structure caused by locking wrong object (#219) 2023-01-24 13:29:57 -08:00
Sebastian Burckhardt a6034f6ced
udpate deployment scripts (#217) 2023-01-23 11:48:58 -08:00
Jacob Viau 2edfb61432
Fix Az Func dotnet-isolated extension (#216) 2023-01-19 13:04:11 -08:00
Jacob Viau b675ec383f
Add Functions isolated extension package (#212) 2023-01-12 16:24:30 -08:00
sebastianburckhardt 473fd63fe7 update samples 2023-01-03 13:34:59 -08:00
sebastianburckhardt 1f3dc4b557 fix release pipeline 2023-01-03 10:58:18 -08:00
sebastianburckhardt bbea3b589d fix release pipeline 2023-01-03 10:04:26 -08:00
sebastianburckhardt 211affcfee try to fix release pipeline 2023-01-03 09:36:13 -08:00
sebastianburckhardt c286b76c1e edit release pipeline 2023-01-03 09:25:50 -08:00
Sebastian Burckhardt dfbd27413a
retry blob deletion when taskhubs are deleted. (#211) 2022-12-20 13:45:33 -08:00
dependabot[bot] 5bf6a5e198
Bump Azure.Storage.Blobs in /src/DurableTask.Netherite (#210)
Bumps [Azure.Storage.Blobs](https://github.com/Azure/azure-sdk-for-net) from 12.10.0 to 12.13.0.
- [Release notes](https://github.com/Azure/azure-sdk-for-net/releases)
- [Commits](https://github.com/Azure/azure-sdk-for-net/compare/Azure.Storage.Blobs_12.10.0...Azure.Storage.Blobs_12.13.0)

---
updated-dependencies:
- dependency-name: Azure.Storage.Blobs
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-12-20 13:45:14 -08:00
sebastianburckhardt 01c4862415 Merge branch 'dev' 2022-12-20 09:26:27 -08:00
sebastianburckhardt be1c079000 update versions to 1.3.0 2022-12-20 09:22:25 -08:00
Sebastian Burckhardt 4818acff14
Move Faster to v12 blob SDK, and implement e-tag protection to fix data corruption bug (#208)
* remove psf code and move faster to v12 storage sdk

* implement e-tag protection for AzureStorageDevice page blob writes

* reduce hang timeouts caused by asynchronous execution of storage access completions

* implement e-tag checking on checkpoints file

* two more updates to ContinueWith

* allow e-tags to be reestablished on precondition fail, to deal with self-conflicts under retries

* fix check for precondition failure to include already-existing blob

* make memory control stay steady if actual empty page count is lagging behind the empty page count control

* undo last change, fix tolerance in test instead
2022-12-19 15:07:14 -08:00
Sebastian Burckhardt 5c61ddaa35
fix bugs in deployment scripts (#209) 2022-12-15 15:51:00 -08:00
Sebastian Burckhardt 7079232c57
Validate partition table name on consumption plan (#207)
* disable the use of blob publishing (tablename null) on consumption plan

* update blob publisher to use the right directories, fix null checks of table name to null or empty checks

* fix log level for LoadMonitor
2022-12-14 13:42:49 -08:00
Sebastian Burckhardt 2f03f54759
update deployment scripts for consumption plan (#204)
* update deployment script to include consumption plan, and add a consumption series

* fix run-scalemonitor.ps1
2022-12-09 08:12:09 -08:00
Sebastian Burckhardt b910e0e343
fix corner case for cache size reporting (#203) 2022-12-08 13:54:24 -08:00
dependabot[bot] 112638602c
Bump Newtonsoft.Json from 13.0.1 to 13.0.2 in /test/LoadGeneratorApp (#205)
Bumps [Newtonsoft.Json](https://github.com/JamesNK/Newtonsoft.Json) from 13.0.1 to 13.0.2.
- [Release notes](https://github.com/JamesNK/Newtonsoft.Json/releases)
- [Commits](https://github.com/JamesNK/Newtonsoft.Json/compare/13.0.1...13.0.2)

---
updated-dependencies:
- dependency-name: Newtonsoft.Json
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-12-08 13:54:06 -08:00
Sebastian Burckhardt bd0a5d8228
update benchmarks for corpus connection, periodic test (#206) 2022-12-08 13:53:40 -08:00
Sebastian Burckhardt 6ea05fe748
fix frequent query timeouts by correctly stopping page collection when time is about to run out (#202) 2022-12-06 07:43:02 -08:00
David Justo a292d0fddb
Change MemoryF to SingleHost in samples (#200)
* change MemoryF to SingleHost in samples

* update Netherite version in samples

Co-authored-by: Sebastian Burckhardt <sburckha@microsoft.com>
2022-11-17 14:47:16 -08:00
Sebastian Burckhardt 7350b1c120 update version to 1.2.0 2022-11-17 10:54:04 -08:00
Sebastian Burckhardt 029991890d
Revise queries implementation (#201)
* intermediate commit

* updates

* fix client path configure await

* fix query implementation of in-memory emulator
2022-11-16 16:56:05 -08:00
Sebastian Burckhardt ed721c67f0
Add support for authentication using an Azure.Core.TokenCredential (#197)
* support authentication using token credentials.

* address PR feedback

* use overload instead of optional argument to be compatible without requiring recompilation

* address PR feedback

* address PR feedback
2022-11-09 07:44:29 -08:00
Sebastian Burckhardt cf1e345881
Update to latest Azure Storage Tables client (#195)
* update to latest Azure Storage Tables client

* Apply suggestions from code review

Co-authored-by: Jacob Viau <javia@microsoft.com>

* use fail-fast when parsing records, add unit tests, and fix a number of bugs

* Add some .ConfigureAwait(false) to AzureBlobLoadPublisher

* address PR feedback.

Co-authored-by: Jacob Viau <javia@microsoft.com>
2022-10-12 15:29:40 -07:00
Sebastian Burckhardt 0333d908f0
support implicit state deletion (#192)
* support implicit state deletion for deleted entities

* update packages
2022-09-28 14:16:53 -07:00
Sebastian Burckhardt a69551ab27
Overhaul internal layers and single-host emulation (#194)
* temp commit

* fix stuff

* update retry logic

* update tests

* rename providers to layers

* add display names for pipeline stages

* minor updates to comments and remove unnecessary usings

* temporarily disable the size checking

* edit and reorder CI pipeline for troubleshooting

* do not run replay checker on the default host fixture

* more tinkering with order of tasks in CI pipeline

* update test projects to latest runtime and packages

* remove replay checker from in-memory tests since it does not actually run anyway

* temporarily remove ConcurrentTestsFaster.EachScenarioOnce since it has demonstrated hanging

* update pipeline durations

* reenable EachScenarioOnce with fixes

* remove excessive tests
2022-09-28 13:14:01 -07:00
Sebastian Burckhardt 6130f04574
add taskhub name validation (#193) 2022-08-22 09:06:18 -07:00
Sebastian Burckhardt 38b75d791f
Update tooling to latest Functions version (#190)
* Update tooling for Hello samples

* update tooling in load generator and performance tests

* remove unneded dependency on Microsoft.Azure.Functions.Extensions

* harden unit test logger
2022-08-16 11:32:21 -07:00
Sebastian Burckhardt dfac505ddd
send load information periodically even if not currently solicited. (#187) 2022-08-11 08:19:29 -07:00
Sebastian Burckhardt 214780d51c
update Netherite version to 1.1.1 in all samples (#189) 2022-08-10 09:16:49 -07:00
Sebastian Burckhardt d0a80ba87a update to patch 1.1.1 2022-08-05 14:32:57 -07:00
Surgupta e4340f6388
Updating NetheriteProviderStartup to implement IWebJobsStartup (#186) 2022-08-05 14:15:27 -07:00
Sebastian Burckhardt 1215e63476
Update README.md
add 64bit requirement to the REAME.md text file
2022-08-04 08:30:49 -07:00
Sebastian Burckhardt ea5045b5f3
Update the samples to use 1.1.0 release. (#185) 2022-08-02 13:14:49 -07:00
microsoft-github-policy-service[bot] 5b56d3f2b3
Microsoft mandatory file (#183)
Co-authored-by: microsoft-github-policy-service[bot] <77245923+microsoft-github-policy-service[bot]@users.noreply.github.com>
2022-08-02 12:29:33 -07:00
Sebastian Burckhardt 8035973484 Merge branch 'dev'
# Conflicts:
#	src/DurableTask.Netherite/DurableTask.Netherite.csproj
2022-08-02 11:50:51 -07:00
Sebastian Burckhardt e79329f2a3 update version to 1.1.0 2022-08-02 11:45:24 -07:00
Sebastian Burckhardt ce7727c230
no message (#181) 2022-08-02 10:22:20 -07:00
Sebastian Burckhardt fd878e96ab
Add a sample for running an orchestration with DTFx. (#180)
* Add a sample for running an orchestration with DTFx.
* update validation of settings to be more comprehensive and useful in a DTFx context
2022-07-26 09:46:05 -07:00
Sebastian Burckhardt 113fc4addc
Remove obsolete uses of ConnectionStringResolver (#171)
* replace obsolete resolver type.

* remove unnecessary usings

* undo changes due to mysterious CI failures, instead just disable warnings
2022-07-25 13:55:46 -07:00
Sebastian Burckhardt 673dd6a96c
Fix io notification (#179)
* fix completePendingAsync mechanism and add memory stats to cache size measure event

* force garbage collection after compaction and checkpoints
2022-07-18 13:26:29 -07:00
dependabot[bot] e4ec226aaf
Bump Newtonsoft.Json from 12.0.3 to 13.0.1 in /src/DurableTask.Netherite (#177)
Bumps [Newtonsoft.Json](https://github.com/JamesNK/Newtonsoft.Json) from 12.0.3 to 13.0.1.
- [Release notes](https://github.com/JamesNK/Newtonsoft.Json/releases)
- [Commits](https://github.com/JamesNK/Newtonsoft.Json/compare/12.0.3...13.0.1)

---
updated-dependencies:
- dependency-name: Newtonsoft.Json
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-06-23 09:41:07 -07:00
Sebastian Burckhardt dda5c86ae0
Measure cache size periodically (#170)
* improve precision of CacheDebugger and periodically recompute cache size

* revert temporary workaround

* fix merge error.
2022-06-21 15:57:42 -07:00
Sebastian Burckhardt 01fa680f46
remove serialization cache since benefit is unclear and it wastes memory (#173) 2022-06-21 13:49:55 -07:00
Sebastian Burckhardt 0fa3f4b100
update packages (#175) 2022-06-21 12:21:49 -07:00
Sebastian Burckhardt 76fe0bfff4
fix cachesize test (#172)
* fix cache size test to be aware of keys not found in memory

* weaken the test since there are many false positives
2022-06-21 11:40:52 -07:00
Sebastian Burckhardt e52e236df6
add support for specialized purge interface DurableTask.Core.IOrchestrationServicePurgeClient (#167) 2022-06-13 08:28:22 -07:00
Sebastian Burckhardt c8cc1ff24c
set the default for MaxEntityOperationBatchSize in NetheriteProviderFactory, based on plan (#165) 2022-05-27 11:56:02 -07:00