microsoft
/
FASTER
зеркало из https://github.com/microsoft/FASTER.git
1
0
Форкнуть 0
Код Задачи Пакеты Проекты Релизы Вики Активность
952 коммитов 267 Ветки 119 Теги 24 MiB
Граф коммитов

952 Коммитов

Автор SHA1 Сообщение Дата
darrenge eb4e976b10
Updated Microsoft.Extensions.* nuget packages for security compliance (#930) 
* Updated Microsoft.Extensions.* nuget packages in FixedLenServer sample and VarLenServer sample as they were out of compliance for security (dependency on System.Text.Json)

* Removed <PackageReference Include="System.Text.Json" Version="8.0.5" /> that was in there from earlier commit.
 2024-10-31 15:33:38 -07:00
darrenge a62a03625b
Updated system.text.json to ver 8.0.5 so it is compliant with security (#929) 
Co-authored-by: Badrish Chandramouli <badrishc@microsoft.com>
 2024-10-28 13:04:15 -07:00
dependabot[bot] 4ae0465c5c
Bump MessagePack from 2.4.35 to 2.5.187 in /cs/playground/AsyncStress (#927) 
Bumps [MessagePack](https://github.com/MessagePack-CSharp/MessagePack-CSharp) from 2.4.35 to 2.5.187.
- [Release notes](https://github.com/MessagePack-CSharp/MessagePack-CSharp/releases)
- [Changelog](https://github.com/MessagePack-CSharp/MessagePack-CSharp/blob/master/prepare_release.ps1)
- [Commits](https://github.com/MessagePack-CSharp/MessagePack-CSharp/compare/v2.4.35...v2.5.187)

---
updated-dependencies:
- dependency-name: MessagePack
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2024-10-28 12:51:28 -07:00
Badrish Chandramouli e25782f602
Fix flush with generic allocator so that we do not write invalid data to disk in rare cases (record was invalid when making initial image, but (#916) 2024-05-06 17:37:06 -07:00
Ted Hart e9e56ed422
Fix ContinuePendingRead to account for new records for the same key that were added and then went to dusk during the pending Read operation. (#911) 2024-04-16 08:03:10 -07:00
asolodov dc4bc1d556
[C#] Fix commit record pointer offset calculation (#912) 
Co-authored-by: Alexander Solodov <asolodov@b2broker.com>
 2024-04-16 07:43:02 -07:00
Stefan 281bdff595
use IsReferenceOrContainsReferences for .NET Standard 2.1+ and 6_0+ (#901) 2024-03-24 14:12:53 -07:00
Stefan 1111326423
Port the Unsafe.SizeOf Fixes from garnet (#900) 
* Port the Unsafe.SizeOf Fixes from garnet

* make static too
 2024-03-24 14:12:39 -07:00
Sebastian Burckhardt 657f3f52eb
Use Azure-Functions-compatible Microsoft.Extensions.Logging (#897) 
* modify version of Microsoft.Extensions.Logging to be 6.0.0 when building net6.0 target

* update FASTER.core.nuspec also
 2024-03-18 09:19:59 -07:00
xtqqczze a093e307ce
Remove unnecessary pinning from `UnmanagedMemoryManager` (#875) 
Co-authored-by: Badrish Chandramouli <badrishc@microsoft.com>
 2024-03-12 11:31:06 -07:00
Sebastian Burckhardt 2ed1d26929
allow reading v4 checkpoints with current version (#896) 2024-02-29 12:39:51 -08:00
Alan Yang 0116754bcf
Fix retry logic in LockableContext when trying to acquire a lock (#889) 
* Fix retry

* Fix retry logic

* Fix
 2023-11-09 17:36:33 -08:00
Badrish Chandramouli 8ba122e47b
Fix incorrect clearing of pool in BufferPool.cs 2023-10-16 11:43:44 -07:00
Ted Hart 63ba949947
[C#] BumpCurrentEpoch calling threads must be protected (#871) 
* - Ensure threads calling BumpCurrentEpoch are protected
- Back out change for shared bucket lock to wait for writer

* Move try/finally block for better inlining
 2023-09-06 22:03:34 -07:00
Ted Hart 32d04e6563
[C#] Replace LockingMode with ConcurrencyControlMode (#867) 
* Replace LockingMode with ConcurrencyControlMode

* Fix 'Remote' solution build
 2023-08-25 14:28:33 -07:00
Ted Hart 4d5412b14b
[C# ]Add TryLock and TryPromoteSharedToExclusive (#848) 
* Add Try(Promote)Lock

* Add drain of writer to HashBucket.TryLockShared
Clean up the latching spinCount loops and add "readonly" to "get" accessors in HashBucket and RecordInfo

* remove stray SetDirty (it's set later)

* Add UpsertOptions, RMWOptions, and DeleteOptions, all with KeyHash, and add overloads of these operations to take this argument. Add KeyHash to ReadOptions and add more Read overloads to include ReadOptions.

* LockCode => KeyHash

* Clean up more LockCode -> KeyHash; handle null pool in SectorAlignedMemory.Return

* Move GetKeyHash from ILockableContext to IFasterContext and implement on all session types
 2023-08-23 20:42:14 -07:00
Ted Hart 7e41e49a7f
- Fix InternalDelete elision from HashBucketEntry (set entire word to 0) (#866) 
- Fix iterators to jump ahead to BeginAddress if they're below it, rather than throw
- Remove unused HashBucketEntry.Pending
- Remove unnecessary ReadCacheEvictChain call in DetachAndReattachReadCacheChain
 2023-08-22 13:04:39 -07:00
Ted Hart 60e162f029
- Set both Sealed and Invalid on new records to ensure consistency both during normal operations and after recovery, which clears the Sealed bit. (#864) 
- Seal ConcurrentUpdater and InPlaceUpdater source records on successful RCU even when not doing Standard locking
 2023-08-17 13:11:16 -07:00
vazois b15e1cddaa
fix autorefresh for fastCommitMode (#863) 2023-08-16 17:23:16 -07:00
Ted Hart 50e3ac5b77
Fox Infomote loop on EmptyPageCount in CacheSizeTracker (#862) 
Make ConditionalCopyToTail check for headAddress if not doing I/O
 2023-08-15 11:36:48 -07:00
Badrish Chandramouli 3b35805b60
Store delta log tail address (#861) 
* Store delta log tail address

* fix + comment
 2023-08-10 11:55:16 -07:00
Badrish Chandramouli 5bee94bb38
Fix edge case for incremental snapshot (#858) 2023-08-02 18:11:09 -07:00
Ted Hart 29cf302e50
[C#] Fix missing Sunlock on nested CopyToTail lock (#857) 
* Fix missing Sunlock on nested CopyToTail lock

* Improve handling of Sealed records in Ephemeral locking

---------

Co-authored-by: Badrish Chandramouli <badrishc@microsoft.com>
 2023-08-02 16:47:31 -07:00
Badrish Chandramouli 44428dbf9f
Fix to delta log for recovery (#856) 
* Fix to delta log for recovery
* If we are in fast-commit, we may not write every metadata to disk. However, when we are deleting files on disk, we have to write metadata for the new start location on disk so we know where to scan forward from.
 2023-08-02 15:54:20 -07:00
Badrish Chandramouli 979beebe19
Handle out of memory during AllocatePage (#854) 
* Allocate exception should throw other allocation threads.

* undo

* nit

* fix
 2023-07-27 22:38:59 -07:00
Badrish Chandramouli b91cd52da2 Rename Dispose for network sender 2023-07-24 17:40:41 -07:00
Badrish Chandramouli 8cea74ec02 Make ThrottleMax configurable. 2023-07-19 15:09:18 -07:00
Badrish Chandramouli 33c4ffe27f
Use byte comparison for LockType instead of Enum.CompareTo which uses object. (#851) 2023-07-16 18:06:20 -07:00
Badrish Chandramouli ea6221daf3 GetLogFileSize should also check delta log for the latest metadata 2023-07-14 11:50:43 -07:00
Badrish Chandramouli 6217eafde3
Special case for RMW with NullDevice to avoid issuing IO below HeadAddress. (#850) 
Similar to what is already done for Read.
 2023-07-13 17:56:05 -07:00
Badrish Chandramouli 2025daa7f1 support remote endpoint in network sender 2023-07-12 14:10:42 -07:00
Badrish Chandramouli 110f9ebe54 fix unsubscribe 2023-07-06 11:18:56 -07:00
Badrish Chandramouli abc185062b
Allow option to write buffered, so data is not sector aligned. (#849) 
* Allow option to write buffered, so data is not sector aligned.

* fix test
 2023-07-06 10:10:26 -07:00
Badrish Chandramouli 5e262d85a5 fix unsubscribe 2023-07-04 13:57:38 -07:00
Chuntao Hong 336b5cfda7
fix typo (#847) 
* fix typo

* Update 25-fasterkv-recovery.md

---------

Co-authored-by: Badrish Chandramouli <badrishc@microsoft.com>
 2023-06-17 15:15:32 -07:00
Badrish Chandramouli 369d772cec
Support NoFlush in UnsafeShiftBeginAddress. (#846) 
* Support NoFlush in UnsafeShiftBeginAddress.

* updates

* Add SafeTailShiftCallback
Delay before waiting to avoid TCS creation if new enqueues happened

* Make sure we call BCE under epoch protection.

* updates

* updates
 2023-06-17 15:14:55 -07:00
Badrish Chandramouli d526e31264
UnsafeShiftBeginAddress (#845) 2023-06-09 18:52:58 -07:00
Badrish Chandramouli a2a9b06239
Throttle network sender (#844) 
* Throttle network sender

* Add NullNamedDeviceFactory

* UnsafeGetNextPageAddress

* update
 2023-06-05 15:51:27 -07:00
Badrish Chandramouli 3e09bf6f61 Revert "Add TryLock() to lockable contexts" 
This reverts commit 6e24390a67.
 2023-06-05 11:28:52 -07:00
microsoft-github-policy-service[bot] 1c191323ad
Microsoft mandatory file (#842) 
Co-authored-by: microsoft-github-policy-service[bot] <77245923+microsoft-github-policy-service[bot]@users.noreply.github.com>
Co-authored-by: Badrish Chandramouli <badrishc@microsoft.com>
 2023-06-04 13:34:52 -07:00
TedHartMS 6e24390a67 Add TryLock() to lockable contexts 2023-06-02 19:25:54 -07:00
Badrish Chandramouli 77296d9a42
Rethrow exception in SendResponse (#841) 2023-06-02 11:47:50 -07:00
Badrish Chandramouli 0e03937e1f
Ckpt size retrieval logic fix (#838) 
* Add

* updates

* updates

* AzureStorageDevice read unloaded blob

* update
 2023-05-31 19:00:22 -07:00
Ted Hart 73fe128475
add Delete to YCSB Benchmark; change "-r read%" to "-rumd read% upsert% rmw% delete%" (#839) 2023-05-31 12:18:26 -07:00
Badrish Chandramouli 7d5d5ff583
Unsafe API to access fasterlog internals (#837) 
* Unsafe API to access fasterlog internals

* updates
 2023-05-24 19:34:09 -07:00
Badrish Chandramouli d6c3a82503 Expand FasterLog Initialize API 2023-05-18 16:07:12 -07:00
Badrish Chandramouli 3450702766 Make sure version switch is called for some checkpoint types 2023-05-17 18:38:32 -07:00
Badrish Chandramouli 8da1898f11
Increase refCache size for Memory based API (#833) 
* add single writer test

* Add user provided repro in playground.

* add user provided test
fix refCache size

* update testcase
 2023-05-06 18:16:22 -07:00
Badrish Chandramouli cb04d94e4e
Update 40-fasterlog-basics.md 2023-05-06 17:47:17 -07:00
Badrish Chandramouli 6428fb782d
FasterLog and device reset (#830) 
* Make version shift virtual

* Add Reset API to FasterLog

* fix device reset

* fix device
 2023-05-06 15:55:35 -07:00