* Removing dead code from $import
* Remove progress and rebuld indexes
* var
* No use of progress
* Removed progress again
* Removing call to heavy heartbeats
* Remove test relying on heavy heartbeats
* removed usage of heavy heartbeats
* Removed progress from IJob
* removed progress more
* tests
* removed obsolete comment
* Removed obsolete fields.
* write back to be on par
* json convert
* removed obsolete properties
* Removed disable indexes from the docs
* more changes in import doc
* Added bundle update method
* Bundles
* Add System.IdentityModel.Tokens.Jwt package and update BearerTokenHandler to print claims from JWT token
* Writing output bundles
* - sleep 40
* Added sync Send to BearerTokenHandler for Import Tool
* blob rewriter
* threads*threads
* .json
* Added deduplication for "single" types
* multiple
* short exe names
* direct bundles
* Removed order by
* full names back
* short on one
* write mixed ndjson
* Fix codeql in bearer token handler
* code an changes
* Fix codeql
* SearchByIds
* correction in searchbyids
* count in correct place
---------
Co-authored-by: Mikael Weaver <mikaelw@microsoft.com>
* Change SqlServerFhirModel to use FhirMemoryCache
* Improvements in FhirMemoryCache.
* Added support to multi case cache.
* Test improvements.
* New tests. Removing lock to be aligned with the MemoryCache.
* Added trx logging and test publishing
* Fixed test reporting path
* changed to vstest
* rollback build change
* Fixed newline issue
* Fixed export tests to use VSTest
* Changed over last dotnet test
* Fixed export tests
* pipeline test fix
* formatting fix
* Fixed test filter typo
* pinning vstest to fix issue
* trying different version of vstest
* Testing batch size to fix data test issues
* Testing custom batch size fix
* removed vstest batching
* Testing changing the TestClassWithFixtureArgumentsTypeInfo name
* testing blame timeout
* Testing new blame params
* Changing SQL exception number
* Removed restriction for testing message only in Win
* Added publishing of test files on failure on error to help debugging
* Updated upload test failure task
* Fixed integration test artifact name
* Added fix for sql test
* Fox normalize in SqlServerSchemaUpgradeTests
* Fixed SQL int test newline integration
* Updated dump type / timeout for tests
* Reduced blame back down to 7
* Added pool name to windows jobs
* Changing to correct windows pool
* Removing dead code from $import
* Remove progress and rebuld indexes
* var
* No use of progress
* Removed progress again
* Removing call to heavy heartbeats
* Remove test relying on heavy heartbeats
* removed usage of heavy heartbeats
* Removed progress from IJob
* removed progress more
* tests
* removed obsolete comment
* Removed obsolete fields.
* write back to be on par
* json convert
* removed obsolete properties
* Removed disable indexes from the docs
* more changes in import doc
* Adding new logs
* Log improvements.
* Extending new logs to ImportOrchestratorJob
* Improving tests
* More log details
* Adding more details
* Undo Global.json
* More changes expanding the use of the new logging logic.
* Added missing log.
* Improving the logs in Job Hosting.
* Adjusts to fix errors after merge with main.
* Clean config file.
Bundle orchestrator improvements.
* Logging to conditional updates
* Adding more logs to conditional operations
* Added new tests to test the issue with MergeAsync and multiple versions being updated in parallel
* Improve the new test adding more asserts to it.
* Add espace condition in BundleOrchestratorOperation's looping
* New tests and comments
* Increase SQLClient version to v4.8.6
* Enable tests to more scenarios. Fix typo.
* Removed not used local variable in test
* Updating the external cancellation timeout of a test.
* checkpoint for export with lastModified count
* Reduced scope to parallelization by resource.
* Added tests for cosmos export orchestrator
* checkpoint to move my code to another machine
* Fixed cosmostdb export integration test expected values
* Added sharding to CosmosDB export
* Revised grouping for export
* small bug fix/enhancements
* bug fixes found during testing
* Rolled back ExecutePagedQueryAsync
* Updated export query to use limit and count
* Fixed logic for continuing export in thread
* Fixed export bugs
* Updated time incrementing logic to milliseconds
* Simplifed range lookup
* Moved large async export search logic to search service
* Use HasValue vs is null for CosmosExportOrch
* Export largest resource counts first
* Modified export to use feedrange
* Fixed tests
* Fixed tests
* small simplification on cosmos orch
* Added initial logic for Cosmos history/delete in $export
* Fixed build issue with SQL export orchestrator
* Fixed cosmos export bugs found via manual testing
* Added soft delete extension to export
* Add first pass on Export E2E Tests
* Updated export E2E tests to use test data from fixture.
* Updated long export tests for individual history/delete scenarios
* Updated gitignore to ignore azurite temp files
* Small azure storage explorer / azurite comment update for export tests
* Fixed ExportJobTaskTests to not rely on position of queryParameterList
* Added ExportJobTask unit test for history/delete
Also cleaned up some left over comments from previous commit
* Removing changed settings.json file
* Added historical and soft delete export to rest file
* Added import of soft deleted resources
* Updates per PR review
* Removed import changes - going to another PR
* Removed launch.json changes accidentally committed
* Added initial SQL export with soft delete / history
* oopsies undo change to importresourceprocessor breaking tests
* Fixed logical error in new SQL historical search
* Added searchoptionsfactory test for include history/deleted
* Fixed failing export test failure.
* Removed long running export flag to see if it runs in pipeline
* restructured export test location for readability
* Fixed export issues found in testing
* Changed SQL script version for merge
* Updated SQL schema version
* Code style cleanup
* Updated export history/deleted query params
* Fixed export included data test
* Changed SQL exporter to use export configuration vs magic numbers in code
* Rolling back unneeded SQL changes
* Fixed parallel export with history/soft delete
* Updated export E2E tests for parallel export multi-job
* fixed merge regression
* Removed unnecesary usings
* Fixed tx issue in export data tests
* testing central export perf
* Rolled back central execution of export tests
* Removing exportlongrunning for pipeline perf test
* Fixed build
* Optimized test structure
* merged from main
* Updated schema version to iterate after merge
* Fixed issue with merge
* Fixed export create call
* decoupled search options from export
* Fixed test issue
* Removing NA SQL comment
* PR comments on tests fix
* "un-fancified" ResourceTypeVersion enum
* Fix STU3 build error
* Fixed unit tests that no longer use export/history query params
* fixed test mistake for resourcetypeversion
* Fixed cosmos export search functoin
* Fixed export includeAssociatedData error message
* Default ResourceVersionType to latest
* Fixed history search - added deleted
* fix export count issue?
* small code cleanups
* fixed merge issue
* Fixed logic stopping from parallel jobs being enqueued
* Fixed parallelization issue
* testing w/o job dup logic
* Added cosmosdb parallel back
* Handle canceled cosmos export issues
* Fixed cosmos export cancel issues
* Fixed for job not completing 100%
* fixed logic to queue new cosmos jobs
* omg I can't believe I missed this
* Added proper handling of cosmos task canceled exceptions
* Fixed cancel retry
* Test cancel export ignore etag
* Added job task tests
* Added export processing job tests
* Updated tests
* Fixed cosmos orchestrator unit tests
* Review improvements
* Fix small isues with cosmosdb export integration tests
* test simplification
* changes from feedback
* undo test changes that aren't needed
* undo spacing changes to resx file
* PR review changes
* undo whitespace changes
* cleanup
* Fixed new export bug
* Used scope search service for Cosmos parallel export
* Split cancelled tests via theory
* Fixed cosmos export int tests
* fixed bad test
* small changes from PR
* Secondary indexes
* Update to allow *:* _revinclude search
* Remove IsHistory filter from reference table WHERE clause
* 73
* removed ResourceType expansion and isHistory for global searches
* fix lines after merge
* ref index
* changed GivenACrossSystemQuery_WhenRewritten_GetsAllResourceTypes(
* reverted generator changes
* 27 -> 3
* temp disable _rev
* _rev back
* Skip wring history clause for search params
* sql client
* Stop resource type expansion
* resource type expansion is back
* View access
* transactions and unit test code
* Commented test script
* Extra IsHistory
* comment
---------
Co-authored-by: Jared Erwin <jaerwin@microsoft.com>
Co-authored-by: rajithaaluri <rajithaaluri@microsoft.com>
* Removed offset
* Updated System.Data.SqlClient
* test cleanup
* Updated test to explicitly read datetime from server
* Added output string to flaky test
* simplified code
* Testing using before with since
* Updated text output so it's not truncated
* adding thread.sleep
* Extending queries to use max concurrency parallelism
* Add new Action Filter for Query Latency Over Efficiency
* Adding new tests to ensure that FhirController has the expected attributes. Adding more tests on top of the new filter. Limiting the execution of the filter to Azure API for FHIR only.
* Make $import parser work with \n line ends
* comment
* Removed batching
* removed new buffer
* static methods and tests
* Do not return empty lines
* corrected spelling
* Removed skip empty line logic and removed "incorrect" test
* extra test plus skip empty
* Added count for all history
* Added necessary extra tests
* Added E2E Test
* Addressed PR comments
* Fixed E2E Tests
* fix test build issue
* Fixed test name
* Updated tests
* Fixed test issue
* Fix test date/time format
* Fixed SQL Search Service deleted history
* Added testing for SQL query generation of history/soft delete
* Removed SqlSearchType as it was redundant
* Added test case for history and soft deleted without latest
* changed invalidurl exception status code to 400 insteadof 500
* Added Validation Filter for ResourceType and Id.
Removed Argumentnull exception block from OperationoutcomeExceptionFilterAttribute class
* Validation added to few other scenarios
* Added unit test case for Filete validation and rename filter attribute to ValidateIdSegmentAttribute
* E2E for VRead BadRequest
* reverting test
* decorated newly added test case class with Trait attribute
---------
Co-authored-by: rajithaaluri <rajithaaluri@microsoft.com>