4e297241a6
Support polling with operation-location header ( #900 )
...
* support data-plane lro polling
* disable roundtrip validator temporarily
* disable rountrip validator tests
* support azurekey auth
* update snapshot
* update changelog
* changelog
* 3.2.2
* support path prefix in parameterized host
* fix bug
2022-11-14 15:30:01 +08:00
fc981bde10
fix file link ( #894 )
...
* fix file link
* package error-definition.json
2022-11-04 10:34:11 +08:00
22a5175ace
add role assignment shortcut ( #880 )
...
* add role assignment shortcut
* fix comment
* use env
* change log
* 3.2.1
Co-authored-by: Tianxiang Chen <tianxchen@microsoft.com>
2022-10-19 13:48:58 +08:00
a87a57277a
Retire some features ( #860 )
...
* retire validateExamplesInCompositeSpec in validate-example
* retire SpecValidator in validate-spec
* retire autorestPlugin
* retire dependencies
* retire vscode launch config
* revert simple semantic validation
* npm install
* clear unused dependencies
* update version
* update version to v3.2.0
Co-authored-by: Ray Chen <raychen@microsoft.com>
2022-10-11 16:26:32 +08:00
bdaf8e2ef9
Aad auth ( #863 )
...
* load authentication
* add appconfig test case
* remove shareScope support
* armEndpoint
* itemGroup for scenario
* prepare & cleanup folder
* fix poller order
* improve lro poller
* implement auth option
* paramiterize armEndpoint
* single script
* fix armEndpoint
* clean lro code
* clean unused dependencies
* fix poller script
* fix host
* add authorization swagger
* improve logging
* check in azure built-in roles
* define roleAssignmentStep
* load roleAssignment step
* collection for scenario file
* fix runCollection
* refactor logging
* add data plane api scenario
* fix log
* update snapshot
* use local variables
* fix testproxy option
* update snapshot
* fix package.json
* changelog
* 3.1.0
* changelog
* Integrate roundtrip into api scenario (#867 )
* init
* delete operationMatch
* revert package
* argvs
* init
* delete operationMatch
* revert package
* argvs
* remove skipRoundtripValidation and check isMangementPlane
* update changelog
* update changelog
* update snapshot
* suppress warning log in live validator
* update package-lock.json
* fix schema ref
* fix generated step name
* align with autorest auth options
* fix roundtrip validation
* format handlebars
* Revert "format handlebars"
This reverts commit bdf9b8b290
2022-09-27 15:55:43 +08:00
ccdcdfcf3c
ARM ID validation ( #851 )
...
* ARM ID validation
* Unit tests
* Restrict arm-id validation to examples and arm tra
* Refactor missing_resource_id rule
Ignore error when response body is empty in example validation;
Add isArmCall flag in semantic validation.
* Updated snapshot of example generation test
Test failed because the location is set as required property in resource model so response body only has location property and doesn't have id property.
* Updated snapshot for example validation test
* Delete examplegen snapshot
* re-add example gen snapshot
* add swagger changes
* add example files used by test
* added examples used by test
* Added all exmaples generated by auto gen
* update index value in model validation
Co-authored-by: raychen <raychen@microsoft.com>
2022-09-21 09:29:24 +08:00
b9c4927a23
[data-plane report] 3th update ( #820 )
...
* add utils function
* fix lint
* fix logic
* Update liveValidatorLoader.ts
* change baselayout template
* update format code
* add resultForRendering big loop
* fix runtimeException bug
* update oav version
* add changelog
Co-authored-by: v-tianxi@microsoft.com <v-tian@microsoft.com>
Co-authored-by: Ray Chen <raychen@microsoft.com>
2022-08-04 17:14:32 +08:00
f706d5667f
api scenario improve and bug fix ( #837 )
...
* fix api scenario int variable generation bug
* fix step variable resolve & delete resource group
* fix html failed count
* add htmlSpecPathPrefix in cmd
* update snapshot and test case
* update snapshot
* update changelog
* 3.0.4
Co-authored-by: Tianxiang Chen <tianxchen@microsoft.com>
2022-07-18 10:51:01 +08:00
0e0d49c5b6
Generate example ( #833 )
...
* generateExample
* fix
* use translator
* scenario
* rename
* run
* test
* _swaggerFilePaths
* generateExample
* fix bug
* changelog
* 3.0.3
* fix bug
2022-07-06 12:02:03 +08:00
31c9a69fce
Migrate oav traffic converter ( #830 )
...
* add traffic-converter
* add changelog and update readme
* fix comment
Co-authored-by: v-tianxi@microsoft.com <v-tian@microsoft.com>
Co-authored-by: Ray Chen <raychen@microsoft.com>
2022-06-30 17:42:41 +08:00
9012f49c81
fix mustache file not packed ( #828 )
...
Co-authored-by: Tianxiang Chen <tianxchen@microsoft.com>
2022-06-29 17:41:29 +08:00
501faac110
Fix issues about: multipart/form-data, duration, exampleJsonPath, LRO validation and generate ( #812 )
...
* fix bug about multipart/form-data
* support duration format when generating examples
* bump oav version
* multipart form data should only have one file type parameter is required
* Report real exampleJsonPath when additional parameter includes '.'
* update logic about multipart/form-data
* still validate LRO operation when response doesn't have schema
* update exampleGeneratorTests snapshot
* update regression tests snapshot
* change the domain of LRO header
* update snapshot name
* skip error MULTIPLE_BODY_PARAMETERS when consumes includes multipart/form-data
* update test example fileName
Co-authored-by: Ray Chen <raychen@microsoft.com>
2022-06-24 17:15:32 +08:00
78749305ba
Apiscenario ( #747 )
...
* change types
* commit
* fix loader
* fix variableEnv
* apiVersion
* add arm deployment script arguments
* fix
* fix compile error
* add setBatchEnv
* fix error
* fix error
* generate api scenario from swagger
* success run basic generated api scenario
* fix bugs
* fix deps
* request and response validate (#760 )
* request and response validate
* fix markdown format and remove code
* remove unused code
Co-authored-by: Tianxiang Chen <tianxchen@microsoft.com>
* use pre-request script for auth
* set environment variables
* use location variable
* default step name
* fix
* use mocker to generate api scenario
* fix step name
* fix bug
* Fit example based scenario to new syntax (#763 )
* Fit example based scenario to new syntax
* update snapshot
Co-authored-by: Tianxiang Chen <tianxchen@microsoft.com>
* add readme params
* [ApiScenario] support readme (#768 )
* support readme
* add generate log
* use 3.0 autorest
* update schema
Co-authored-by: Tianxiang Chen <tianxchen@microsoft.com>
* fix schemaType
* fix requestUpdate and exampleResponseDiff (#775 )
* fix requestUpdate and exampleResponseDiff
* fix response diff
* fix example diff
Co-authored-by: Tianxiang Chen <tianxchen@microsoft.com>
* 2.12.0-beta.0
* fix copyfiles
* 2.12.0-beta.1
* fix package.json
* 2.12.0-beta.2
* fix autorest version
* 2.12.0-beta.3
* remove autorest (#780 )
Co-authored-by: Tianxiang Chen <tianxchen@microsoft.com>
* 2.12.0-beta.4
* armtemplate variable convention (#781 )
Co-authored-by: Tianxiang Chen <tianxchen@microsoft.com>
* 3.0.0-beta.0
* test proxy recording loader
* util
* regex
* _testLoad
* Support remote uri (#784 )
* remote cdn scenario
* fix local
* 3.0.0-beta.1
* fix analyze-report
* fix bug
* fix bug
* response assertion
* load readmeTag
* load readme tag
* load cross-rp swagger
* use cross-RP operation
* 3.0.0-beta.2
* test proxy recording
* fix example based template generate (#795 )
* fix example based template generate
* fix commit
Co-authored-by: Tianxiang Chen <tianxchen@microsoft.com>
* start/stop testProxy
* polling through test proxy
* 3.0.0-beta.3
* add test for apiScenarioLoader (coverage: 79%) (#758 )
* add test for apiScenarioLoader (coverage: 56%)
* add test for apiScenarioLoader (coverage: 79%)
* Apiscenario test (#800 )
* remove log
* refactor pathEnv
* rename requestParameters & responseExpected
* add ApiScenarioLoader test
* test load from uri
* test load Spring.yaml
* skip test from uri
* test load appplatform basic.yaml
* load compute scenario
* remove compute/network/appplatform test
* postmanCollectionGenerator test (#801 )
* fix eslint
* Apiscenario test (#803 )
* ouput uncovered operations in verbose
* testProxy test case
* refactor
* update snaptshot
* tiny change
* use clientRequest
* fix loader test
* Apiscenario test (#806 )
* add more scenario and generate base snapshot
* fix arm url
* remove uploadBlob option
* updateSnapshot
* fix bug
* prefix x_
* improve pseudo random
* fix variable scope
* Refactor runner client (#807 )
* refactor postmanCollectionRunnerClient
* fix bug & update snapshot
* Remove shareScope (#808 )
* fix bug
* remove shareScope
* support variable prefix (#809 )
* Revert "remove shareScope"
This reverts commit 1ad06dd59a
2022-06-10 15:01:39 +08:00
dff4f111c4
Get real schema and data while error's schema has allOf property ( #798 )
2022-05-16 17:31:46 +08:00
48a1a72ec3
Fix bug about copyfiles command during build ( #782 )
...
* Fix bug about copyfiles command
* bump version and add change log
* lock async version to 3.2.3 in istanbul
2022-04-20 17:51:58 +08:00
e76784bb28
Fix CG ( #779 )
...
* Bump json-pointer from 0.6.1 to 0.6.2
* Get rid of z-schema dependency
* Bump async from 3.2.0 to 3.2.3
* Bump ansi-regex to 5.0.1
* Bump md5-file from 4.0.0 to 5.0.0
* fix error about md5-file
* Bump validator to 13.7.0
* Bump json-schema from 0.2.3 to 0.4.0
* fix error about swagger-parser
Co-authored-by: Ray Chen <raychen@microsoft.com>
2022-04-18 17:52:58 +08:00
376b27a93b
Support traffic validation report generation ( #769 )
...
* Add report for traffic validation
* Update swagger accuracy report
* Add rendering data in report
* Add link and friendly name of error
* Generate Swagger Accuracy Report (#770 )
* change baselayout template
* Fixed snapshot test failure
Co-authored-by: Tianen <347142915@qq.com>
2022-04-07 15:42:08 +08:00
0c2683fe44
Fix bug about error path ( #776 )
...
* add condition for newPathArr
* add test and change log
* upgrade package version
* add comments for newPathArr
* update comment and assert on the error path
Co-authored-by: Ray Chen <raychen@microsoft.com>
2022-04-07 14:17:19 +08:00
12b188e47e
fix readonly bug in example diff ( #761 )
...
Co-authored-by: Tianxiang Chen <tianxchen@microsoft.com>
2022-03-11 10:59:12 +08:00
384248d42c
Xiaoxu/coverage: add coverage for each swagger file for trafficValidator ( #757 )
...
* init
* update operationCoverageResult,operationUndefinedResult, errorMessage and if-else-block
* modify error message
2022-03-02 11:29:44 +08:00
fcf57101ba
Fix GC introduced by 2.11.7 ( #759 )
...
* init
* test
2022-02-28 14:39:02 +08:00
4655cd8341
Upgrade version to 2.11.7 ( #755 )
2022-02-22 08:42:06 +08:00
615df5b0d6
Upgrade newman ( #749 )
...
* upgrade newman package
* bump version and update changelog
* apply snapshot patch
Co-authored-by: Ray Chen <raychen@microsoft.com>
2022-02-14 14:25:27 +08:00
7ad54bc872
Fix false alarm for NOT_PASSED about multipleOf ( #743 )
...
* Fix false alarm for NOT_PASSED about multipleOf
* add test and update change log
* update test payload
* bump version to 2.11.5
* reduce the size of the payload file
* update validation logic
2022-01-24 15:53:52 +08:00
2e9bb2f71b
fix failed to resolve discriminator models in nested definitions ( #721 )
...
* fix nested definition resolve descriminator
* add change log
* fix false alarm when inherited model has a discriminator value
* update snapshot
* revert change launch.json
* try fix pipeline false alarm
Co-authored-by: Tianxiang Chen <tianxchen@microsoft.com>
2021-12-17 16:32:55 +08:00
77e49b7f9d
User/raych1/cli bug fix ( #716 )
...
* Fix validation command error
* style fix
* package json fix
* package lock update
2021-12-03 17:30:52 +08:00
06f47f51e1
Ruowan/bug fix ( #714 )
...
* fix regex issue
* bump version
* revert package-lock
* Update ChangeLog.md
Co-authored-by: Ray Chen <raychen@microsoft.com>
2021-12-02 10:14:57 +08:00
45f515661e
Support spec traces in liveValidator ( #711 )
2021-12-01 10:41:12 +08:00
f0b53e0937
add new step armDeploymentScript ( #712 )
...
* add new step armDeploymentScript
* update types
* update types
* add constants
* fix schema
* bump version
Co-authored-by: Tianxiang Chen <tianxchen@microsoft.com>
2021-11-29 13:47:27 +08:00
6a1a91ad46
Fix 'generate-examples' command failed to generate correct format for ‘uri’ format parameter ( #704 )
...
* Fix 'generate-examples' command failed to generate correct format for ‘uri’ format parameter
* add test case
* more test case
* add missing file
* update
* add test case
* update
Co-authored-by: Gengxin Li <v-wenbli@microsoft.com>
2021-11-15 13:22:49 +08:00
3329c1669d
Upgrade autorest schema ( #701 )
...
* Upgrade autorest schema
* Fix content-type and unknown format issue.
* fix snapshots
2021-11-09 08:43:42 +08:00
ad2c485d5a
support dataplane traffic validation ( #696 )
...
* support dataplane traffic validation
* add operationInfo and extends format
* bump version
2021-11-04 16:20:24 +08:00
83fbc1eb64
Ruowan/gen api scenario ( #693 )
...
* generate api-scenario support pass swagger file as input
* support pass swaggers as input
* update changelog and bump version
2021-10-26 15:33:44 +08:00
15bc328187
User/raych1/new mv ( #680 )
...
* new version of model validation
* package info change
* Update some tests
* clean up some unused code
* support formData parameter
* fix lint issue
* update snapshot
* resolve external swagger error path
* fixed style issue
* fix error in semantic validator test while merging branch 'new-mv' (#691 )
* fix snapshots
Co-authored-by: KeYu(AnkhSpirit) <33389195+KeYu-AnkhSpirit@users.noreply.github.com>
2021-10-20 13:42:57 +08:00
2cf07cb2ef
Export loader types ( #690 )
2021-10-19 15:55:16 +08:00
7f08b5cf98
example extractor support add url parameter ( #679 )
2021-09-30 16:01:12 +08:00
561e55e3b0
V2 ( #655 )
...
* fix bug
* fix bug
* separate schema def
* fix types
* remove type & add scenario
* fix testResourceLoader
* fix jsonpatch
* fix schemas
* fix schema
* fix types
* fix schema
* fix raw types
* save
* fix loader
* simplify VariableScope in memory
* fix
* fix testScenarioGenerator
* fix
* fix runner
* fix tslint
* restore shareScope
* fix bug
* requiredVariables
* variable type
* fix resolve variables
* bump js-yaml version
* define patternProperties
* restore plain structure
* implement apiScenaroYamlLoader
* expectedResponse & use Example operationId
* fix variableEnv bug
* support patch
* fix bug
* implement Patch per ARM RPC
* log step name
* templateGenerator
* update export types
* add armTemplate parameters convension
* fix bug
* fix request schema
* cleanUpSteps
* error handling when execution
* revert
* revert cliSuppressExceptions
* Update validate-examples-regression-sample.yml for Azure Pipelines
* Update azure-pipelines.yml for Azure Pipelines
* Revert "Update azure-pipelines.yml for Azure Pipelines"
This reverts commit 273b05ef82d758018bdb
2021-09-30 11:27:59 +08:00
5fb05951e6
Updating ansi-regex ( #676 )
...
* Updating ansi-regex in yasway
* Updating ansi-regex from 5.0.0 to 5.0.1 in copyfiles
* Updating ansi-regex from 5.0.0 to 5.0.1 in eslint
* Updating ansi-regex from 5.0.0 to 5.0.1 in jest
* Updating ansi-regex from 4.1.0 to 5.0.1 in types/jest
* dedupe ansi-regex 5.0.1
* Revert "dedupe ansi-regex 5.0.1"
This reverts commit 88dfd926ac
2021-09-30 09:43:22 +08:00
2140c9f99d
Fix cg 3 ( #675 )
...
* fix cg
* bump version
* reformat
* reformat
* fix no new line
2021-09-28 13:03:28 +08:00
33c5260747
Fix alerts issues by updating libraries ( #669 )
...
* Fix alerts issues by updating libraries
@azure/openapi-markdown
@ts-common/commonmark-to-markdown
yargs
glob-parent
* Fix legal alerts caused by intel and utcstring
* Fix alert issue by updating set-value
* Refresh package-lock.json about set-value
Co-authored-by: Ray Chen <raychen@microsoft.com>
2021-09-24 13:03:43 +08:00
1209c13802
fix vulerability issue ( #667 )
...
* fix vulerability issue
* add postman collection
2021-09-16 15:38:43 +08:00
d563232003
Ruowan/operation coverage ( #662 )
...
* calculate operation coverage
* bump version and update changelog
* fix operation coverage
* runner support step scope variables
* Fix runner armTemplate outpuyt as runtime variables. support different
scope level variables.
* update changelog
2021-09-08 14:40:42 +08:00
a91895fd04
Live validator update from rpaas feedback ( #656 )
...
* Live validator update from rpaas feedback
* Isolate RP when running transform in livevalidator
* Use template msg for livevalidation runtime error
2021-08-25 14:36:17 +08:00
2e25ef5da2
Refactor Semantic Feature ( #649 )
...
* sync
* Add changelog
Co-authored-by: Phoenix He <tih@microsoft.com>
Co-authored-by: raychen <raychen@microsoft.com>
2021-08-12 17:36:27 +08:00
6c9aab3879
make runner run api sync ( #648 )
...
* runner run test scenario sequentially
* add runner architecture
* bump version and update changelog
* remove install gif update runApiTest.gif
2021-08-10 14:49:25 +08:00
7320e528a0
Disable checkUnderFileRoot in `Validate Traffic` command ( #646 )
...
* Disable checkUnderFileRoot
* Disable checkUnderFileRoot
* bump version
* update
2021-08-03 15:08:25 +08:00
8e43493bf9
support load variables from env & debugging mode ( #643 )
...
* load env
* wip
* load env
* add debugging mode
* wip
* add
* small fix
* wip
* remove ci option
* default not clean up
* fix rebase issue
* add from to check
* fix desc
* fix linting error
* fix comments
* wip
* improve consolidating env logic
* fix linting error
* bump version
* add change log
Co-authored-by: jianye xi <jianyxi@microsoft.com>
2021-07-22 10:42:38 +08:00
992502de36
Bug Fix: validate-traffic command doesn't support relative path input ( #642 )
...
* bug fix: validate-traffic command doesn't support relative path input
* Bump version and update changelog
2021-07-16 08:09:29 +08:00
3008735de8
Ruowan/pass variables ( #638 )
...
* default resourceGroupPrefix apiTest
* run test scenario command support skip cleanup
* runner support predefined resourceGroup. and skip cleanup
* fix resourceUpdate bug
* oav test scenario runner support dryRun mode
* rename analyze-newman-report
* oav runner support pass variables
* support pass variables
* update outputVariables schema
* run-test-scenario add oav run alias
* postman runner support get object value by json pointer
* update changelog and bump version
* udpate jsonPointer unittest
* small fix
* update package-lock
* revert back oav
* revert back readme
* remove unused log
2021-07-15 10:10:47 +08:00
51e2e4247b
support validate-traffic <traffic-path> <spec-path> command in OAV cli ( #633 )
...
* support validate-traffic <traffic-path> <spec-path> command
* fix format
* update command describe
* update
* update log type
* format
* update readme
* delete semicolon
* test ci
* check file path before validate
* resolve comment
* resovle comment
* Update
* add missing dependency files
* fix lint
* remove files
* resolve comment
* fix lint
* Bump version and update changelog
* update
Co-authored-by: Ray Chen <raychen@microsoft.com>
2021-07-13 11:36:21 +08:00
Lei Ni
tianxchen-ms
Ke Yu
Matthew Christopher
Tianen
Ray Chen
xiaoxu qi
KeYu(AnkhSpirit)
Ruoxuan Wang
Ligengxin
Ke Yu
Phoenix He
JianyeXi