f706d5667f
api scenario improve and bug fix ( #837 )
...
* fix api scenario int variable generation bug
* fix step variable resolve & delete resource group
* fix html failed count
* add htmlSpecPathPrefix in cmd
* update snapshot and test case
* update snapshot
* update changelog
* 3.0.4
Co-authored-by: Tianxiang Chen <tianxchen@microsoft.com>
2022-07-18 10:51:01 +08:00
0e0d49c5b6
Generate example ( #833 )
...
* generateExample
* fix
* use translator
* scenario
* rename
* run
* test
* _swaggerFilePaths
* generateExample
* fix bug
* changelog
* 3.0.3
* fix bug
2022-07-06 12:02:03 +08:00
31c9a69fce
Migrate oav traffic converter ( #830 )
...
* add traffic-converter
* add changelog and update readme
* fix comment
Co-authored-by: v-tianxi@microsoft.com <v-tian@microsoft.com>
Co-authored-by: Ray Chen <raychen@microsoft.com>
2022-06-30 17:42:41 +08:00
9012f49c81
fix mustache file not packed ( #828 )
...
Co-authored-by: Tianxiang Chen <tianxchen@microsoft.com>
2022-06-29 17:41:29 +08:00
501faac110
Fix issues about: multipart/form-data, duration, exampleJsonPath, LRO validation and generate ( #812 )
...
* fix bug about multipart/form-data
* support duration format when generating examples
* bump oav version
* multipart form data should only have one file type parameter is required
* Report real exampleJsonPath when additional parameter includes '.'
* update logic about multipart/form-data
* still validate LRO operation when response doesn't have schema
* update exampleGeneratorTests snapshot
* update regression tests snapshot
* change the domain of LRO header
* update snapshot name
* skip error MULTIPLE_BODY_PARAMETERS when consumes includes multipart/form-data
* update test example fileName
Co-authored-by: Ray Chen <raychen@microsoft.com>
2022-06-24 17:15:32 +08:00
78749305ba
Apiscenario ( #747 )
...
* change types
* commit
* fix loader
* fix variableEnv
* apiVersion
* add arm deployment script arguments
* fix
* fix compile error
* add setBatchEnv
* fix error
* fix error
* generate api scenario from swagger
* success run basic generated api scenario
* fix bugs
* fix deps
* request and response validate (#760 )
* request and response validate
* fix markdown format and remove code
* remove unused code
Co-authored-by: Tianxiang Chen <tianxchen@microsoft.com>
* use pre-request script for auth
* set environment variables
* use location variable
* default step name
* fix
* use mocker to generate api scenario
* fix step name
* fix bug
* Fit example based scenario to new syntax (#763 )
* Fit example based scenario to new syntax
* update snapshot
Co-authored-by: Tianxiang Chen <tianxchen@microsoft.com>
* add readme params
* [ApiScenario] support readme (#768 )
* support readme
* add generate log
* use 3.0 autorest
* update schema
Co-authored-by: Tianxiang Chen <tianxchen@microsoft.com>
* fix schemaType
* fix requestUpdate and exampleResponseDiff (#775 )
* fix requestUpdate and exampleResponseDiff
* fix response diff
* fix example diff
Co-authored-by: Tianxiang Chen <tianxchen@microsoft.com>
* 2.12.0-beta.0
* fix copyfiles
* 2.12.0-beta.1
* fix package.json
* 2.12.0-beta.2
* fix autorest version
* 2.12.0-beta.3
* remove autorest (#780 )
Co-authored-by: Tianxiang Chen <tianxchen@microsoft.com>
* 2.12.0-beta.4
* armtemplate variable convention (#781 )
Co-authored-by: Tianxiang Chen <tianxchen@microsoft.com>
* 3.0.0-beta.0
* test proxy recording loader
* util
* regex
* _testLoad
* Support remote uri (#784 )
* remote cdn scenario
* fix local
* 3.0.0-beta.1
* fix analyze-report
* fix bug
* fix bug
* response assertion
* load readmeTag
* load readme tag
* load cross-rp swagger
* use cross-RP operation
* 3.0.0-beta.2
* test proxy recording
* fix example based template generate (#795 )
* fix example based template generate
* fix commit
Co-authored-by: Tianxiang Chen <tianxchen@microsoft.com>
* start/stop testProxy
* polling through test proxy
* 3.0.0-beta.3
* add test for apiScenarioLoader (coverage: 79%) (#758 )
* add test for apiScenarioLoader (coverage: 56%)
* add test for apiScenarioLoader (coverage: 79%)
* Apiscenario test (#800 )
* remove log
* refactor pathEnv
* rename requestParameters & responseExpected
* add ApiScenarioLoader test
* test load from uri
* test load Spring.yaml
* skip test from uri
* test load appplatform basic.yaml
* load compute scenario
* remove compute/network/appplatform test
* postmanCollectionGenerator test (#801 )
* fix eslint
* Apiscenario test (#803 )
* ouput uncovered operations in verbose
* testProxy test case
* refactor
* update snaptshot
* tiny change
* use clientRequest
* fix loader test
* Apiscenario test (#806 )
* add more scenario and generate base snapshot
* fix arm url
* remove uploadBlob option
* updateSnapshot
* fix bug
* prefix x_
* improve pseudo random
* fix variable scope
* Refactor runner client (#807 )
* refactor postmanCollectionRunnerClient
* fix bug & update snapshot
* Remove shareScope (#808 )
* fix bug
* remove shareScope
* support variable prefix (#809 )
* Revert "remove shareScope"
This reverts commit 1ad06dd59a
2022-06-10 15:01:39 +08:00
dff4f111c4
Get real schema and data while error's schema has allOf property ( #798 )
2022-05-16 17:31:46 +08:00
48a1a72ec3
Fix bug about copyfiles command during build ( #782 )
...
* Fix bug about copyfiles command
* bump version and add change log
* lock async version to 3.2.3 in istanbul
2022-04-20 17:51:58 +08:00
e76784bb28
Fix CG ( #779 )
...
* Bump json-pointer from 0.6.1 to 0.6.2
* Get rid of z-schema dependency
* Bump async from 3.2.0 to 3.2.3
* Bump ansi-regex to 5.0.1
* Bump md5-file from 4.0.0 to 5.0.0
* fix error about md5-file
* Bump validator to 13.7.0
* Bump json-schema from 0.2.3 to 0.4.0
* fix error about swagger-parser
Co-authored-by: Ray Chen <raychen@microsoft.com>
2022-04-18 17:52:58 +08:00
376b27a93b
Support traffic validation report generation ( #769 )
...
* Add report for traffic validation
* Update swagger accuracy report
* Add rendering data in report
* Add link and friendly name of error
* Generate Swagger Accuracy Report (#770 )
* change baselayout template
* Fixed snapshot test failure
Co-authored-by: Tianen <347142915@qq.com>
2022-04-07 15:42:08 +08:00
0c2683fe44
Fix bug about error path ( #776 )
...
* add condition for newPathArr
* add test and change log
* upgrade package version
* add comments for newPathArr
* update comment and assert on the error path
Co-authored-by: Ray Chen <raychen@microsoft.com>
2022-04-07 14:17:19 +08:00
12b188e47e
fix readonly bug in example diff ( #761 )
...
Co-authored-by: Tianxiang Chen <tianxchen@microsoft.com>
2022-03-11 10:59:12 +08:00
384248d42c
Xiaoxu/coverage: add coverage for each swagger file for trafficValidator ( #757 )
...
* init
* update operationCoverageResult,operationUndefinedResult, errorMessage and if-else-block
* modify error message
2022-03-02 11:29:44 +08:00
fcf57101ba
Fix GC introduced by 2.11.7 ( #759 )
...
* init
* test
2022-02-28 14:39:02 +08:00
4655cd8341
Upgrade version to 2.11.7 ( #755 )
2022-02-22 08:42:06 +08:00
615df5b0d6
Upgrade newman ( #749 )
...
* upgrade newman package
* bump version and update changelog
* apply snapshot patch
Co-authored-by: Ray Chen <raychen@microsoft.com>
2022-02-14 14:25:27 +08:00
7ad54bc872
Fix false alarm for NOT_PASSED about multipleOf ( #743 )
...
* Fix false alarm for NOT_PASSED about multipleOf
* add test and update change log
* update test payload
* bump version to 2.11.5
* reduce the size of the payload file
* update validation logic
2022-01-24 15:53:52 +08:00
2e9bb2f71b
fix failed to resolve discriminator models in nested definitions ( #721 )
...
* fix nested definition resolve descriminator
* add change log
* fix false alarm when inherited model has a discriminator value
* update snapshot
* revert change launch.json
* try fix pipeline false alarm
Co-authored-by: Tianxiang Chen <tianxchen@microsoft.com>
2021-12-17 16:32:55 +08:00
77e49b7f9d
User/raych1/cli bug fix ( #716 )
...
* Fix validation command error
* style fix
* package json fix
* package lock update
2021-12-03 17:30:52 +08:00
06f47f51e1
Ruowan/bug fix ( #714 )
...
* fix regex issue
* bump version
* revert package-lock
* Update ChangeLog.md
Co-authored-by: Ray Chen <raychen@microsoft.com>
2021-12-02 10:14:57 +08:00
45f515661e
Support spec traces in liveValidator ( #711 )
2021-12-01 10:41:12 +08:00
f0b53e0937
add new step armDeploymentScript ( #712 )
...
* add new step armDeploymentScript
* update types
* update types
* add constants
* fix schema
* bump version
Co-authored-by: Tianxiang Chen <tianxchen@microsoft.com>
2021-11-29 13:47:27 +08:00
6a1a91ad46
Fix 'generate-examples' command failed to generate correct format for ‘uri’ format parameter ( #704 )
...
* Fix 'generate-examples' command failed to generate correct format for ‘uri’ format parameter
* add test case
* more test case
* add missing file
* update
* add test case
* update
Co-authored-by: Gengxin Li <v-wenbli@microsoft.com>
2021-11-15 13:22:49 +08:00
3329c1669d
Upgrade autorest schema ( #701 )
...
* Upgrade autorest schema
* Fix content-type and unknown format issue.
* fix snapshots
2021-11-09 08:43:42 +08:00
ad2c485d5a
support dataplane traffic validation ( #696 )
...
* support dataplane traffic validation
* add operationInfo and extends format
* bump version
2021-11-04 16:20:24 +08:00
83fbc1eb64
Ruowan/gen api scenario ( #693 )
...
* generate api-scenario support pass swagger file as input
* support pass swaggers as input
* update changelog and bump version
2021-10-26 15:33:44 +08:00
15bc328187
User/raych1/new mv ( #680 )
...
* new version of model validation
* package info change
* Update some tests
* clean up some unused code
* support formData parameter
* fix lint issue
* update snapshot
* resolve external swagger error path
* fixed style issue
* fix error in semantic validator test while merging branch 'new-mv' (#691 )
* fix snapshots
Co-authored-by: KeYu(AnkhSpirit) <33389195+KeYu-AnkhSpirit@users.noreply.github.com>
2021-10-20 13:42:57 +08:00
2cf07cb2ef
Export loader types ( #690 )
2021-10-19 15:55:16 +08:00
7f08b5cf98
example extractor support add url parameter ( #679 )
2021-09-30 16:01:12 +08:00
561e55e3b0
V2 ( #655 )
...
* fix bug
* fix bug
* separate schema def
* fix types
* remove type & add scenario
* fix testResourceLoader
* fix jsonpatch
* fix schemas
* fix schema
* fix types
* fix schema
* fix raw types
* save
* fix loader
* simplify VariableScope in memory
* fix
* fix testScenarioGenerator
* fix
* fix runner
* fix tslint
* restore shareScope
* fix bug
* requiredVariables
* variable type
* fix resolve variables
* bump js-yaml version
* define patternProperties
* restore plain structure
* implement apiScenaroYamlLoader
* expectedResponse & use Example operationId
* fix variableEnv bug
* support patch
* fix bug
* implement Patch per ARM RPC
* log step name
* templateGenerator
* update export types
* add armTemplate parameters convension
* fix bug
* fix request schema
* cleanUpSteps
* error handling when execution
* revert
* revert cliSuppressExceptions
* Update validate-examples-regression-sample.yml for Azure Pipelines
* Update azure-pipelines.yml for Azure Pipelines
* Revert "Update azure-pipelines.yml for Azure Pipelines"
This reverts commit 273b05ef82d758018bdb
2021-09-30 11:27:59 +08:00
5fb05951e6
Updating ansi-regex ( #676 )
...
* Updating ansi-regex in yasway
* Updating ansi-regex from 5.0.0 to 5.0.1 in copyfiles
* Updating ansi-regex from 5.0.0 to 5.0.1 in eslint
* Updating ansi-regex from 5.0.0 to 5.0.1 in jest
* Updating ansi-regex from 4.1.0 to 5.0.1 in types/jest
* dedupe ansi-regex 5.0.1
* Revert "dedupe ansi-regex 5.0.1"
This reverts commit 88dfd926ac
2021-09-30 09:43:22 +08:00
2140c9f99d
Fix cg 3 ( #675 )
...
* fix cg
* bump version
* reformat
* reformat
* fix no new line
2021-09-28 13:03:28 +08:00
33c5260747
Fix alerts issues by updating libraries ( #669 )
...
* Fix alerts issues by updating libraries
@azure/openapi-markdown
@ts-common/commonmark-to-markdown
yargs
glob-parent
* Fix legal alerts caused by intel and utcstring
* Fix alert issue by updating set-value
* Refresh package-lock.json about set-value
Co-authored-by: Ray Chen <raychen@microsoft.com>
2021-09-24 13:03:43 +08:00
1209c13802
fix vulerability issue ( #667 )
...
* fix vulerability issue
* add postman collection
2021-09-16 15:38:43 +08:00
d563232003
Ruowan/operation coverage ( #662 )
...
* calculate operation coverage
* bump version and update changelog
* fix operation coverage
* runner support step scope variables
* Fix runner armTemplate outpuyt as runtime variables. support different
scope level variables.
* update changelog
2021-09-08 14:40:42 +08:00
a91895fd04
Live validator update from rpaas feedback ( #656 )
...
* Live validator update from rpaas feedback
* Isolate RP when running transform in livevalidator
* Use template msg for livevalidation runtime error
2021-08-25 14:36:17 +08:00
2e25ef5da2
Refactor Semantic Feature ( #649 )
...
* sync
* Add changelog
Co-authored-by: Phoenix He <tih@microsoft.com>
Co-authored-by: raychen <raychen@microsoft.com>
2021-08-12 17:36:27 +08:00
6c9aab3879
make runner run api sync ( #648 )
...
* runner run test scenario sequentially
* add runner architecture
* bump version and update changelog
* remove install gif update runApiTest.gif
2021-08-10 14:49:25 +08:00
7320e528a0
Disable checkUnderFileRoot in `Validate Traffic` command ( #646 )
...
* Disable checkUnderFileRoot
* Disable checkUnderFileRoot
* bump version
* update
2021-08-03 15:08:25 +08:00
8e43493bf9
support load variables from env & debugging mode ( #643 )
...
* load env
* wip
* load env
* add debugging mode
* wip
* add
* small fix
* wip
* remove ci option
* default not clean up
* fix rebase issue
* add from to check
* fix desc
* fix linting error
* fix comments
* wip
* improve consolidating env logic
* fix linting error
* bump version
* add change log
Co-authored-by: jianye xi <jianyxi@microsoft.com>
2021-07-22 10:42:38 +08:00
992502de36
Bug Fix: validate-traffic command doesn't support relative path input ( #642 )
...
* bug fix: validate-traffic command doesn't support relative path input
* Bump version and update changelog
2021-07-16 08:09:29 +08:00
3008735de8
Ruowan/pass variables ( #638 )
...
* default resourceGroupPrefix apiTest
* run test scenario command support skip cleanup
* runner support predefined resourceGroup. and skip cleanup
* fix resourceUpdate bug
* oav test scenario runner support dryRun mode
* rename analyze-newman-report
* oav runner support pass variables
* support pass variables
* update outputVariables schema
* run-test-scenario add oav run alias
* postman runner support get object value by json pointer
* update changelog and bump version
* udpate jsonPointer unittest
* small fix
* update package-lock
* revert back oav
* revert back readme
* remove unused log
2021-07-15 10:10:47 +08:00
51e2e4247b
support validate-traffic <traffic-path> <spec-path> command in OAV cli ( #633 )
...
* support validate-traffic <traffic-path> <spec-path> command
* fix format
* update command describe
* update
* update log type
* format
* update readme
* delete semicolon
* test ci
* check file path before validate
* resolve comment
* resovle comment
* Update
* add missing dependency files
* fix lint
* remove files
* resolve comment
* fix lint
* Bump version and update changelog
* update
Co-authored-by: Ray Chen <raychen@microsoft.com>
2021-07-13 11:36:21 +08:00
1234376d48
Ignore LRO header check in case of sync calls ( #637 )
...
* Ignore LRO header check in case of sync calls
* Update snapshots and test swagger
2021-07-06 15:39:47 +08:00
375072f6b9
support extract output from armTemplate deployment ( #634 )
...
* support extract output from armTemplate
* update changelog and bump version
* remove unused log
* fix compitablity issue
* fix compatibility issue.
2021-06-29 13:51:20 +08:00
8c9e084268
small fix ( #632 )
2021-06-24 16:33:49 +08:00
87d8b0d1df
Ruowan/checklevel ( #628 )
...
* support two checklevel and ignore readonly, secret property compare.
* donot output log when request method is post
* rename to RUNTIME_ERROR
* rename level
* remove unused log
* refine description
* update changelog
* rename check level
2021-06-24 13:27:25 +08:00
1371ee8fed
Add test scenario JUnit result output and markdown report refinement ( #629 )
...
* add markdown report support
* fix linting issues
* update generate markdown report flow
* fix snapshot
* improve report format
* fix markdownReportPath as optional
* fix markdownReportPath
* add junit xml output
* fix markdown
* fix package.json formatting
2021-06-23 10:25:56 +08:00
a93b956b38
Ruowan/list operations ( #625 )
...
* generate listOperation
* rename rule incorrect provisioning state
* refactor api testing code
* rename error code
* update changelog bump version
* update changelog
* fix relative path bug
* update changelog
* output junit report
* revert package.json
* bump version
* add patch
* revert
* rename rule-name
* fix
* rename generate rule put-delete to resource-put-delete
2021-06-17 11:05:57 +08:00
0b6adc1b21
add markdown report support for test scenario runner ( #624 )
...
* add markdown report support
* fix linting issues
* update generate markdown report flow
* fix snapshot
* improve report format
* fix markdownReportPath as optional
2021-06-10 11:35:16 +08:00
tianxchen-ms
Lei Ni
Tianen
Ke Yu
Ray Chen
xiaoxu qi
KeYu(AnkhSpirit)
Ruoxuan Wang
Ligengxin
Ke Yu
Phoenix He
JianyeXi
Zhenglai Zhang