Ruoxuan Wang
3008735de8
Ruowan/pass variables ( #638 )
...
* default resourceGroupPrefix apiTest
* run test scenario command support skip cleanup
* runner support predefined resourceGroup. and skip cleanup
* fix resourceUpdate bug
* oav test scenario runner support dryRun mode
* rename analyze-newman-report
* oav runner support pass variables
* support pass variables
* update outputVariables schema
* run-test-scenario add oav run alias
* postman runner support get object value by json pointer
* update changelog and bump version
* udpate jsonPointer unittest
* small fix
* update package-lock
* revert back oav
* revert back readme
* remove unused log
2021-07-15 10:10:47 +08:00
Ligengxin
51e2e4247b
support validate-traffic <traffic-path> <spec-path> command in OAV cli ( #633 )
...
* support validate-traffic <traffic-path> <spec-path> command
* fix format
* update command describe
* update
* update log type
* format
* update readme
* delete semicolon
* test ci
* check file path before validate
* resolve comment
* resovle comment
* Update
* add missing dependency files
* fix lint
* remove files
* resolve comment
* fix lint
* Bump version and update changelog
* update
Co-authored-by: Ray Chen <raychen@microsoft.com>
2021-07-13 11:36:21 +08:00
Phoenix He
56886b0e5e
Support request/response transform and output variable from response ( #640 )
2021-07-09 16:57:29 +08:00
Ray Chen
1234376d48
Ignore LRO header check in case of sync calls ( #637 )
...
* Ignore LRO header check in case of sync calls
* Update snapshots and test swagger
2021-07-06 15:39:47 +08:00
Ruoxuan Wang
375072f6b9
support extract output from armTemplate deployment ( #634 )
...
* support extract output from armTemplate
* update changelog and bump version
* remove unused log
* fix compitablity issue
* fix compatibility issue.
2021-06-29 13:51:20 +08:00
Ruoxuan Wang
8c9e084268
small fix ( #632 )
2021-06-24 16:33:49 +08:00
Ruoxuan Wang
87d8b0d1df
Ruowan/checklevel ( #628 )
...
* support two checklevel and ignore readonly, secret property compare.
* donot output log when request method is post
* rename to RUNTIME_ERROR
* rename level
* remove unused log
* refine description
* update changelog
* rename check level
2021-06-24 13:27:25 +08:00
Zhenglai Zhang
1371ee8fed
Add test scenario JUnit result output and markdown report refinement ( #629 )
...
* add markdown report support
* fix linting issues
* update generate markdown report flow
* fix snapshot
* improve report format
* fix markdownReportPath as optional
* fix markdownReportPath
* add junit xml output
* fix markdown
* fix package.json formatting
2021-06-23 10:25:56 +08:00
Ruoxuan Wang
a93b956b38
Ruowan/list operations ( #625 )
...
* generate listOperation
* rename rule incorrect provisioning state
* refactor api testing code
* rename error code
* update changelog bump version
* update changelog
* fix relative path bug
* update changelog
* output junit report
* revert package.json
* bump version
* add patch
* revert
* rename rule-name
* fix
* rename generate rule put-delete to resource-put-delete
2021-06-17 11:05:57 +08:00
Zhenglai Zhang
0b6adc1b21
add markdown report support for test scenario runner ( #624 )
...
* add markdown report support
* fix linting issues
* update generate markdown report flow
* fix snapshot
* improve report format
* fix markdownReportPath as optional
2021-06-10 11:35:16 +08:00
Ruoxuan Wang
9fdf0cd30f
Ruowan/dependency ( #622 )
...
* add error log when jsonPointer is invalid
* analyze dependency output resourceId definition json path
* remove unused code
* add test fixtures
* fix unittest
* small fix and optimise dependency structure
* add more field for dependencyResult
* export swaggerAnalyzer
* rename resourceType to fullResourceType
* update description
* bump version and update readme
* update package-lock.json
* update package-lock.json
* fix eslint
* fix prettier error
* test step any of to oneof
* bug fix: get armTemplate deployment parameters. add arm deployment
status check
* update changelog
2021-06-01 14:01:44 +08:00
Ray Chen
515b9875d4
Ignore sub level resources validation for missing_resource_id rule ( #623 )
...
* Ignore sub level resources validation
* Added test
* Export function parseValidationRequest
2021-05-26 13:26:47 +08:00
Ray Chen
50a0dd5a22
Supports different logging types in livevalidator ( #621 )
...
* Supports different logging types in livevalidator
* Remove unnecessary perf logging for one operation.
2021-05-18 10:56:28 +08:00
Ruoxuan Wang
ccac9026e0
Ruowan/arm endpoint ( #620 )
...
* support pass armEndpoint and location
* bump version
* test scenario runner support overwrite location, by args
2021-05-14 14:31:02 +08:00
Ruoxuan Wang
caa19ba531
optimise upload blob path and report format ( #610 )
...
* optimise upload blob path
add code severity
support load resource type
output all file to outputFolder
* add timings
* run failure. exitCode = 1
* add dataMasker
* generate minute level runId
* support mask token
* escapeRegExp
* refine comment
* update changelog and bump version
* do not output header
* refine report format
* add testScenarioName field
* small fix
* small fix
* add error message for response diff and update report.
* update report blob path
* optimise postman collection blob file path
* add container report for pipeline
* response diff result to array type
* response diff ignore id, location, datetime
* bump handlebars version
* remove internal link
* add comments and small fix
* update runtime error code to "RUNTIME_ERROR"
* update runtime error code
* update runtime error message
* update changelog
2021-05-12 11:08:52 +08:00
Ray Chen
9bec0f5020
examplegen support multiple operations ( #618 )
...
* Support examplegen for multiple operations
2021-05-11 16:18:43 +08:00
Ray Chen
aa8ead5858
Add more loggings and export types ( #615 )
...
* Add more loggings and export types
* fix lint
* Log duration for on demand build validator
* Output err details
2021-05-11 13:41:26 +08:00
Ruoxuan Wang
9b6155260e
support upload generated file and report to blob ( #608 )
...
* support upload generated file and report to blob
* small fix
* use <ResourceProvider>/<api-version>/<test-scenario-name> for storing
blob result
* move collection name env name to defaultNaming.ts
* bump version and support auto upload generated file
* auto generate readme.test.md
* update changelog
2021-04-21 10:58:11 +08:00
Ruoxuan Wang
191f544087
oav2.3.1 dependency analyze. auto genereate test-scenario. run test scenario ( #607 )
...
* oav2.3.1 dependency analyze. auto genereate test-scenario. run test
scenario
* rename dependencyAnalyzer to swaggerAnalyzer
* output newman json report
2021-04-08 11:27:49 +08:00
Ray Chen
a3176ba721
Update error message of some rules ( #602 )
2021-03-30 16:28:37 +08:00
Ruoxuan Wang
ff64062a5b
Test scenario main ( #599 )
...
Support test scenario and test runner
2021-03-24 16:48:10 +08:00
Ray Chen
ab8af58add
Update LRO rules for adding allowed response code ( #598 )
...
* Update LRO rules for adding allowed response code
* Fix style issue
2021-03-23 17:40:24 +08:00
Ray Chen
40b6b7fa84
User/raychen/lro ( #588 )
...
* Add LRO validation rule
* Added two rules for LRO validation in live validator.
* Exclude error response from LRO validation.
2021-03-16 16:55:13 +08:00
Ray Chen
a022613e39
Fixed mocked value of LRO headers ( #587 )
2021-03-15 10:47:08 +08:00
Ray Chen
307f062f95
Add new rule of missing_resource_id and isArmCall option. ( #579 )
...
* Add new rule of missing_resource_id and isArmCall option.
2021-02-26 13:51:01 +08:00
Ray Chen
effbc86ed4
Bump version for re-publish. ( #577 )
2021-02-08 11:40:30 +08:00
Phoenix He
e6d445dc0b
Bugfix collect correct err.data in discriminator validation for multi… ( #568 )
...
* Bugfix
* Add test
* Update changelog
2021-01-27 13:22:14 +08:00
Ray Chen
cd097d3736
Update README.md ( #551 )
...
Update example generation command change in v2.1.0
2021-01-25 14:43:47 +08:00
JianyeXi
3b8911bd0f
fix undefined reference ( #564 )
...
* fix undefined reference
* bump version
* fix lint
Co-authored-by: jianye xi <jianyxi@microsoft.com>
2021-01-25 10:04:50 +08:00
Phoenix He
d46ff90231
Bugfix should copy required array for allOf transformer ( #563 )
...
* Bugfix should copy required array for allOf transformer
* Bugfix collect correct err.data in discriminator validation
* Add doc
2021-01-21 15:45:00 +08:00
Phoenix He
7d3b53beb1
Bump to 2.2.0 ( #562 )
2021-01-19 10:32:07 +08:00
Phoenix He
150c5e9c7c
Test Scenario Support ( #558 )
...
* Support yaml in jsonLoader
* New package
2021-01-18 16:54:38 +08:00
JianyeXi
33a8222912
Example generation improvement ( #550 )
...
* add example cache
* improve merge array cache algorithm
* fix comments
* fix snapshot
Co-authored-by: jianye xi <jianyxi@microsoft.com>
2021-01-07 10:52:02 +08:00
Phoenix He
5f01014b4b
Always transform response code ( #549 )
...
* Always transform response code
* Add test
2020-12-22 09:54:34 +08:00
Phoenix He
1a1cb1cbe7
Support loading swagger examples ( #546 )
2020-12-01 09:28:32 +08:00
Ray Chen
d2486f4f53
Update README.md
2020-11-30 10:09:41 +08:00
raychen
a74c3577da
Updated test snapshot of regression test.
2020-11-25 16:17:09 +08:00
raychen
fcc6da5bf9
Ignore body schema validation when schema is not required and body value is empty.
2020-11-25 14:59:48 +08:00
raychen
0d8fc2952e
Ignore required rule validation in response in case of x-ms-secret.
2020-11-25 10:30:34 +08:00
raychen
8faf7c9d9e
Adding trigger for CI
2020-11-24 11:43:14 +08:00
raychen
8815d179d1
Release 2.0.0 version
2020-11-24 11:07:36 +08:00
Ray Chen
814697931f
Fixed two bugs in error handling ( #544 )
...
* Fixed two bugs in error handling.
Output model detail in log when resolve it with failure,
report error when the example reference has issues.
* Add error code.
* Add test for missing example reference.
2020-10-16 17:07:31 +08:00
Ray Chen
63330796d1
Ignore required rule check in response. ( #543 )
...
Only in case of both required and x-ms-secret:true are annotated.
2020-10-16 09:50:16 +08:00
Renhe Li
8f45598321
Apply the latest change for yasway to treat {} and null for parameter body with the same behavour ( #541 )
...
Co-authored-by: FAREAST\renhel <renhel@microsoft.com>
2020-09-29 13:18:39 +08:00
Ray Chen
424143000c
Ignore invalid yaml object when parse error. ( #539 )
...
* Ignore invalid yaml object when parse error.
* update package.lock
2020-09-16 15:18:52 +08:00
dependabot[bot]
d9e912a580
Bump node-fetch from 2.6.0 to 2.6.1 ( #538 )
...
Bumps [node-fetch](https://github.com/bitinn/node-fetch ) from 2.6.0 to 2.6.1.
- [Release notes](https://github.com/bitinn/node-fetch/releases )
- [Changelog](https://github.com/node-fetch/node-fetch/blob/master/docs/CHANGELOG.md )
- [Commits](https://github.com/bitinn/node-fetch/compare/v2.6.0...v2.6.1 )
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2020-09-14 08:27:30 +08:00
Wenhao Zhang
ba6b5bef61
fix name to ONE_OF_MULTIPLE ( #536 )
...
Co-authored-by: t-zhangw <codespace@72c482c53b75>
2020-09-07 17:16:12 +08:00
Ray Chen
fb06a7fcb0
Update regression test snapshot. ( #535 )
2020-09-07 15:46:16 +08:00
Wenhao Zhang
6eafef4e1d
New function getErrorsFromSemanticValidationForUnifiedPipeline ( #533 )
...
* Revert "Update function getErrorsFromSemanticValidation to extract inner error correctly (#530 )"
This reverts commit cd3896e62c
.
* New function for unified pipeline to extract semantic validation inner error.
* export serializeErrorsForUnifiedPipeline
Co-authored-by: t-zhangw <codespace@72c482c53b75>
2020-09-07 13:59:10 +08:00
Wenhao Zhang
cd3896e62c
Update function getErrorsFromSemanticValidation to extract inner error correctly ( #530 )
...
* Fix oav bug
* lint fix
* bump version and add changelog
Co-authored-by: t-zhangw <codespace@72c482c53b75>
2020-09-04 10:51:09 +08:00