3875f8dba9
Isolate RP when running transform in livevalidator
2021-08-23 11:15:45 +08:00
87d2cb5364
Live validator update from rpaas feedback
2021-08-17 14:05:38 +08:00
2e25ef5da2
Refactor Semantic Feature ( #649 )
...
* sync
* Add changelog
Co-authored-by: Phoenix He <tih@microsoft.com>
Co-authored-by: raychen <raychen@microsoft.com>
2021-08-12 17:36:27 +08:00
6c9aab3879
make runner run api sync ( #648 )
...
* runner run test scenario sequentially
* add runner architecture
* bump version and update changelog
* remove install gif update runApiTest.gif
2021-08-10 14:49:25 +08:00
7320e528a0
Disable checkUnderFileRoot in `Validate Traffic` command ( #646 )
...
* Disable checkUnderFileRoot
* Disable checkUnderFileRoot
* bump version
* update
2021-08-03 15:08:25 +08:00
5660d08093
Update readme and small bug fix ( #644 )
...
* fix lint
* add gif
* add installOav.gif
* update oav -h in readme
* update runApiTest doc
* small fix
* avoid conflict step name when generate postman collection item
* update changelog
* support verbose command update gif
* update doc
* refine doc
* poller do not output err
* update gif
* fix typo
* bug fix. setup subscriptionId as environment variables
* update changelog
2021-07-29 11:32:57 +08:00
8e43493bf9
support load variables from env & debugging mode ( #643 )
...
* load env
* wip
* load env
* add debugging mode
* wip
* add
* small fix
* wip
* remove ci option
* default not clean up
* fix rebase issue
* add from to check
* fix desc
* fix linting error
* fix comments
* wip
* improve consolidating env logic
* fix linting error
* bump version
* add change log
Co-authored-by: jianye xi <jianyxi@microsoft.com>
2021-07-22 10:42:38 +08:00
992502de36
Bug Fix: validate-traffic command doesn't support relative path input ( #642 )
...
* bug fix: validate-traffic command doesn't support relative path input
* Bump version and update changelog
2021-07-16 08:09:29 +08:00
3008735de8
Ruowan/pass variables ( #638 )
...
* default resourceGroupPrefix apiTest
* run test scenario command support skip cleanup
* runner support predefined resourceGroup. and skip cleanup
* fix resourceUpdate bug
* oav test scenario runner support dryRun mode
* rename analyze-newman-report
* oav runner support pass variables
* support pass variables
* update outputVariables schema
* run-test-scenario add oav run alias
* postman runner support get object value by json pointer
* update changelog and bump version
* udpate jsonPointer unittest
* small fix
* update package-lock
* revert back oav
* revert back readme
* remove unused log
2021-07-15 10:10:47 +08:00
51e2e4247b
support validate-traffic <traffic-path> <spec-path> command in OAV cli ( #633 )
...
* support validate-traffic <traffic-path> <spec-path> command
* fix format
* update command describe
* update
* update log type
* format
* update readme
* delete semicolon
* test ci
* check file path before validate
* resolve comment
* resovle comment
* Update
* add missing dependency files
* fix lint
* remove files
* resolve comment
* fix lint
* Bump version and update changelog
* update
Co-authored-by: Ray Chen <raychen@microsoft.com>
2021-07-13 11:36:21 +08:00
1234376d48
Ignore LRO header check in case of sync calls ( #637 )
...
* Ignore LRO header check in case of sync calls
* Update snapshots and test swagger
2021-07-06 15:39:47 +08:00
375072f6b9
support extract output from armTemplate deployment ( #634 )
...
* support extract output from armTemplate
* update changelog and bump version
* remove unused log
* fix compitablity issue
* fix compatibility issue.
2021-06-29 13:51:20 +08:00
8c9e084268
small fix ( #632 )
2021-06-24 16:33:49 +08:00
87d8b0d1df
Ruowan/checklevel ( #628 )
...
* support two checklevel and ignore readonly, secret property compare.
* donot output log when request method is post
* rename to RUNTIME_ERROR
* rename level
* remove unused log
* refine description
* update changelog
* rename check level
2021-06-24 13:27:25 +08:00
1371ee8fed
Add test scenario JUnit result output and markdown report refinement ( #629 )
...
* add markdown report support
* fix linting issues
* update generate markdown report flow
* fix snapshot
* improve report format
* fix markdownReportPath as optional
* fix markdownReportPath
* add junit xml output
* fix markdown
* fix package.json formatting
2021-06-23 10:25:56 +08:00
a93b956b38
Ruowan/list operations ( #625 )
...
* generate listOperation
* rename rule incorrect provisioning state
* refactor api testing code
* rename error code
* update changelog bump version
* update changelog
* fix relative path bug
* update changelog
* output junit report
* revert package.json
* bump version
* add patch
* revert
* rename rule-name
* fix
* rename generate rule put-delete to resource-put-delete
2021-06-17 11:05:57 +08:00
0b6adc1b21
add markdown report support for test scenario runner ( #624 )
...
* add markdown report support
* fix linting issues
* update generate markdown report flow
* fix snapshot
* improve report format
* fix markdownReportPath as optional
2021-06-10 11:35:16 +08:00
9fdf0cd30f
Ruowan/dependency ( #622 )
...
* add error log when jsonPointer is invalid
* analyze dependency output resourceId definition json path
* remove unused code
* add test fixtures
* fix unittest
* small fix and optimise dependency structure
* add more field for dependencyResult
* export swaggerAnalyzer
* rename resourceType to fullResourceType
* update description
* bump version and update readme
* update package-lock.json
* update package-lock.json
* fix eslint
* fix prettier error
* test step any of to oneof
* bug fix: get armTemplate deployment parameters. add arm deployment
status check
* update changelog
2021-06-01 14:01:44 +08:00
515b9875d4
Ignore sub level resources validation for missing_resource_id rule ( #623 )
...
* Ignore sub level resources validation
* Added test
* Export function parseValidationRequest
2021-05-26 13:26:47 +08:00
50a0dd5a22
Supports different logging types in livevalidator ( #621 )
...
* Supports different logging types in livevalidator
* Remove unnecessary perf logging for one operation.
2021-05-18 10:56:28 +08:00
ccac9026e0
Ruowan/arm endpoint ( #620 )
...
* support pass armEndpoint and location
* bump version
* test scenario runner support overwrite location, by args
2021-05-14 14:31:02 +08:00
caa19ba531
optimise upload blob path and report format ( #610 )
...
* optimise upload blob path
add code severity
support load resource type
output all file to outputFolder
* add timings
* run failure. exitCode = 1
* add dataMasker
* generate minute level runId
* support mask token
* escapeRegExp
* refine comment
* update changelog and bump version
* do not output header
* refine report format
* add testScenarioName field
* small fix
* small fix
* add error message for response diff and update report.
* update report blob path
* optimise postman collection blob file path
* add container report for pipeline
* response diff result to array type
* response diff ignore id, location, datetime
* bump handlebars version
* remove internal link
* add comments and small fix
* update runtime error code to "RUNTIME_ERROR"
* update runtime error code
* update runtime error message
* update changelog
2021-05-12 11:08:52 +08:00
9bec0f5020
examplegen support multiple operations ( #618 )
...
* Support examplegen for multiple operations
2021-05-11 16:18:43 +08:00
aa8ead5858
Add more loggings and export types ( #615 )
...
* Add more loggings and export types
* fix lint
* Log duration for on demand build validator
* Output err details
2021-05-11 13:41:26 +08:00
9b6155260e
support upload generated file and report to blob ( #608 )
...
* support upload generated file and report to blob
* small fix
* use <ResourceProvider>/<api-version>/<test-scenario-name> for storing
blob result
* move collection name env name to defaultNaming.ts
* bump version and support auto upload generated file
* auto generate readme.test.md
* update changelog
2021-04-21 10:58:11 +08:00
191f544087
oav2.3.1 dependency analyze. auto genereate test-scenario. run test scenario ( #607 )
...
* oav2.3.1 dependency analyze. auto genereate test-scenario. run test
scenario
* rename dependencyAnalyzer to swaggerAnalyzer
* output newman json report
2021-04-08 11:27:49 +08:00
a3176ba721
Update error message of some rules ( #602 )
2021-03-30 16:28:37 +08:00
ff64062a5b
Test scenario main ( #599 )
...
Support test scenario and test runner
2021-03-24 16:48:10 +08:00
40b6b7fa84
User/raychen/lro ( #588 )
...
* Add LRO validation rule
* Added two rules for LRO validation in live validator.
* Exclude error response from LRO validation.
2021-03-16 16:55:13 +08:00
a022613e39
Fixed mocked value of LRO headers ( #587 )
2021-03-15 10:47:08 +08:00
307f062f95
Add new rule of missing_resource_id and isArmCall option. ( #579 )
...
* Add new rule of missing_resource_id and isArmCall option.
2021-02-26 13:51:01 +08:00
effbc86ed4
Bump version for re-publish. ( #577 )
2021-02-08 11:40:30 +08:00
e6d445dc0b
Bugfix collect correct err.data in discriminator validation for multi… ( #568 )
...
* Bugfix
* Add test
* Update changelog
2021-01-27 13:22:14 +08:00
3b8911bd0f
fix undefined reference ( #564 )
...
* fix undefined reference
* bump version
* fix lint
Co-authored-by: jianye xi <jianyxi@microsoft.com>
2021-01-25 10:04:50 +08:00
d46ff90231
Bugfix should copy required array for allOf transformer ( #563 )
...
* Bugfix should copy required array for allOf transformer
* Bugfix collect correct err.data in discriminator validation
* Add doc
2021-01-21 15:45:00 +08:00
7d3b53beb1
Bump to 2.2.0 ( #562 )
2021-01-19 10:32:07 +08:00
150c5e9c7c
Test Scenario Support ( #558 )
...
* Support yaml in jsonLoader
* New package
2021-01-18 16:54:38 +08:00
33a8222912
Example generation improvement ( #550 )
...
* add example cache
* improve merge array cache algorithm
* fix comments
* fix snapshot
Co-authored-by: jianye xi <jianyxi@microsoft.com>
2021-01-07 10:52:02 +08:00
0d8fc2952e
Ignore required rule validation in response in case of x-ms-secret.
2020-11-25 10:30:34 +08:00
8815d179d1
Release 2.0.0 version
2020-11-24 11:07:36 +08:00
63330796d1
Ignore required rule check in response. ( #543 )
...
Only in case of both required and x-ms-secret:true are annotated.
2020-10-16 09:50:16 +08:00
8f45598321
Apply the latest change for yasway to treat {} and null for parameter body with the same behavour ( #541 )
...
Co-authored-by: FAREAST\renhel <renhel@microsoft.com>
2020-09-29 13:18:39 +08:00
424143000c
Ignore invalid yaml object when parse error. ( #539 )
...
* Ignore invalid yaml object when parse error.
* update package.lock
2020-09-16 15:18:52 +08:00
d9e912a580
Bump node-fetch from 2.6.0 to 2.6.1 ( #538 )
...
Bumps [node-fetch](https://github.com/bitinn/node-fetch ) from 2.6.0 to 2.6.1.
- [Release notes](https://github.com/bitinn/node-fetch/releases )
- [Changelog](https://github.com/node-fetch/node-fetch/blob/master/docs/CHANGELOG.md )
- [Commits](https://github.com/bitinn/node-fetch/compare/v2.6.0...v2.6.1 )
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2020-09-14 08:27:30 +08:00
6eafef4e1d
New function getErrorsFromSemanticValidationForUnifiedPipeline ( #533 )
...
* Revert "Update function getErrorsFromSemanticValidation to extract inner error correctly (#530 )"
This reverts commit cd3896e62c
2020-09-07 13:59:10 +08:00
cd3896e62c
Update function getErrorsFromSemanticValidation to extract inner error correctly ( #530 )
...
* Fix oav bug
* lint fix
* bump version and add changelog
Co-authored-by: t-zhangw <codespace@72c482c53b75>
2020-09-04 10:51:09 +08:00
f12bb2528c
Fix the additional path item problem for error path ( #527 )
...
* Fix the additional path item problem for error path
* Update snapshot file
* Support writeonly property
* Apply the change for write_only property
* Update the version of OAV
Co-authored-by: FAREAST\renhel <renhel@microsoft.com>
2020-08-18 16:28:07 +08:00
822ab7e7ba
Remove sensitive value is the live validation result of x-ms-secret ( #525 )
...
* Remove sensitive value is the live validation result of x-ms-secret
* Undo unnecessary file
Co-authored-by: FAREAST\renhel <renhel@microsoft.com>
2020-08-17 14:14:02 +08:00
d7f69d59cf
Export more methods from oav for validation in unified pipeline ( #523 )
...
* Export more methods from oav for validation in unified pipeline
* minor
* add change log and bump version
Co-authored-by: t-zhangw <codespace@72c482c53b75>
2020-08-14 15:56:26 +08:00
9365547033
Upgrade yargs version to fix security vulnerability warning ( #521 )
2020-08-13 08:30:32 +08:00
raychen
Phoenix He
Ruoxuan Wang
Ligengxin
JianyeXi
Zhenglai Zhang
Phoenix He
Renhe Li
dependabot[bot]
Wenhao Zhang
Johnson Yang