8f4a3a9076
update changelog
2021-09-06 07:06:50 +00:00
b5ae8427dc
Fix runner armTemplate outpuyt as runtime variables. support different
...
scope level variables.
2021-09-06 07:05:26 +00:00
6f47cca831
runner support step scope variables
2021-09-06 06:41:08 +00:00
8fb081e6b3
fix operation coverage
2021-09-06 02:56:48 +00:00
228fa9d7a7
bump version and update changelog
2021-09-03 05:57:16 +00:00
505c63e037
calculate operation coverage
2021-09-03 05:30:59 +00:00
c9ae46271a
Ruowan/small fix ( #657 )
...
* runner support resolve armTemplate and deploymentScripts
* update comments
* bump version and update changelog
2021-08-25 15:25:31 +08:00
9d766e068f
Cli command bug fix ( #658 )
...
* fix validate-traffic command path bug
* Bug fix: generate-examples can't generate 4xx status code
* disable loadValidatorInBackground
* delete space
Co-authored-by: Gengxin Li <v-wenbli@microsoft.com>
2021-08-25 15:04:24 +08:00
a91895fd04
Live validator update from rpaas feedback ( #656 )
...
* Live validator update from rpaas feedback
* Isolate RP when running transform in livevalidator
* Use template msg for livevalidation runtime error
2021-08-25 14:36:17 +08:00
2e25ef5da2
Refactor Semantic Feature ( #649 )
...
* sync
* Add changelog
Co-authored-by: Phoenix He <tih@microsoft.com>
Co-authored-by: raychen <raychen@microsoft.com>
2021-08-12 17:36:27 +08:00
fb33f9b16e
remove unused log ( #654 )
2021-08-11 14:12:43 +08:00
066e989670
runner debug mode ramp up ( #650 )
...
* save after step env file
* fix lint error
* rename method
* fix merge conflict
* add change log
Co-authored-by: jianye xi <jianyxi@microsoft.com>
2021-08-11 13:09:27 +08:00
60e9727dec
fix bug ( #653 )
...
* fix bug
* fix bug
2021-08-10 16:58:50 +08:00
6c9aab3879
make runner run api sync ( #648 )
...
* runner run test scenario sequentially
* add runner architecture
* bump version and update changelog
* remove install gif update runApiTest.gif
2021-08-10 14:49:25 +08:00
7320e528a0
Disable checkUnderFileRoot in `Validate Traffic` command ( #646 )
...
* Disable checkUnderFileRoot
* Disable checkUnderFileRoot
* bump version
* update
2021-08-03 15:08:25 +08:00
5660d08093
Update readme and small bug fix ( #644 )
...
* fix lint
* add gif
* add installOav.gif
* update oav -h in readme
* update runApiTest doc
* small fix
* avoid conflict step name when generate postman collection item
* update changelog
* support verbose command update gif
* update doc
* refine doc
* poller do not output err
* update gif
* fix typo
* bug fix. setup subscriptionId as environment variables
* update changelog
2021-07-29 11:32:57 +08:00
8e43493bf9
support load variables from env & debugging mode ( #643 )
...
* load env
* wip
* load env
* add debugging mode
* wip
* add
* small fix
* wip
* remove ci option
* default not clean up
* fix rebase issue
* add from to check
* fix desc
* fix linting error
* fix comments
* wip
* improve consolidating env logic
* fix linting error
* bump version
* add change log
Co-authored-by: jianye xi <jianyxi@microsoft.com>
2021-07-22 10:42:38 +08:00
992502de36
Bug Fix: validate-traffic command doesn't support relative path input ( #642 )
...
* bug fix: validate-traffic command doesn't support relative path input
* Bump version and update changelog
2021-07-16 08:09:29 +08:00
3008735de8
Ruowan/pass variables ( #638 )
...
* default resourceGroupPrefix apiTest
* run test scenario command support skip cleanup
* runner support predefined resourceGroup. and skip cleanup
* fix resourceUpdate bug
* oav test scenario runner support dryRun mode
* rename analyze-newman-report
* oav runner support pass variables
* support pass variables
* update outputVariables schema
* run-test-scenario add oav run alias
* postman runner support get object value by json pointer
* update changelog and bump version
* udpate jsonPointer unittest
* small fix
* update package-lock
* revert back oav
* revert back readme
* remove unused log
2021-07-15 10:10:47 +08:00
51e2e4247b
support validate-traffic <traffic-path> <spec-path> command in OAV cli ( #633 )
...
* support validate-traffic <traffic-path> <spec-path> command
* fix format
* update command describe
* update
* update log type
* format
* update readme
* delete semicolon
* test ci
* check file path before validate
* resolve comment
* resovle comment
* Update
* add missing dependency files
* fix lint
* remove files
* resolve comment
* fix lint
* Bump version and update changelog
* update
Co-authored-by: Ray Chen <raychen@microsoft.com>
2021-07-13 11:36:21 +08:00
56886b0e5e
Support request/response transform and output variable from response ( #640 )
2021-07-09 16:57:29 +08:00
1234376d48
Ignore LRO header check in case of sync calls ( #637 )
...
* Ignore LRO header check in case of sync calls
* Update snapshots and test swagger
2021-07-06 15:39:47 +08:00
375072f6b9
support extract output from armTemplate deployment ( #634 )
...
* support extract output from armTemplate
* update changelog and bump version
* remove unused log
* fix compitablity issue
* fix compatibility issue.
2021-06-29 13:51:20 +08:00
8c9e084268
small fix ( #632 )
2021-06-24 16:33:49 +08:00
87d8b0d1df
Ruowan/checklevel ( #628 )
...
* support two checklevel and ignore readonly, secret property compare.
* donot output log when request method is post
* rename to RUNTIME_ERROR
* rename level
* remove unused log
* refine description
* update changelog
* rename check level
2021-06-24 13:27:25 +08:00
1371ee8fed
Add test scenario JUnit result output and markdown report refinement ( #629 )
...
* add markdown report support
* fix linting issues
* update generate markdown report flow
* fix snapshot
* improve report format
* fix markdownReportPath as optional
* fix markdownReportPath
* add junit xml output
* fix markdown
* fix package.json formatting
2021-06-23 10:25:56 +08:00
a93b956b38
Ruowan/list operations ( #625 )
...
* generate listOperation
* rename rule incorrect provisioning state
* refactor api testing code
* rename error code
* update changelog bump version
* update changelog
* fix relative path bug
* update changelog
* output junit report
* revert package.json
* bump version
* add patch
* revert
* rename rule-name
* fix
* rename generate rule put-delete to resource-put-delete
2021-06-17 11:05:57 +08:00
0b6adc1b21
add markdown report support for test scenario runner ( #624 )
...
* add markdown report support
* fix linting issues
* update generate markdown report flow
* fix snapshot
* improve report format
* fix markdownReportPath as optional
2021-06-10 11:35:16 +08:00
9fdf0cd30f
Ruowan/dependency ( #622 )
...
* add error log when jsonPointer is invalid
* analyze dependency output resourceId definition json path
* remove unused code
* add test fixtures
* fix unittest
* small fix and optimise dependency structure
* add more field for dependencyResult
* export swaggerAnalyzer
* rename resourceType to fullResourceType
* update description
* bump version and update readme
* update package-lock.json
* update package-lock.json
* fix eslint
* fix prettier error
* test step any of to oneof
* bug fix: get armTemplate deployment parameters. add arm deployment
status check
* update changelog
2021-06-01 14:01:44 +08:00
515b9875d4
Ignore sub level resources validation for missing_resource_id rule ( #623 )
...
* Ignore sub level resources validation
* Added test
* Export function parseValidationRequest
2021-05-26 13:26:47 +08:00
50a0dd5a22
Supports different logging types in livevalidator ( #621 )
...
* Supports different logging types in livevalidator
* Remove unnecessary perf logging for one operation.
2021-05-18 10:56:28 +08:00
ccac9026e0
Ruowan/arm endpoint ( #620 )
...
* support pass armEndpoint and location
* bump version
* test scenario runner support overwrite location, by args
2021-05-14 14:31:02 +08:00
caa19ba531
optimise upload blob path and report format ( #610 )
...
* optimise upload blob path
add code severity
support load resource type
output all file to outputFolder
* add timings
* run failure. exitCode = 1
* add dataMasker
* generate minute level runId
* support mask token
* escapeRegExp
* refine comment
* update changelog and bump version
* do not output header
* refine report format
* add testScenarioName field
* small fix
* small fix
* add error message for response diff and update report.
* update report blob path
* optimise postman collection blob file path
* add container report for pipeline
* response diff result to array type
* response diff ignore id, location, datetime
* bump handlebars version
* remove internal link
* add comments and small fix
* update runtime error code to "RUNTIME_ERROR"
* update runtime error code
* update runtime error message
* update changelog
2021-05-12 11:08:52 +08:00
9bec0f5020
examplegen support multiple operations ( #618 )
...
* Support examplegen for multiple operations
2021-05-11 16:18:43 +08:00
aa8ead5858
Add more loggings and export types ( #615 )
...
* Add more loggings and export types
* fix lint
* Log duration for on demand build validator
* Output err details
2021-05-11 13:41:26 +08:00
9b6155260e
support upload generated file and report to blob ( #608 )
...
* support upload generated file and report to blob
* small fix
* use <ResourceProvider>/<api-version>/<test-scenario-name> for storing
blob result
* move collection name env name to defaultNaming.ts
* bump version and support auto upload generated file
* auto generate readme.test.md
* update changelog
2021-04-21 10:58:11 +08:00
191f544087
oav2.3.1 dependency analyze. auto genereate test-scenario. run test scenario ( #607 )
...
* oav2.3.1 dependency analyze. auto genereate test-scenario. run test
scenario
* rename dependencyAnalyzer to swaggerAnalyzer
* output newman json report
2021-04-08 11:27:49 +08:00
a3176ba721
Update error message of some rules ( #602 )
2021-03-30 16:28:37 +08:00
ff64062a5b
Test scenario main ( #599 )
...
Support test scenario and test runner
2021-03-24 16:48:10 +08:00
ab8af58add
Update LRO rules for adding allowed response code ( #598 )
...
* Update LRO rules for adding allowed response code
* Fix style issue
2021-03-23 17:40:24 +08:00
40b6b7fa84
User/raychen/lro ( #588 )
...
* Add LRO validation rule
* Added two rules for LRO validation in live validator.
* Exclude error response from LRO validation.
2021-03-16 16:55:13 +08:00
a022613e39
Fixed mocked value of LRO headers ( #587 )
2021-03-15 10:47:08 +08:00
307f062f95
Add new rule of missing_resource_id and isArmCall option. ( #579 )
...
* Add new rule of missing_resource_id and isArmCall option.
2021-02-26 13:51:01 +08:00
effbc86ed4
Bump version for re-publish. ( #577 )
2021-02-08 11:40:30 +08:00
e6d445dc0b
Bugfix collect correct err.data in discriminator validation for multi… ( #568 )
...
* Bugfix
* Add test
* Update changelog
2021-01-27 13:22:14 +08:00
cd097d3736
Update README.md ( #551 )
...
Update example generation command change in v2.1.0
2021-01-25 14:43:47 +08:00
3b8911bd0f
fix undefined reference ( #564 )
...
* fix undefined reference
* bump version
* fix lint
Co-authored-by: jianye xi <jianyxi@microsoft.com>
2021-01-25 10:04:50 +08:00
d46ff90231
Bugfix should copy required array for allOf transformer ( #563 )
...
* Bugfix should copy required array for allOf transformer
* Bugfix collect correct err.data in discriminator validation
* Add doc
2021-01-21 15:45:00 +08:00
7d3b53beb1
Bump to 2.2.0 ( #562 )
2021-01-19 10:32:07 +08:00
150c5e9c7c
Test Scenario Support ( #558 )
...
* Support yaml in jsonLoader
* New package
2021-01-18 16:54:38 +08:00
ruowan
Ruoxuan Wang
Ligengxin
Ray Chen
Phoenix He
JianyeXi
Lei Ni
Phoenix He
Zhenglai Zhang