Граф коммитов

490 Коммитов

Автор SHA1 Сообщение Дата
tianxchen-ms f30684dfcb
replace variable in key (#869)
* replace variable in key

* update message

* add new test case

* update snapshot

* resolve confilct

* fix ci

* update snapshot

Co-authored-by: Tianxiang Chen <tianxchen@microsoft.com>
2022-09-29 14:55:56 +08:00
Lei Ni 3753e153ae
define newman item type (#872) 2022-09-28 13:58:59 +08:00
Lei Ni 7696835c3e
fix payload path link (#871)
* fix payload path link

* fix roundtrip validation
2022-09-27 17:22:43 +08:00
Lei Ni bdaf8e2ef9
Aad auth (#863)
* load authentication

* add appconfig test case

* remove shareScope support

* armEndpoint

* itemGroup for scenario

* prepare & cleanup folder

* fix poller order

* improve lro poller

* implement auth option

* paramiterize armEndpoint

* single script

* fix armEndpoint

* clean lro code

* clean unused dependencies

* fix poller script

* fix host

* add authorization swagger

* improve logging

* check in azure built-in roles

* define roleAssignmentStep

* load roleAssignment step

* collection for scenario file

* fix runCollection

* refactor logging

* add data plane api scenario

* fix log

* update snapshot

* use local variables

* fix testproxy option

* update snapshot

* fix package.json

* changelog

* 3.1.0

* changelog

* Integrate roundtrip into api scenario (#867)

* init

* delete operationMatch

* revert package

* argvs

* init

* delete operationMatch

* revert package

* argvs

* remove skipRoundtripValidation and check isMangementPlane

* update changelog

* update changelog

* update snapshot

* suppress warning log in live validator

* update package-lock.json

* fix schema ref

* fix generated step name

* align with autorest auth options

* fix roundtrip validation

* format handlebars

* Revert "format handlebars"

This reverts commit bdf9b8b290.

* show roundtrip validation results in report

* revert log level

Co-authored-by: xiaoxu qi <xiaoxuqi@microsoft.com>
2022-09-27 15:55:43 +08:00
Matthew Christopher ccdcdfcf3c
ARM ID validation (#851)
* ARM ID validation

* Unit tests

* Restrict arm-id validation to examples and arm tra

* Refactor missing_resource_id rule

Ignore error when response body is empty in example validation;
Add isArmCall flag in semantic validation.

* Updated snapshot of example generation test

Test failed because the location is set as required property in resource model so response body only has location property and doesn't have id property.

* Updated snapshot for example validation test

* Delete examplegen snapshot

* re-add example gen snapshot

* add swagger changes

* add example files used by test

* added examples used by test

* Added all exmaples generated by auto gen

* update index value in model validation

Co-authored-by: raychen <raychen@microsoft.com>
2022-09-21 09:29:24 +08:00
Ke Yu 95f76f2c76
Support api-version validation (#854)
* support api-version validation

* fix modelValidatorTest

* fix example api-version

* update snapshot

* fix build error

* use continue instead of break

* update snapshot

* fill exampleJsonPath and examplePosition

* update snapshot

Co-authored-by: Ray Chen <raychen@microsoft.com>
2022-09-20 17:44:59 +08:00
xiaoxu qi 7742096af8
remove circular ref (#865)
* remove circular ref

* remove duplicated snapshot

* update snapshot

* add test for circular

* add status code

* fix prettier

* add one rp

Co-authored-by: Ray Chen <raychen@microsoft.com>
2022-09-15 18:05:24 +08:00
tianxchen-ms 85b062aa1f
support example used in multi operations (#862)
* support example used in multi operations

* improve generate scenario

* update snapshot

* change order

Co-authored-by: Tianxiang Chen <tianxchen@microsoft.com>
2022-09-08 14:13:16 +08:00
Tianen 72800adf47
simulate hash click by jQuery (#864)
Co-authored-by: v-tianxi@microsoft.com <v-tian@microsoft.com>
2022-09-08 13:47:34 +08:00
xiaoxu qi 85fb41394f
Support round trip validation (#847)
* draft: init

* test 01

* update ref

* update attrs

* checker

* update

* update

* update

* remove lazy build

* version 1: ready for tests

* lazy build init

* add test

* update lazy build and test

* update

* fix some comment

* add todos before useing loader

* test for swaggerloader

* use swagger loader

* swagger loader for test

* use traverse swagger

* add comment and use resolveRef as parameter

* remove debug log

* update test and init operationLoader outof while-loop

* use snapshot

* use provider in SwaggerSpec

* update package

* update package from develop

* update package from develop no update

* adopt shouldResolveRef in loader opt

* update test

* update test case

* update properties parser

* update snap

* update snap
2022-08-29 16:03:43 +08:00
Tianen f8e9624c1c
add link (#859)
Co-authored-by: v-tianxi@microsoft.com <v-tian@microsoft.com>
2022-08-29 12:00:13 +08:00
tianxchen-ms 1193293516
fix response parse error (#858)
* fix response parse error

* Update lib/apiScenario/newmanReportParser.ts

Co-authored-by: Tianxiang Chen <tianxchen@microsoft.com>
Co-authored-by: Lei Ni <7233663+leni-msft@users.noreply.github.com>
2022-08-24 16:05:21 +08:00
tianxchen-ms 9db4046c0b
use newman summary in memory (#857)
Co-authored-by: Tianxiang Chen <tianxchen@microsoft.com>
2022-08-23 15:11:06 +08:00
Tianen 9875310b7e
Add markdown to swagger report (#853)
* add part of task

* add some changes about render full page render

* change position between test-failed and not-tested

* fix comment and change template that can support general normal case

* upper case api

Co-authored-by: v-tianxi@microsoft.com <v-tian@microsoft.com>
Co-authored-by: Ray Chen <raychen@microsoft.com>
2022-08-22 17:34:51 +08:00
tianxchen-ms 6ad309ac79
apiscenario bug fix (#856)
Co-authored-by: Tianxiang Chen <tianxchen@microsoft.com>
2022-08-22 14:32:48 +08:00
Ke Yu 56ca2025c1
Fix bug when operation has no own parameters (#855)
* Fix bug when operation has no own parameters

* Use mergedParameters instead
2022-08-22 14:15:01 +08:00
tianxchen-ms 2ac4bc9068
add response assert (#849)
* add response assert

* add response assert

* skip validation

* 3.0.5-beta

* update snapshot

* add mock operation info

* fix html bug

* 3.0.5-beta.1

* update changelog

* 3.0.5

Co-authored-by: Tianxiang Chen <tianxchen@microsoft.com>
2022-08-12 16:03:09 +08:00
Lei Ni ab717d2799
More scopes (#850)
* add support for Subscription and Tenant scope

* update CHANGELOG

* fix bug
2022-08-05 16:19:09 +08:00
Tianen b9c4927a23
[data-plane report] 3th update (#820)
* add utils function

* fix lint

* fix logic

* Update liveValidatorLoader.ts

* change  baselayout template

* update format code

* add resultForRendering big loop

* fix runtimeException bug

* update oav version

* add changelog

Co-authored-by: v-tianxi@microsoft.com <v-tian@microsoft.com>
Co-authored-by: Ray Chen <raychen@microsoft.com>
2022-08-04 17:14:32 +08:00
tianxchen-ms 34c9b84830
improve markdown report (#846)
* improve markdown report

* update change log

* update markdown report order

* delete correlationId

* update snapshot

Co-authored-by: Tianxiang Chen <tianxchen@microsoft.com>
2022-08-02 15:21:04 +08:00
Lei Ni c1996477d6
fix variable patches (#841)
* fix variable patches

* add test case

* update changelog

* update snapshot
2022-08-02 10:25:32 +08:00
tianxchen-ms f37550d3cb
fix report path prefix (#840)
Co-authored-by: Tianxiang Chen <tianxchen@microsoft.com>
2022-07-25 11:43:30 +08:00
tianxchen-ms 1a4e303380
improve api test report (#839)
* into one html and move markdown and junit report

* rename specPathPrefix

* add operationIds in report.json

* update changelog

* fix crossrp in report and coverage

* rename externalReference

Co-authored-by: Tianxiang Chen <tianxchen@microsoft.com>
2022-07-22 11:02:28 +08:00
Ke Yu bf07412d3c
Support data validation and generation in byte format (#834)
* Enable byte format validation and generation

* update snapshot

* update liveValidatorTest snapshot

* update validateExamplesRegression snapshot

* update validation about base64 format

* update snapshot

* Cancel config setting about atob()

Co-authored-by: Ray Chen <raychen@microsoft.com>
2022-07-20 16:59:18 +08:00
tianxchen-ms f706d5667f
api scenario improve and bug fix (#837)
* fix api scenario int variable generation bug

* fix step variable resolve & delete resource group

* fix html failed count

* add htmlSpecPathPrefix in cmd

* update snapshot and test case

* update snapshot

* update changelog

* 3.0.4

Co-authored-by: Tianxiang Chen <tianxchen@microsoft.com>
2022-07-18 10:51:01 +08:00
tianxchen-ms bd04e228b4
fix run api test when using scenario file path (#836)
Co-authored-by: Tianxiang Chen <tianxchen@microsoft.com>
2022-07-12 14:02:34 +08:00
tianxchen-ms 6f243d4ed4
add readme.test.md (#835)
* add readme.test.md

* move html report path

* update snapshot

Co-authored-by: Tianxiang Chen <tianxchen@microsoft.com>
2022-07-12 10:26:56 +08:00
Lei Ni 0e0d49c5b6
Generate example (#833)
* generateExample

* fix

* use translator

* scenario

* rename

* run

* test

* _swaggerFilePaths

* generateExample

* fix bug

* changelog

* 3.0.3

* fix bug
2022-07-06 12:02:03 +08:00
tianxchen-ms c6e95c45fe
add report test (#832)
* add report test

* fix snapshot

Co-authored-by: Tianxiang Chen <tianxchen@microsoft.com>
2022-07-05 14:25:32 +08:00
tianxchen-ms 77f47e2607
convert runtime error to live validation issue (#831)
Co-authored-by: Tianxiang Chen <tianxchen@microsoft.com>
2022-07-04 14:39:33 +08:00
Lei Ni c8a450e662
Save payload (#827)
* generate examples

* clean code

* fix operationsList generator

* savePayload

* add payload in html report

Co-authored-by: Tianxiang Chen <tianxchen@microsoft.com>
2022-07-01 20:19:29 +08:00
xiaoxu qi a4f99bf82e
Add activity id (#824)
* init

* version update

* version update

* update changelog

Co-authored-by: Ray Chen <raychen@microsoft.com>
2022-07-01 16:02:28 +08:00
Tianen 31c9a69fce
Migrate oav traffic converter (#830)
* add traffic-converter

* add changelog and update readme

* fix comment

Co-authored-by: v-tianxi@microsoft.com <v-tian@microsoft.com>
Co-authored-by: Ray Chen <raychen@microsoft.com>
2022-06-30 17:42:41 +08:00
tianxchen-ms 9c5b3f6818
fix template location replace bug (#829)
Co-authored-by: Tianxiang Chen <tianxchen@microsoft.com>
2022-06-30 14:40:23 +08:00
tianxchen-ms db9658238c
fix html report template path (#826)
Co-authored-by: Tianxiang Chen <tianxchen@microsoft.com>
2022-06-29 16:55:55 +08:00
tianxchen-ms c32c578f15
generate html report (#825)
* generate html report

* add service name

Co-authored-by: Tianxiang Chen <tianxchen@microsoft.com>
2022-06-29 15:33:59 +08:00
tianxchen-ms e72bf7d20d
fix example file path (#823)
Co-authored-by: Tianxiang Chen <tianxchen@microsoft.com>
2022-06-27 15:02:14 +08:00
tianxchen-ms f12348e221
uncheck under file root (#822)
Co-authored-by: Tianxiang Chen <tianxchen@microsoft.com>
2022-06-27 11:39:24 +08:00
tianxchen-ms 6e2f6b8335
fix spec path (#821)
* fix spec path

* add fileroot

* fix fileroot

Co-authored-by: Tianxiang Chen <tianxchen@microsoft.com>
2022-06-27 10:27:10 +08:00
Ke Yu 501faac110
Fix issues about: multipart/form-data, duration, exampleJsonPath, LRO validation and generate (#812)
* fix bug about multipart/form-data

* support duration format when generating examples

* bump oav version

* multipart form data should only have one file type parameter is required

* Report real exampleJsonPath when additional parameter includes '.'

* update logic about multipart/form-data

* still validate LRO operation when response doesn't have schema

* update exampleGeneratorTests snapshot

* update regression tests snapshot

* change the domain of LRO header

* update snapshot name

* skip error MULTIPLE_BODY_PARAMETERS when consumes includes multipart/form-data

* update test example fileName

Co-authored-by: Ray Chen <raychen@microsoft.com>
2022-06-24 17:15:32 +08:00
Lei Ni 3840542759
fix vlaue.replace is not function (#819) 2022-06-23 17:17:55 +08:00
Lei Ni 01c87c9123
change default output folder (#818)
* change default output folder

* ignore .apitest
2022-06-22 16:14:13 +08:00
tianxchen-ms 1134311b05
add example base apiscenario generator (#817)
* add test case

* add example based generation

* substring limit 10

* update snapshot

Co-authored-by: Tianxiang Chen <tianxchen@microsoft.com>
2022-06-20 10:21:10 +08:00
Lei Ni 100b655547
Support devMode for cadl local dev/test (#814)
* fix --specs param

* add support for devMode

* generate example from postman recording

* update log

* use lodash to get json pointer value

* unused

* workaround skipping lro poll in devMode

* absolute path in generated collection

* fix schema validation

* update snapshot

* fix example generation

* update variable regex

* revert option for devMode

* fix typo

* hotfix apiscenario generation

* 3.0.0-beta.5

* fix example step

* add test case

* fix templateGenerator

* update CHANGELOG

* Revert "3.0.0-beta.5"

This reverts commit 43e1637eae.

Co-authored-by: Tianxiang Chen <tianxchen@microsoft.com>
2022-06-17 15:45:16 +08:00
tianxchen-ms 29abf8249e
generate api scenario from recording (#804)
* generate api scenario from recording

* add test

* update index

* replace location

* replace variables and use parameter

* add arm folder

* fix variablize bug

* rename

* fix test

* update snapshot

* fix test

* delete unused test file

* update changelog and remove test file

Co-authored-by: Tianxiang Chen <tianxchen@microsoft.com>
2022-06-15 11:49:41 +08:00
tianxchen-ms 78749305ba
Apiscenario (#747)
* change types

* commit

* fix loader

* fix variableEnv

* apiVersion

* add arm deployment script arguments

* fix

* fix compile error

* add setBatchEnv

* fix error

* fix error

* generate api scenario from swagger

* success run basic generated api scenario

* fix bugs

* fix deps

* request and response validate (#760)

* request and response validate

* fix markdown format and remove code

* remove unused code

Co-authored-by: Tianxiang Chen <tianxchen@microsoft.com>

* use pre-request script for auth

* set environment variables

* use location variable

* default step name

* fix

* use mocker to generate api scenario

* fix step name

* fix bug

* Fit example based scenario to new syntax (#763)

* Fit example based scenario to new syntax

* update snapshot

Co-authored-by: Tianxiang Chen <tianxchen@microsoft.com>

* add readme params

* [ApiScenario] support readme (#768)

* support readme

* add generate log

* use 3.0 autorest

* update schema

Co-authored-by: Tianxiang Chen <tianxchen@microsoft.com>

* fix schemaType

* fix requestUpdate and exampleResponseDiff (#775)

* fix requestUpdate and exampleResponseDiff

* fix response diff

* fix example diff

Co-authored-by: Tianxiang Chen <tianxchen@microsoft.com>

* 2.12.0-beta.0

* fix copyfiles

* 2.12.0-beta.1

* fix package.json

* 2.12.0-beta.2

* fix autorest version

* 2.12.0-beta.3

* remove autorest (#780)

Co-authored-by: Tianxiang Chen <tianxchen@microsoft.com>

* 2.12.0-beta.4

* armtemplate variable convention (#781)

Co-authored-by: Tianxiang Chen <tianxchen@microsoft.com>

* 3.0.0-beta.0

* test proxy recording loader

* util

* regex

* _testLoad

* Support remote uri (#784)

* remote cdn scenario

* fix local

* 3.0.0-beta.1

* fix analyze-report

* fix bug

* fix bug

* response assertion

* load readmeTag

* load readme tag

* load cross-rp swagger

* use cross-RP operation

* 3.0.0-beta.2

* test proxy recording

* fix example based template generate (#795)

* fix example based template generate

* fix commit

Co-authored-by: Tianxiang Chen <tianxchen@microsoft.com>

* start/stop testProxy

* polling through test proxy

* 3.0.0-beta.3

* add test for apiScenarioLoader (coverage: 79%) (#758)

* add test for apiScenarioLoader (coverage: 56%)

* add test for apiScenarioLoader (coverage: 79%)

* Apiscenario test (#800)

* remove log

* refactor pathEnv

* rename requestParameters & responseExpected

* add ApiScenarioLoader test

* test load from uri

* test load Spring.yaml

* skip test from uri

* test load appplatform basic.yaml

* load compute scenario

* remove compute/network/appplatform test

* postmanCollectionGenerator test (#801)

* fix eslint

* Apiscenario test (#803)

* ouput uncovered operations in verbose

* testProxy test case

* refactor

* update snaptshot

* tiny change

* use clientRequest

* fix loader test

* Apiscenario test (#806)

* add more scenario and generate base snapshot

* fix arm url

* remove uploadBlob option

* updateSnapshot

* fix bug

* prefix x_

* improve pseudo random

* fix variable scope

* Refactor runner client (#807)

* refactor postmanCollectionRunnerClient

* fix bug & update snapshot

* Remove shareScope (#808)

* fix bug

* remove shareScope

* support variable prefix (#809)

* Revert "remove shareScope"

This reverts commit 1ad06dd59a.

* fix variable scopes

* skipCleanUp if scopes are shared

* 3.0.0-beta.4

* skip test generate example

* remove obsolete snapshot

* fix comments

* fix fileLoader

* revert exampleGenerator specs

* add comment

* 3.0.0

* fix bug of fileLoader preloadCache

* fix fileRoot in run-api-scenario

* fix package-lock not in sync & fix eslint

* fix npm scripts & update CHANGELOG

Co-authored-by: Lei Ni <leni@microsoft.com>
Co-authored-by: Tianxiang Chen <tianxchen@microsoft.com>
Co-authored-by: Lei Ni <7233663+leni-msft@users.noreply.github.com>
Co-authored-by: Ke Yu <33389195+keryul@users.noreply.github.com>
2022-06-10 15:01:39 +08:00
Ray Chen 967a29d767
Support arm-id format (#802)
* Support arm-id format

* Added test

* Remove .only from test
2022-05-27 17:51:02 +08:00
Tianen 4abf2dfe26
Generate swagger report 2 (#797)
* first chagne

* finish

* revert launch.json

* change testFailed table width

* fix error and add args exception

* add js to hidden run time exception

* change login to render runtime exception

* fix comment to resolve cmd alias

Co-authored-by: Ray Chen <raychen@microsoft.com>
2022-05-23 17:26:14 +08:00
Ke Yu dff4f111c4
Get real schema and data while error's schema has allOf property (#798) 2022-05-16 17:31:46 +08:00
Ke Yu e76784bb28
Fix CG (#779)
* Bump json-pointer from 0.6.1 to 0.6.2

* Get rid of z-schema dependency

* Bump async from 3.2.0 to 3.2.3

* Bump ansi-regex to 5.0.1

* Bump md5-file from 4.0.0 to 5.0.0

* fix error about md5-file

* Bump validator to 13.7.0

* Bump json-schema from 0.2.3 to 0.4.0

* fix error about swagger-parser

Co-authored-by: Ray Chen <raychen@microsoft.com>
2022-04-18 17:52:58 +08:00
Ke Yu 3eec33d4ac
fix bug about query parameter validation (#767)
* Ignore INVALID_TYPE validation in case of query parameter in string format

* update revalidate logic

* align change log version

* put all the revalidate logic to function ReValidateIfNeed()

* set timeout to single test

* update revalidate logic

* update revalidate logic and test files

* clean old codes
2022-04-18 17:19:14 +08:00
Ray Chen 376b27a93b
Support traffic validation report generation (#769)
* Add report for traffic validation

* Update swagger accuracy report

* Add rendering data in report

* Add link and friendly name of error

* Generate Swagger Accuracy Report (#770)

* change baselayout template

* Fixed snapshot test failure

Co-authored-by: Tianen <347142915@qq.com>
2022-04-07 15:42:08 +08:00
Ke Yu 0c2683fe44
Fix bug about error path (#776)
* add condition for newPathArr

* add test and change log

* upgrade package version

* add comments for newPathArr

* update comment and assert on the error path

Co-authored-by: Ray Chen <raychen@microsoft.com>
2022-04-07 14:17:19 +08:00
Alexander Batishchev 2918f02fd5
Fixed regex for management group in armUrlParser.ts (#774)
* Fixed regex for management group in armUrlParser.ts

* Update armUrlParser.ts

* Update lib/apiScenario/armUrlParser.ts

Co-authored-by: Lei Ni <7233663+leni-msft@users.noreply.github.com>
Co-authored-by: Ray Chen <raychen@microsoft.com>
2022-04-07 08:52:31 +08:00
tianxchen-ms 12b188e47e
fix readonly bug in example diff (#761)
Co-authored-by: Tianxiang Chen <tianxchen@microsoft.com>
2022-03-11 10:59:12 +08:00
Ke Yu d022e558a1
Clarify the error message of NOT_PASSED (#762)
* Clarify the error message of NOT_PASSED

* add change log

* add assert on the error location
2022-03-10 17:37:07 +08:00
xiaoxu qi 384248d42c
Xiaoxu/coverage: add coverage for each swagger file for trafficValidator (#757)
* init

* update operationCoverageResult,operationUndefinedResult, errorMessage and if-else-block

* modify error message
2022-03-02 11:29:44 +08:00
xiaoxu qi fcf57101ba
Fix GC introduced by 2.11.7 (#759)
* init

* test
2022-02-28 14:39:02 +08:00
xiaoxu qi 37fad216e0
de-duplicate swagger path when loading swagger (#753)
* de=duplicate swagger path

* update change log

* update change log

Co-authored-by: Ray Chen <raychen@microsoft.com>
2022-02-16 15:02:24 +08:00
KeYu(AnkhSpirit) f202b99c57
fix bug about date-time validation (#752)
* fix bug about date-time validation

* test if the bug is fixed

* add test property and bump version

* update test property

Co-authored-by: Ray Chen <raychen@microsoft.com>
2022-02-16 14:02:36 +08:00
KeYu(AnkhSpirit) eb0d22d652
loosen date-time validation (#744)
* loosen date-time validation

* recode, fix test error, update snapshot

* update numberOfSpecs
2022-01-26 11:34:07 +08:00
KeYu(AnkhSpirit) 7ad54bc872
Fix false alarm for NOT_PASSED about multipleOf (#743)
* Fix false alarm for NOT_PASSED about multipleOf

* add test and update change log

* update test payload

* bump version to 2.11.5

* reduce the size of the payload file

* update validation logic
2022-01-24 15:53:52 +08:00
KeYu(AnkhSpirit) a92d1bec0f
Fix false alarm for WRITEONLY_PROPERTY_NOT_ALLOWED_IN_RESPONSE (#726)
* Fix false alarm for WRITEONLY_PROPERTY_NOT_ALLOWED_IN_RESPONSE

* update

* fix x-ms-secret check and add test case

* fix test error

* update rule for x-ms-mutability

* add test for more cases

* add test comments, update change log

* add validation on error code in tests

* update error code validation in tests
2022-01-10 15:57:05 +08:00
KeYu(AnkhSpirit) 7b99b9a672
Fix false alarm for OBJECT_MISSING_REQUIRED_PROPERTY (#725)
* Fix false alarm for OBJECT_MISSING_REQUIRED_PROPERTY

* update test file, update change log

* Update ChangeLog.md

* Update modelValidatorTests.ts

Co-authored-by: Ray Chen <raychen@microsoft.com>
2022-01-05 16:16:26 +08:00
KeYu(AnkhSpirit) 85293ed4a9
Fix LRO_RESPONSE_CODE rule (#724)
* update LRO_RESPONSE_CODE validation rule

* update snapshot

* update snapshot

* add test file for model validation

Co-authored-by: Ray Chen <raychen@microsoft.com>
2021-12-23 10:54:51 +08:00
tianxchen-ms 2e9bb2f71b
fix failed to resolve discriminator models in nested definitions (#721)
* fix nested definition resolve descriminator

* add change log

* fix false alarm when inherited model has a discriminator value

* update snapshot

* revert change launch.json

* try fix pipeline false alarm

Co-authored-by: Tianxiang Chen <tianxchen@microsoft.com>
2021-12-17 16:32:55 +08:00
Ray Chen 77e49b7f9d
User/raych1/cli bug fix (#716)
* Fix validation command error

* style fix

* package json fix

* package lock update
2021-12-03 17:30:52 +08:00
Ruoxuan Wang 06f47f51e1
Ruowan/bug fix (#714)
* fix regex issue

* bump version

* revert package-lock

* Update ChangeLog.md

Co-authored-by: Ray Chen <raychen@microsoft.com>
2021-12-02 10:14:57 +08:00
Ruoxuan Wang 37bd15f5fe
Ruowan/bug fix (#713)
* add operationSearchTest

* fix regex

* add changelog
2021-12-01 13:57:51 +08:00
Ray Chen 45f515661e
Support spec traces in liveValidator (#711) 2021-12-01 10:41:12 +08:00
tianxchen-ms f0b53e0937
add new step armDeploymentScript (#712)
* add new step armDeploymentScript

* update types

* update types

* add constants

* fix schema

* bump version

Co-authored-by: Tianxiang Chen <tianxchen@microsoft.com>
2021-11-29 13:47:27 +08:00
Ruoxuan Wang d1e42e9767
fix url encoding issue (#706)
* fix url encoding issue

* new URL add base host

* fix URL based

* fix unittest

* rename function

* renmae

* update changelog

* update test and remove unused readme

* fix data-plane regex

* update liveValidator
2021-11-23 11:13:34 +08:00
tianxchen-ms 73dfa760e1
add new rules of discriminator (#707)
* add new rules INVALID_XMS_DISCRIMINATOR_VALUE and DISCRIMINATOR_PROPERTY_NOT_FOUND

* fix error meta param

* continue when invalid discriminator type

* fix comments

Co-authored-by: Tianxiang Chen <tianxchen@microsoft.com>
2021-11-22 14:54:51 +08:00
tianxchen-ms 0ac7ebb818
Fix false alarm for MISSING_PATH_PARAMETER_DEFINITION (#708)
* Fix false alarm for MISSING_PATH_PARAMETER_DEFINITION

* fix comments

Co-authored-by: Tianxiang Chen <tianxchen@microsoft.com>
2021-11-22 09:47:45 +08:00
Ray Chen f079ea65c5
Make response headers as optional (#705)
* Make response headers as optional

* adding test payloads

* Ignore LRO header check for livevalidator

* Support suppression on error code
2021-11-18 13:24:05 +08:00
Ligengxin 6a1a91ad46
Fix 'generate-examples' command failed to generate correct format for ‘uri’ format parameter (#704)
* Fix 'generate-examples' command failed to generate correct format for ‘uri’ format parameter

* add test case

* more test case

* add missing file

* update

* add test case

* update

Co-authored-by: Gengxin Li <v-wenbli@microsoft.com>
2021-11-15 13:22:49 +08:00
Ray Chen 3329c1669d
Upgrade autorest schema (#701)
* Upgrade autorest schema

* Fix content-type and unknown format issue.

* fix snapshots
2021-11-09 08:43:42 +08:00
KeYu(AnkhSpirit) cf8c7c6c59
fix jsonPathToArray bug and update snapshot (#702)
* fix jsonPathToArray bug and update snapshot

* add change log

* update change log
2021-11-08 15:19:28 +08:00
Ruoxuan Wang 3104b4fa13
bug fix for api scenario generation (#695) 2021-11-05 16:39:33 +08:00
tianxchen-ms 58768ff1e1
check discriminator property type must be string (#698)
* check discriminator property type must be string

* add changelog and bump version

Co-authored-by: Tianxiang Chen <tianxchen@microsoft.com>
2021-11-04 16:50:39 +08:00
Ray Chen ad2c485d5a
support dataplane traffic validation (#696)
* support dataplane traffic validation

* add operationInfo and extends format

* bump version
2021-11-04 16:20:24 +08:00
Ray Chen 9024ac5b59
Fix error conversion issue in MV (#694)
* Fix error conversion issue in MV

* refactor output info in mv/sv commands

* fix snapshot of regression test
2021-10-26 15:45:55 +08:00
Ruoxuan Wang 83fbc1eb64
Ruowan/gen api scenario (#693)
* generate api-scenario support pass swagger file as input

* support pass swaggers as input

* update changelog and bump version
2021-10-26 15:33:44 +08:00
Zhenglai Zhang 9a2b04e9c2
minor improvement for api scenario runner (#692)
* minor improvement for api scenario runner

* fix typo

* remove cloudName default value to support customized armEndpoint

* remove cloudName support to add its support in wrapper

* update snapshot
2021-10-21 17:43:52 +08:00
Ray Chen 15bc328187
User/raych1/new mv (#680)
* new version of model validation

* package info change

* Update some tests

* clean up some unused code

* support formData parameter

* fix lint issue

* update snapshot

* resolve external swagger error path

* fixed style issue

* fix error in semantic validator test while merging branch 'new-mv' (#691)

* fix snapshots

Co-authored-by: KeYu(AnkhSpirit) <33389195+KeYu-AnkhSpirit@users.noreply.github.com>
2021-10-20 13:42:57 +08:00
KeYu(AnkhSpirit) 36dfb6e868
update tests for semantic validator (#689)
* update tests for semantic validator

* fix suppress test

Co-authored-by: Ray Chen <raychen@microsoft.com>
2021-10-19 15:14:33 +08:00
Ruoxuan Wang 7f08b5cf98
example extractor support add url parameter (#679) 2021-09-30 16:01:12 +08:00
Lei Ni 561e55e3b0
V2 (#655)
* fix bug

* fix bug

* separate schema def

* fix types

* remove type & add scenario

* fix testResourceLoader

* fix jsonpatch

* fix schemas

* fix schema

* fix types

* fix schema

* fix raw types

* save

* fix loader

* simplify VariableScope in memory

* fix

* fix testScenarioGenerator

* fix

* fix runner

* fix tslint

* restore shareScope

* fix bug

* requiredVariables

* variable type

* fix resolve variables

* bump js-yaml version

* define patternProperties

* restore plain structure

* implement apiScenaroYamlLoader

* expectedResponse & use Example operationId

* fix variableEnv bug

* support patch

* fix bug

* implement Patch per ARM RPC

* log step name

* templateGenerator

* update export types

* add armTemplate parameters convension

* fix bug

* fix request schema

* cleanUpSteps

* error handling when execution

* revert

* revert cliSuppressExceptions

* Update validate-examples-regression-sample.yml for Azure Pipelines

* Update azure-pipelines.yml for Azure Pipelines

* Revert "Update azure-pipelines.yml for Azure Pipelines"

This reverts commit 273b05ef82.

* Revert "Update validate-examples-regression-sample.yml for Azure Pipelines"

This reverts commit d758018bdb.

* npm install with v6

* Refactor VariableEnv

* fix bug

* variableEnv

* fix outputVariables

* revert placeholder

* add resolveVariables option and turn off in postmanCollectionRunner

* fix pathVariable

* use output method to make output variable global

* update

* fix prettier

* rename to apiScenario

* rename command

* restore folder name

* restore fixture

* remove fixture from .gitignore

* fix

* fix test

* resove armTemplate

* systemData is readOnly

* Fix bug

* fix VariableEnv

* fix resolveString

* fix convention for cleanUp steps

* apply patch

* fix xmsExampleExtract bug

* fix xMsExampleExtractor

* rename folder and add Changelog

Co-authored-by: ruowan <ruowan@microsoft.com>
2021-09-30 11:27:59 +08:00
Ruoxuan Wang 2140c9f99d
Fix cg 3 (#675)
* fix cg

* bump version

* reformat

* reformat

* fix no new line
2021-09-28 13:03:28 +08:00
Ruoxuan Wang d563232003
Ruowan/operation coverage (#662)
* calculate operation coverage

* bump version and update changelog

* fix operation coverage

* runner support step scope variables

* Fix runner armTemplate outpuyt as runtime variables. support different
scope level variables.

* update changelog
2021-09-08 14:40:42 +08:00
Ruoxuan Wang c9ae46271a
Ruowan/small fix (#657)
* runner support resolve armTemplate and deploymentScripts

* update comments

* bump version and update changelog
2021-08-25 15:25:31 +08:00
Ligengxin 9d766e068f
Cli command bug fix (#658)
* fix validate-traffic command path bug

* Bug fix: generate-examples can't generate 4xx status code

* disable loadValidatorInBackground

* delete space

Co-authored-by: Gengxin Li <v-wenbli@microsoft.com>
2021-08-25 15:04:24 +08:00
Ray Chen a91895fd04
Live validator update from rpaas feedback (#656)
* Live validator update from rpaas feedback

* Isolate RP when running transform in livevalidator

* Use template msg for livevalidation runtime error
2021-08-25 14:36:17 +08:00
Phoenix He 2e25ef5da2
Refactor Semantic Feature (#649)
* sync

* Add changelog

Co-authored-by: Phoenix He <tih@microsoft.com>
Co-authored-by: raychen <raychen@microsoft.com>
2021-08-12 17:36:27 +08:00
Ruoxuan Wang fb33f9b16e
remove unused log (#654) 2021-08-11 14:12:43 +08:00
JianyeXi 066e989670
runner debug mode ramp up (#650)
* save after step env file

* fix lint error

* rename method

* fix merge conflict

* add change log

Co-authored-by: jianye xi <jianyxi@microsoft.com>
2021-08-11 13:09:27 +08:00
Lei Ni 60e9727dec
fix bug (#653)
* fix bug

* fix bug
2021-08-10 16:58:50 +08:00
Ruoxuan Wang 6c9aab3879
make runner run api sync (#648)
* runner run test scenario sequentially

* add runner architecture

* bump version and update changelog

* remove install gif update runApiTest.gif
2021-08-10 14:49:25 +08:00
Ligengxin 7320e528a0
Disable checkUnderFileRoot in `Validate Traffic` command (#646)
* Disable checkUnderFileRoot

* Disable checkUnderFileRoot

* bump version

* update
2021-08-03 15:08:25 +08:00
Ruoxuan Wang 5660d08093
Update readme and small bug fix (#644)
* fix lint

* add gif

* add installOav.gif

* update oav -h in readme

* update runApiTest doc

* small fix

* avoid conflict step name when generate postman collection item

* update changelog

* support verbose command update gif

* update doc

* refine doc

* poller do not output err

* update gif

* fix typo

* bug fix. setup subscriptionId as environment variables

* update changelog
2021-07-29 11:32:57 +08:00