Граф коммитов

112 Коммитов

Автор SHA1 Сообщение Дата
Stas 6336c84ff5
Convert RESTler bug buckets to Postman collections (#168)
Co-authored-by: stas <statis@microsoft.com>
2021-03-24 14:50:05 -07:00
Stas b5d1ff4c07
Fix Linux implementation. (#167)
Instead of trying to pass environment variables as part of the command to run. Save command line to a shell script file and then run the file with the shell.
Otherwise Linux shell replaces environment variable values before they get to the container.

Co-authored-by: stas <statis@microsoft.com>
2021-03-24 10:40:29 -07:00
Stas f0c5df716b
Update deprecated frontend authentication APIs (#166)
Co-authored-by: stas <statis@microsoft.com>
2021-03-19 08:51:39 -07:00
Marc 185948f37f
Update index. (#165) 2021-03-18 12:31:09 -07:00
Stas 94b6d3af1d
fix 60 tasks test (#164)
Co-authored-by: stas <statis@microsoft.com>
2021-03-18 10:57:31 -07:00
Stas e48449b65e
update dotnet dependencies (#163)
Co-authored-by: stas <statis@microsoft.com>
2021-03-18 09:09:42 -07:00
Marc 6435347080
Update version for release 3.0 #161 (#162) 2021-03-17 15:23:18 -07:00
Marc 64090bdfef
Support job deployment into a vnet. #158 (#159) 2021-03-16 16:39:25 -07:00
Stas 53df5e9f83
upgrade pyyaml and the other of python dependencies (#160)
Co-authored-by: stas <statis@microsoft.com>
2021-03-16 13:13:00 -07:00
Stas 15665589e6
dotnet5 (#157)
Co-authored-by: stas <statis@microsoft.com>
2021-03-16 10:21:08 -07:00
Marc 6efa439c67
Create the key vault event subscription after orchestrator is running. #155 (#156) 2021-03-12 12:07:26 -08:00
Stas 1b0b65835a
add CLI version tracking (#154)
Co-authored-by: stas <statis@microsoft.com>
2021-03-11 11:31:52 -08:00
Stas 202a710cba
Split each task in RESTler. Every task reports it's own stats, meanwhile Agent overall reports sum of all requests. (#153)
Example:

Agent: 2-restlercombined    Tool: RESTler    State: Completed     Total Request Count: 701
  Response Code    Count
---------------  -------
            200      227
            400      272
            404       13
            500      189

======================
Agent: 2-restlercombined:0    Tool: RESTler    State: TaskCompleted
Details:
tasktype : Compile
======================
Agent: 2-restlercombined:1    Tool: RESTler    State: TaskCompleted     Total Request Count: 701
  Response Code    Count
---------------  -------
            200      227
            400      272
            404       13
            500      189

Details:
experiment : experiment36
tasktype : Fuzz
finalspeccoverage : 10 / 19
numberofbugsfound : 53

Co-authored-by: stas <statis@microsoft.com>
2021-03-10 15:32:47 -08:00
Stas a50774ca1e
CLI script to run RAFT locally. - Requires Python and Docker to be on the machine - No Azure required (#152)
Co-authored-by: stas <statis@microsoft.com>
2021-03-10 13:05:00 -08:00
Stas eb01987fc9
Combine RESTler tasks into one config (#151)
- Enable combination of any RESTler tasks in one job config, thus running specified tasks on single container in succession
- Add new TaskCompleted event to provide more granular status notifications

Co-authored-by: stas <statis@microsoft.com>
2021-03-08 08:44:05 -08:00
Stas e6d718bb66
Step-by-Step documentation on how to setup Azure Devops pipeline to run RAFT jobs (#150)
Co-authored-by: stas <statis@microsoft.com>
2021-03-02 13:02:00 -08:00
Marc 4d674022ef
Dynamically reload secrets from the key vault. #122 (#149) 2021-03-01 12:20:47 -08:00
Stas 5a0297b7d0
2.3 release (#145)
Co-authored-by: stas <statis@microsoft.com>
2021-02-22 15:55:34 -08:00
Stas b5d032d6fd
Update txttoken.md (#144) 2021-02-22 15:50:31 -08:00
Stas 6740d776a7
step by step tutorial on how to use Text Token authentication (#143)
Co-authored-by: stas <statis@microsoft.com>
2021-02-22 15:38:30 -08:00
Stas 2f68c8610f
Expose dredd configuration values through RAFT job definition - Add swagger scheman.json to dredd - Expose 'header', 'dry-run', 'only', 'hookfiles', 'require' confgiuration values (#142)
Co-authored-by: stas <statis@microsoft.com>
2021-02-22 14:48:59 -08:00
Marc b8d2f7790f
Update RESTler version string in Agent. (#139) 2021-02-19 16:24:26 -08:00
Marc 3dd3552628
Update release numbers and RESTler image version. (#138) 2021-02-19 13:48:46 -08:00
Marc aa3acaa18f
Update default scope string. #133 #131 (#134) 2021-02-19 13:15:12 -08:00
Stas 210fed3ebf
Update how-to-deploy.md (#137) 2021-02-18 11:12:54 -08:00
Stas 28b40376c3
Use updated schemathesis docker image (#136)
Co-authored-by: stas <statis@microsoft.com>
2021-02-16 15:07:57 -08:00
Stas e7bc863d5f
Fix deployment failure caused by updated az-cli (#135)
* adjust deployment warning handling to newer az cli

* Fix deployment failure caused by updated az-cli

- AZ CLI prints "WARNING:" in front of the warning message now to std-out

Co-authored-by: stas <statis@microsoft.com>
2021-02-16 10:53:16 -08:00
Stas 52e7ba4367
add retry logic to CLI when service is temporarily unavailable (#129)
Co-authored-by: stas <statis@microsoft.com>
2021-02-02 12:40:23 -08:00
Marc b0046a8abe
Tutorial on how to create a github workflow (#130)
Co-authored-by: Stas <stishkin@live.com>
2021-02-01 15:54:52 -08:00
Marc 0c56fe4359
Merge authentication library before packaging CLI. (#128) 2021-02-01 12:10:15 -08:00
Marc 5d6d12a4bc
Always build the binaries regardless if it's a production build or not. The publish step will determine which build pipeline artifacts to pull from. (#127) 2021-02-01 10:41:43 -08:00
Stas f95bb9186c
RAFT 2.1 (#126)
Co-authored-by: stas <statis@microsoft.com>
2021-02-01 10:11:01 -08:00
Stas add2963c1d
Ability to add SSL certificates (#125)
- only works with RESTler at this point

Co-authored-by: stas <statis@microsoft.com>
2021-02-01 08:30:44 -08:00
Marc 4339967231
Keyvault roles are no longer in preview. #123 (#124) 2021-01-29 15:13:13 -08:00
Stas 0402146f2e
Garbage collection improvements (#120)
Co-authored-by: stas <statis@microsoft.com>
2021-01-26 16:09:31 -08:00
Stas bd4a4b4f6e
Improve handling of containers with IsIdling flag - if IsIdling is set, then RAFT_STARTUP_DELAY is 0 since all commands executions are controlled by the user - Added `ReStarted` state to impove behaviour when `update` command is posted (#119)
Co-authored-by: stas <statis@microsoft.com>
2021-01-25 10:45:29 -08:00
Stas 41e7296e4c
Schemathesis (#118)
* mutation seeds

* raft on raft yaml fix

* schemathesis

Co-authored-by: stas <statis@microsoft.com>
2021-01-21 15:26:53 -08:00
Stas 0979bf5c1a
Big-List-Of-Naughty-Strings - Integrate https://github.com/minimaxir/big-list-of-naughty-strings as fuzz values used by RESTler when mutationsSeed specified in RESTler configuration file (#115)
Co-authored-by: stas <statis@microsoft.com>
2021-01-20 12:20:42 -08:00
Stas 8ef0f8f0b8
Documentation fixes (#114)
* Download auth to correct directory

* Documentation fixes

Co-authored-by: Marc Greisen <marc@greisen.org>
Co-authored-by: stas <statis@microsoft.com>
2021-01-20 11:22:58 -08:00
Marc 28057389c3
Fix upload-tools yaml. (#116) 2021-01-20 10:21:50 -08:00
Stas 331fd6f7fe
Wordpress on RAFT (#113)
Co-authored-by: stas <statis@microsoft.com>
2021-01-19 08:56:51 -08:00
Marc 8f1db56262
Update build-publish-deploy-test pipeline yaml. (#112) 2021-01-14 14:56:55 -08:00
Marc a956d8e6b4
Update rolling build definition. (#111) 2021-01-14 13:16:34 -08:00
Marc e6316e32be
Update pipelines to use with production releases. #109 (#110) 2021-01-14 12:31:12 -08:00
Marc 4e1dfd1feb
Reference command line defaults as needed. #107 (#108) 2021-01-14 12:06:22 -08:00
Stas ec72ee35e0
V2 (#106)
* Support for listening on multiple ports in test targets (#58)

Co-authored-by: stas <statis@microsoft.com>

* Support for a list of swagger specifications (#62)

Co-authored-by: stas <statis@microsoft.com>

* SwaggerLocations renamed to ApiSpecifications and unify URL and FilePath (#90)

Co-authored-by: stas <statis@microsoft.com>

* Use "shell" only to run commands (#92)

Co-authored-by: stas <statis@microsoft.com>

* Make resource names unique #88 (#95)

Co-authored-by: Stas <stishkin@live.com>

* Refactor schema to include TestTargetConfiguration as common configuration for test tasks (#94)

- TestTargetConfiguration includes ApiSepcifications list, IP, port and host (all are optional)
- If task sets it's own TestTargetConfiguration, then it overrides the global one

Co-authored-by: stas <statis@microsoft.com>

* Expose more of RESTler configuration settings as part of Run Configuration (#98)

Co-authored-by: stas <statis@microsoft.com>

* Schema renames (#99)

* Rename:
testTargetConfiguration -> targetConfiguration

* Rename:
targets -> services

* Script to run all samples

Co-authored-by: stas <statis@microsoft.com>

* "dredd" integration with RAFT (#101)

Co-authored-by: stas <statis@microsoft.com>

* use endpoint for target under test configuration (#102)

Co-authored-by: stas <statis@microsoft.com>

* - dedicated results storage (#103)

- all of utils functionality (status tables, azure function blob storage) move to utils storage

Co-authored-by: stas <statis@microsoft.com>

* Refactor RAFT specific code into separate libraries, thus simplifying onboarding of tools written in node-js or Python (#104)

Co-authored-by: stas <statis@microsoft.com>

* Align docs with V2 changes (#105)

Co-authored-by: stas <statis@microsoft.com>

Co-authored-by: stas <statis@microsoft.com>
Co-authored-by: Marc <marc@greisen.org>
2021-01-06 11:41:11 -08:00
Marc 0f9e0c0d3b
Fix integration point for tool swagger. #96 (#97) 2020-12-15 12:28:10 -08:00
Marc d549b12f72
Update documentation with video tutorial links. (#93) 2020-12-14 10:59:23 -08:00
Stas ec7311036b
Update RESTler swagger schema (#91)
Co-authored-by: stas <statis@microsoft.com>
2020-12-11 14:14:57 -08:00
Stas 539fac99d1
cli version 2.15.0 (#87)
Co-authored-by: stas <statis@microsoft.com>
2020-12-08 15:32:44 -08:00