Граф коммитов

339 Коммитов

Автор SHA1 Сообщение Дата
Saipriya-1144 b4287080d9
User/priya/passing versions as args (#2478)
* Deleted __pythonVersions.sh

* Modified PlatformInstallerBase.cs

* Modified Php, phpfpm dockerfiles

* Modified bullseye.dockerfile in php-fmp

* Modified azureFunctions.JamStack.Dockerfile

* Removed Unnecessary files

* modified dotnet dockerfiles

* deleted unused sh files in build folder

* Removed Unnecessary ENV variables

* deleted __functions.sh

* Modified PlatformInstallerBase.cs

* modified PlatformInstallerBase.yml

* modified args in dockerfiles

* Removed unnecessary lines

* Modified dotnet 9 dockerfile

* Created a default version file in Oryx

* Created a default version file in Oryx

* Created a default version file in Oryx

* making default version file executable

* moved defaultversions.sh to build folder

* removed default values

* modified php-fpm 8.2 dockerfile

* created build_runtime_images.sh to  build locally

* removed unnecessary zips

* added setting_variables.yml for local build

* Modified setting_variables.yml

* removed DotNetCoreAgent.2.8.42.zip

* removed default versions file

* modified NodeDynamicInstallationTest.cs

* added more constants to constants.yml

* modified Oryx.sln

* recovered build/buildPlatformBinaries.sh build/buildTestBuildImages.sh files

* modified buildTestBuildImages.sh

* recovered __functions.sh

* recovered __functions.sh

* updated versions in constants.yml

* updated php 8.3 buster image

* passed YAML version from constants.yml

* Recovered __pythonVersions.sh

* modified to include __pythonVersions.sh

* passed YARN version also as parameter

* removed extra line

* passed dotnetCoreagent version as arg

* Added build_buildimages.sh

* Removed unnecessary  comments

* removed unnecessary comments

* resolved comments
2024-08-22 09:53:49 +05:30
Saipriya-1144 9313ee939a
User/vchintalapat/dotnet9 stack updates (#2482)
* Created new dockerfile for dotnet9 bookworm image

* modified versionsToBuild.txt

* Modified __dotnetCoreSdkVersions.sh

* Modified __dotnetCoreSdkVersions.sh

* Modified Dockerfiles

* Added Tests for dotnet9 Runtime Image

* Modified __dotNetCoreRunTimeVersions.sh

* Modified __dotNetCoreRunTimeVersion.sh

* Added Sample Apps

* modified DotNetCoreSdkVersions.cs

* Modified DotNetCoreDynamicInstallTest.cs

* Modified DotNetCoreDynamicInstallTest.cs

* Modified StorageAccountSanityTestBase.cs

* modified imageTestHelper.cs

* Modified ImageTestHelper.cs

* Modified DotnetCoreDynamicInstallTest.cs

* Modified DotnetCoreDynamicInstallTest.cs

* Modified sampleapp

* Modified PythonImageTests.cs

* Modified StorageAccountSanityTestBase.cs

* Modified StorageAccountSanityTestBase.cs

* Modified Dotnet-Monitor Version

* modified  tests/Oryx.RuntimeImage.Tests/Python/PythonImagesTests.cs
2024-07-24 11:00:50 +05:30
Sarthak Sharma c57f601da1
change category (#2461)
Signed-off-by: Sarthak Sharma <sartsharma@microsoft.com>
2024-06-17 15:52:36 +05:30
Sarath Chandra Bussa a4b0ab6e5c
Changes for Oryx pipeline migration. (#2430)
* SDKs and images onboard to onebranch

* removed V2 folder

* removed versions.txt

* not needed file

* these files are not auto generated

* gitignore

* Tests and other changes (#2441)

* tests changes

* fix

* empty

* these files are not auto generated

* gitignore

* tests fix

* githubactions fix

* tests fix

* fixes

* changes

* fixes

* changes

* changes

* jamstackInstallNode

* fixes

* commits

* changes

* fixes

* fixes

* fix versions

* publish sdks

* remove

* changes

* azcopy

* add creds

* hugo

* bug fix

* overrite logic fix

* command not found fix

* syntax fix

* enabling a few tests

* fix

* overrite

* enabled a few tests

---------

Co-authored-by: Sarath chandra Bussa <sbussa@microsoft.com>

* build images

* fix docker file

* remove set x and e

---------

Co-authored-by: Sarath chandra Bussa <sbussa@microsoft.com>
2024-05-31 16:30:11 +05:30
kumaraksh1 e1852c789e
Add Support for PHP|8.3 (#2375)
* Add support for PHP|8.2

* Add support for PHP|8.3

* typo in version

* fixing gpg keys

* version fix

* fix duplicate buster file issue

* fix installPrereqs issue

* Add support for PHP|8.3

* nit fix

* updating base runtime tag

* update sqlsrv

* update 8.3.3 sha

* Remove imagick from php|8.3

* remove imagick from PHP|8.3

* PHP|8.3.3 update base tag

* Add bookworm support for PHP|8.3.3

* add bookworm for php|8.3.3

* adding common base dockerfile for bookworm

* add 8.3 bookworm job

* update service connection

* update debian repo url

* test|8.3 something

* update ms packages repo

* update packages

* test packages php|8.3

* update  83 bookworm

* rebase php|8.3 bookworm

* update release template for a temporary run

* temp run

* Generate php base images

* Update base tag | PHP|8.3.3

* Update base tag | Php-fpm|8.3.3

* test cases | php | 8.3

* update tests | php | 8.3

* tests | php | 8.3

* test cases | php|8.3

* php | 8.3 tests

* test cases | php | 8.3.3

* Run PHP|8.3 Tests

* php|tests | 8.3.3

* php|8.3.3 tests

* add tests | php | 8.3.3

* update php|8.3.3 to 8.3.4

* update version | php | 8.3.4

* update version 8.3.3 to 8.3.4 for php

* update keys for php|8.3.4

* PHP|8.3.4 | Update Base Tag

* Version updates | php | 8.3.4

* address comments | php|8.3.4

* address comments | php|8.3.4

* update ltsVersions dockerfile | php|8.3

* php|8.3, ltsDockerfile

* php composer | php|8.3.4

---------

Co-authored-by: root <root@Akshay-D22.fareast.corp.microsoft.com>
2024-03-19 11:53:35 +05:30
Cormac McCarthy 8bdf0efd93
Add bookworm support for PHP (build) and Python (build + runtime) (#2337)
Co-authored-by: REDMOND\williamhe <williamhe@microsoft.com>
2024-01-22 22:40:24 -08:00
Cormac McCarthy fcdcb50165
Remove .NET 6.0.417, update storage account testing (#2278) 2023-12-15 09:45:21 -05:00
Harry Li 7d979c063a
Added Django 4.2 Sample App for Python 3.12 (#2251)
* Added Django 4.2 Sample App for Python 3.12
2023-11-17 09:52:54 -08:00
william-msft e35c80c05b
Add new .net8 sdks (#2246)
* Add new .net8 sdks

* Update sdk versions

* Add dotnet8 sample app

* Add comma

* Add e2e test

* Update display
2023-11-14 09:14:48 -08:00
Harry Li 07b75878a8
Harrli/python3.12 and automation (#2247)
* python 3.12 integration

* updated baseimage tag

* added dockerfiles and tests

* fixed build issue

* python version update

* BUG FIX

* issue fix

* python 3.12 sdk

* updated package version

* python 3.12 issue fix

* python pip issue fix in binaries

* updated python binary fix

* issue fix

* minor bug fix

* pip req_set file issue fix

* quick fix

* test

* python version in the image fix

* testing the container

* python 3.12 changes

* updated baseimage tag

* addressed PR comments.

* Fixed Python 3.12 pipeline failure

* Added required dependencies for lxml package

* Fixing lxml build issue

* Fixing missed gcc

* Update orjson version

* Modified orjson version

* Pipeline failure fix

* Added cargo to resolve pipeline error

* Temporarily remove orjson from python 3.12 runtime

* Addressed comments and enabled new Python test

* Added django-utils-six manually

* Removed incompatible integration test for Python 3.12

---------

Co-authored-by: Wali Bhuiyan <mbhuiyan@microsoft.com>
2023-11-08 20:20:43 -08:00
Harry Li 6cdefa572d
Adding Node 20 Support (#2217)
* Adding node 20 support for bullseye and bookworm

* Added node 20 dynamic install test

* Added tests for node 20

* Updated node platform bin yaml

* Fixed empty sas token issue

* Fixed run image base pipeline failure

* Fixed sas token issue

* Fixed sas token issue

* Added runtime tag

* Update runtime tag

* Update to LTS version

* Fixed integration test and pipeline bugs

* Updated runtime tag

* Updated for future debian bookworm

* Fixed typo

* Fixed typo
2023-10-27 13:43:35 -07:00
Cormac McCarthy 6420ace8d7
Hard-code working .NET 7.0 buster version for failing integration test (#2203) 2023-10-19 15:10:52 -07:00
Cormac McCarthy 0eee2e512d
Publish runtime images with specific version and multiple Debian flavors (#2129)
* Publish runtime images with specific tags and multiple Debian flavors

* Update constants for PHP(-FPM) base images

* Update runtime image tests to reflect new pattern

* Fix failing 'oryx dockerfile' tests

* Fix test error with new Python version mapping

* Resolve review feedback, fix tagging issue causing build failure

* Fix failing Python tests due to wrong runtime image used

* Temporary commit to get the CLA bot to run
2023-09-13 14:56:40 -07:00
waliMSFT 96b62e0bfe
removed redundancy of some methods in staging environment (#2091)
* removed redundancy of some methods in staging environment
2023-09-07 11:17:11 -04:00
Paul Dorsch 9f84875ae9
Pauld/run e2e dotnet 8 (#2123)
* add end to end test for dotnet 8, and comment out nuxt js stretch tests for now

* buster to bookworm for dotnet 8 test category

* uncomment

* fixed remaining buster reference to bookworm
2023-08-29 08:15:10 -04:00
Paul Dorsch ad51c4e715
End to end test for dotnet 8 and fix nuxt stretch test (#2121)
* add end to end test for dotnet 8, and comment out nuxt js stretch tests for now

* fixed nuxt tests to run the correct sample app, and added dotnet installation for security check (#2122)
2023-08-28 16:58:58 -04:00
waliMSFT a2e53ddad9
SDL requirement- package version update (#2088)
* SDL requirement- package version update
2023-08-21 14:25:53 -04:00
waliMSFT 5239b0416c
added env variable NGINX_CONF_FILE (#2022)
* added env variable NGINX_CONF_FILE on the runtime image

* added custom nginx config file with test and documented the new env variable
2023-07-25 11:34:44 -04:00
waliMSFT cb7d994701
Wali/oryx private environment setup 1675864 (#1878)
* setting up the private env

* private environment for build

* private account setup for buildBuildImages and buildRunTimeImages script

* copy sdks from prod to private staging account

* adding secrets to validation pipeline

* Authenticate with Azure DevOps

* env variable path bug fix

* debian package fix for nodejs

* fixed the local build issue related to the stretch package

* merged with main

* addressed PR change

* make the token hideen in local build
2023-07-10 15:11:03 -04:00
Harry Li 5b10d84a8b
Upgrade Cli to Dotnet 7 (#1816)
* Updating csproj files to dotnet 6

* net6 upgrade with pipeline update

* Updated packages to be compatible versions with dotnet 6

* Update dockerfile to install dotnet 6 sdk

* Skip self containing check

* Updated all ms extensions pkg version

* Update mcmaster command line utils in autoUpdater

* Update oryx cli from mcmaster to system commandline

* Nit

* Updated for telemetry command

* updated to test oryx cli

* Update to dotnet 7

* Update pipeline to net 7

* Update serviceProvider and commandbase

* Update detector signproj to net7

* update runtime version to 7

* Fixed inaccessible embedded resourcess

* Nit fix

* Added readme to explain the new structure of cli

* Bump werkzeug in /tests/SampleApps/python/microblog (#1854)

Bumps [werkzeug](https://github.com/pallets/werkzeug) from 0.15.3 to 0.15.5.
- [Release notes](https://github.com/pallets/werkzeug/releases)
- [Changelog](https://github.com/pallets/werkzeug/blob/main/CHANGES.rst)
- [Commits](https://github.com/pallets/werkzeug/compare/0.15.3...0.15.5)

---
updated-dependencies:
- dependency-name: werkzeug
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* Bump django in /tests/SampleApps/python/django-regex-example-app (#1874)

Bumps [django](https://github.com/django/django) from 3.2.16 to 3.2.17.
- [Release notes](https://github.com/django/django/releases)
- [Commits](https://github.com/django/django/compare/3.2.16...3.2.17)

---
updated-dependencies:
- dependency-name: django
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* Update testConsole

* Nit fix

* Update autoUpdater

* AutoUpdater change naming to suppress error

* Nit change

* Fix AutoUpdater linting issue

* Fixing testConsole errors

* Removed custom version output and its related tests

* Updated OptionTemplates

* Fix exit code error

* Remove temp local test settings

* Passed console into InvokeAsync

* Fix test

* Updated test

* Test fix

* Fix sourceDir, version, and test issues

* Removed autoUpdater and modified readme

* Nit

* Fix platforms command

* Nit

* Nit fix

* Build fix

* Address comments

* Build fix

* Suppress XML warnings

* Address comments

* Nit

* Fixed BuildCommand setting obselete options

* Update automation agent os to ubuntu latest

* Added pipeline to push img to test env acr

* Test Acr yaml name change

* Fix test acr yaml template

* Fix test acr yaml template

* Fix acr yaml stages

* fix parameter

* Fix build issue on test pipeline

* Temporary fix for uploading img

* Copy img from nightly to acr

* Nit fix

* Added nightly tag parameter

* Nit

* Nit change

* Nit change

* Fix shell script array

* Try changing to bash insteawd of script

* Remove variables

* Test parameters settings

* Change parameter settings

* Nit

* Nit change parameters

* Change script to bash

* Change loop in yaml

* Nit

* Nit change

* Loop fix

* Fixing all loops in new yaml

* Fix copy pipeline

* Fix retag

* Fix auth

* Test ACR login

* Test Auth

* Fix order of acr login

* Fixed mismatch help messages

* Update image list

* Update new image repo

* Fixing typo

---------

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-04-11 10:13:31 -07:00
william-msft 2baf5f02a2
Update node version (#1935) 2023-03-16 22:12:41 -07:00
dependabot[bot] 4f0e099547
Bump werkzeug from 0.15.5 to 2.2.3 in /tests/SampleApps/python/flask-setup-py-requirement-txt (#1886)
* Bump werkzeug in /tests/SampleApps/python/flask-setup-py-requirement-txt

Bumps [werkzeug](https://github.com/pallets/werkzeug) from 0.15.5 to 2.2.3.
- [Release notes](https://github.com/pallets/werkzeug/releases)
- [Changelog](https://github.com/pallets/werkzeug/blob/main/CHANGES.rst)
- [Commits](https://github.com/pallets/werkzeug/compare/0.15.5...2.2.3)

---
updated-dependencies:
- dependency-name: werkzeug
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>

* fix tests

* update dep

* Fix .net 7 test

---------

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Paul Dorsch <pauldorsch@microsoft.com>
2023-03-09 15:51:16 -05:00
snehapar9 1c0d98b9ef
Create extension methods for telemetry client (#1869)
* Added tests for php 8.2.0

* Revert "Added tests for php 8.2.0"

This reverts commit 857fd4bbe8.

* Added Application Insights to service provider builder

* Injected TelemetryClient as a dependency

* Updated telemetry client injection

* Replaced IOptions with TelemetryClient

* Updated LogDependencies

* Renamed to TelemetryClientExtensions

* Made changes releated to adding Telemetry Client

* Fix build failure

* Fixed version conflict

* Registered telemetry client service

* Added telemetry client as DI to hugo

* Registered telemetry client service

* Replaced logger with telemetry client

* Added overloaded method for LogTimedEvent

* Removed references to NLog

* Flush client

* Fixed indentation

* Added FlushOnDispose to options

* Rmoved NLog.config

* Removed FlushOnDispose

* Added license header

* Fix validation failures

* Test validation failures

* Mock telemetry client for testing

* Delete mock class

* Added telemetry client mock for testing

* Replace InstrumentaionKey

* Resolved PR comments

* Remove Moq

* Removed ORYX_AI_INSTRUMENTATION_KEY

* Resolved PR comments

* Replaced InstrumentationKey env

* Fix logging

* Add NLog for writing to a file

* Resolve PR comments

* Fixed typo

* Fix nightly failures

* Fix nightly failures

* Add new line

* Rename aiKey

* Delete ITelemetryClientMock.cs

* Remove Moq and fix build fails

* Remove references to mock class

* Remove Moq

* Replace connection string value for tests

* Remove unused namespaces

* Update intergration test

* Remove extra space

* Remove extra space

* Explicitly shut down NLog.LogManager

* Remove un-used build event props from DockerfileCommand.cs
2023-02-27 16:00:39 -08:00
william-msft edea6f6f63
Williamhe/1735613 remove 3.11.1 references from codebase (#1876)
* Remove 3.11.1 references

* Uncomment test

* Update runtime tag without python version 3.11.1

* Remove additional 3.11.1 reference
2023-02-09 07:40:45 -08:00
william-msft 8e1b90d65e
Update to skip test (#1875) 2023-02-08 13:16:21 -08:00
william-msft a21a42ccbb
Williamhe/Python.h error workaround (#1865)
* Update requirementstxt

* Update requirementstxt

* Add python cffi libary

* Add additional libaries to python

* Remove libffi6, not supported

* Add new library

* Update libraries

* Update pip gcc flags

* Add packages to build all optional python modules

* Add additional python module requirements

* Add integration test

* Update to test version 3.11.1

* Update after running generateConstants.sh script which distributes constants.yaml constants across Oryx repo

* Add python 3.11.1

* Remove bad package causing pipeline failure

* Remove bad package and add comments

* Remove unnecessary flag

* Remove sandbox storage account

* Remove additional packages for runtime

* Update dependencies

* Revert dependencies

* Update python runtime tag

* Update python version

* Update python version

* Add 3.8.16 python back

* Update runtime tag

* Update runtime tag
2023-02-08 09:29:58 -08:00
Paul Dorsch 636375356a
Pauld/1685848 update dependencies (#1791)
* updated all packages and resolved errors

* Revert "updated all packages and resolved errors"

This reverts commit ee12952289.

* updated all packages besides fxanalyzers

* resolve all build warnings

* fixing linting - temp commit

* fix all linting errors

* downgraded microsoft packages to ones that support version 3.1

* checked all dependencies for date, and uninstalled deprecated ones

* shared code generator now builds

* use versions for dotnet 3.1

* fixed bash scripts properties

* minor updates and removal of deprecated project

* re-ignored some tests that do not pass

* add valid connection string

* update connection string tests

* reverted ruleset

* Fix tests failing after change to default version

* Update failing test

* Fix or skip failing tests after default version update

Co-authored-by: Cormac McCarthy <corm@microsoft.com>
2023-01-11 10:18:34 -05:00
Cormac McCarthy 946f96a9f3
Fix or skip failing tests after default version update (#1802) 2023-01-10 09:27:52 -05:00
Paul Dorsch 9624bd2bff
Http request exception handling (#1743)
* add some exception handling and helpful error logging to failed http requests

* add simple test

* addressed pr comments: updated error messages and use environment.newline
2022-12-16 09:22:21 -05:00
snehapar9 615e6723ed
snehapar/add support for php 8.2.0 (#1697)
* Test php 8.2.0RC6

* Test php fpm 8.2.0rc6

* Added php 8.2 in constants.yaml

* Updated dockerfiles for php-fpm

* Added tests for php 8.2.0

* Revert "Added tests for php 8.2.0"

This reverts commit 857fd4bbe8.

* Added tests for PHP 8.2.0

* Updated gpg and sha keys

* Updated gpg keys and sha for php-fpm

* Updated gpg keys and sha

* Updated gpg keys and sha

* Modified build script for testing

* Revert build.sh changes

* Modified build scripts for testing

* Changed to executable

* Changed to exxecutable

* Fixed syntax error

* Updated runtime tag

* Updated tests for php 8.2

* Fixed syntax error

* Added php 8.2 integration tests

* Updated php version to 8.2.0

* Updated php version

* Removed changes for testing

* Remove condition to test

* Updated php version

* Updated php version

* Added new line

* Fixed typo

* Fixed typo

* Fixed typo

* Fixed gpg keys

* Updated gpg keys

* Updated PHP_URL

* Updated runtime tags for php and php-fpm

* Updated supported versions

* Removed 7.4 from SupportedRuntimeVersions.md
2022-12-14 10:01:29 -08:00
snehapar9 5efb1fd089
Add support for python latest versions (#1647)
* Add support for python latest versions

* generated constants

* Updated runtime tag

* generated constants

* Updated unit tests

* updated runtime tag

* updated constants

* Removed extra space character

* Added new python versions to all os types

* Updated tests

* Updated tests

* convert go fully to go.mod

* removed gopkg files, adn fully built all go packages with dependencies

* fixed tests to run on packages

* cleaned up scripts

* removed built exes

* make mod files consistent

* allow execution of the test packages script

* Fixed bug to download tarballs from storage account url supplied from pipeline

* Fix bug to download sdks from storage account url supplied from pipeline

* Add AddDefaultTestEnvironmentVariables

* Replcae SetEnvironmentVariable by AddDefaultTestEnvironmentVariables

* Commented out test for python 3.11

* Add support for python latest versions

* generated constants

* Updated runtime tag

* generated constants

* Updated unit tests

* updated runtime tag

* updated constants

* Removed extra space character

* Added new python versions to all os types

* Updated tests

* Updated tests

* Fixed bug to download tarballs from storage account url supplied from pipeline

* Fix bug to download sdks from storage account url supplied from pipeline

* fixed tests to run on packages

* cleaned up scripts

* Add AddDefaultTestEnvironmentVariables

* Replcae SetEnvironmentVariable by AddDefaultTestEnvironmentVariables

* Commented out test for python 3.11

* Add dotnet 7 to stretch / older images (#1667)

* add dotnet 7 to stretch / legacy images

* generated constants and supported versions, and updated the final stretch version for dotnet 7

* remove .NET7 condition on bindport2 (#1670)

* Pauld/switch go packages to go mod (#1671)

* convert go fully to go.mod

* removed gopkg files, adn fully built all go packages with dependencies

* fixed tests to run on packages

* cleaned up scripts

* removed built exes

* make mod files consistent

* allow execution of the test packages script

* added readme for updating and testing go dependencies

* Add support for python latest versions

* generated constants

* Updated runtime tag

* generated constants

* Updated unit tests

* updated runtime tag

* updated constants

* Removed extra space character

* Added new python versions to all os types

* Updated tests

* Updated tests

* Fixed bug to download tarballs from storage account url supplied from pipeline

* Fix bug to download sdks from storage account url supplied from pipeline

* fixed tests to run on packages

* cleaned up scripts

* Add AddDefaultTestEnvironmentVariables

* Replcae SetEnvironmentVariable by AddDefaultTestEnvironmentVariables

* Commented out test for python 3.11

* also add execution permissions for the restore packages script

* reordered testing shell script builder methods

* Updated error message

* Fixed astroid version conflict

* Fixed version conflict with astroid 2.8.0

* Fixed astroid 2.8.0 version conflict

* Addressed PR comments and resolved dependency conflict

* Resolved pyflakes version conflict

* Enabled test case to use default test env variables

* Resolved dependency conflicts

* Updated runtime tag

Co-authored-by: Paul Dorsch <pauldorsch@microsoft.com>
Co-authored-by: Paul Dorsch <107068277+pauld-msft@users.noreply.github.com>
Co-authored-by: waliMSFT <105239794+waliMSFT@users.noreply.github.com>
2022-11-18 11:06:24 -08:00
Paul Dorsch 02556b249f
Pauld/net 7 ga updates (#1660)
* updated constants to unstage the runtime image

* updated .net 7 constants, and added a .net 7 web app for testing

* more test updates

* updated tests, and generate constants to respect using empty lists

* finished updating tests for .NET 7

* removed skip from sanity check tests

* re-add fact to run storage account sanity checks

* Lock version of viper to 1.13.0

* fix base image logic

* Changed viper version to 1.10.0

* added go mod files to fix dependencies for go

* whitespace

* updated dotnetcore runtime base tag and generated constants

* minor mistakes and typo

Co-authored-by: snehapar9 <snehapar@microsoft.com>
2022-11-07 21:47:25 -08:00
waliMSFT b5830e08a1
Wali/1634821 adopting private dotnet binaries (#1644)
* dotnet7 private rc2 changes

* adopting private binaries

* adopting private binaries changes

* private binaries changes

* private binaries changes

* private binaires changes

* pr changes

* pr changes

* env variable fix

* temporary fix

* private binaries changes

* dotnet 7 private sdk binaries

* check for null token

* allow sas token to be used to pull default version

Co-authored-by: Paul Dorsch <pauldorsch@microsoft.com>
2022-11-01 20:55:30 -04:00
Zixuan Qian e4bd79a46f
Update (#1600) 2022-10-06 14:51:15 -07:00
Cormac McCarthy 3f416b1ee1
Split integration tests by platform version and build image (#1592)
* Split integration tests by platform version and build image

* Reduce number of runners required for integration tests

* Remove unused parameter from integration test templates

* Fix failing tests

* Fix other failing CLI buster test
2022-10-03 13:32:06 -07:00
Cormac McCarthy 6dbda65193
Split Python integration tests, remove Ruby from pipeline (#1587) 2022-09-27 09:15:47 -07:00
Zixuan Qian 056bbe2874
Install and add imagick package test coverage for PHP 8.0 and 8.1 (#1547)
* Add imagick package tests for php 8.0 and 8.1

* Add pdo_sqlsrv installation on 8.0 and 8.1

* Update PHP runtime image tags

* Update

* Update tags
2022-09-15 15:33:01 -07:00
Paul Dorsch 64b3f661c3
Pauld/1581775 include ostype in image tag (#1529)
* added support for ostype in image tag

* fixed dotnet, node, and ruby tests and fixed ruby's generateDockerfiles file

* added dynamic image versions to the tests

* updated build images to include debian flavor

* updated build images to include ostype in their image tag, and fixed a few tests to use the new tag

* starting a constants file for images to test on

* moved constants to image test helper, and updated tests to use github actions stretch constant

* updating tests to use constants so that we can switch the tag structure down the line with minimal code changes

* cli images use constant for testing

* fixing building images for new names

* fixed latest image for tests

* fix some more references to latest and lts versions

* updated test tag

* updated tests to respect the os type and os version combo

* fix building build images

* fix pulling and tagging for integration tests

* fix latest build

* updated new php-fpm tag text

* bug fixes and remaining hardcode cleanup

* resolve vso focal issue

* fix lts buster dockerfile

* lingering cli hardcode

* final tagging fixes and self review

* replace 'ubuntu-vso' with 'vso-ubuntu'

* pr feedback: renaming testing constants and resolving hardcoded buster in build images script

* tag latest image so that it is still accessible with the 'latest' tag

* made full tests consistent

* fixed remaining merge conflict

* update to gitignore for php

* update to gitignore for php attempt 2

* removed bullseye.Dockerfiles from git cache and reverted .gitignore

* added missing node 18 and python 3.11 to runtime image test helper
2022-09-07 14:26:26 -04:00
Zixuan Qian 236348ca32
Add node 18 and python 3.11 dynamic installation and runtime images (#1396)
* support python bullseye SDK

* add node 18 and python 3.11

Co-authored-by: Stella Qian <zixuan.qian@microsoft.com>
2022-09-06 10:44:39 -07:00
snehapar9 0f8eebe507
Concatenated blobs from multiple pages (#1545)
* Concatenated blobs from multiple pages

* Propogaated constants

* Addressed PR comments

* Replaced hardcoded "dotnet" by DotNetCoreConstants.PlatformName

* Added helper to list all blobs

* Fixed URL
2022-09-02 10:40:30 -07:00
Paul Dorsch a93a1521c7
Pauld/1597308 parameterize pipelines (#1534)
* add ability to pass in sdk base url as build arg

* parameterize storage account that platform binaries job uploads to

* added environment variable to control the storage account we use for testing

* update runtime and build image building so that it respects the passed in sdk storage account

* add some more parameterization to pipelines to allow for configurable storage accounts

* validation pipeline fix

* fix validation

* pass in parameter as variable

* add appsvc constant

* pass in parameters correctly

* make integration test use testing storage account, and add some versions that are missing

* allow platform binaries to be configured for different storage accounts

* add env var to integration testing

* removed added versions to build

* pr feedback: specify storage account name, fix some missing parameters, better logs

* make a dotnetcore 3.1 test use the testing storage account to pull SDKs
2022-08-30 13:45:28 -04:00
Paul Dorsch 7695943165
Final stretch version constants for dotnet 3.1 and 6.0 (#1539)
* added final stretch versions to mark end of uploading stretch sdks

* attempt to fix tests

* fix lts versions dockerfile

* saved file to fix final test

* pr feedback: renamed netcore31 runtime and fixed test to specific version
2022-08-30 09:07:41 -04:00
snehapar9 7b88aad858
Snehapar/1588872 upgrade golang version to 1.19 and change to bullseye (#1533)
* Upgrade golang to 1.19 and migrate to bullseye

* Generated Golang19Version

* Removed echo

* Made modifications to build full-bullseye image

* Modified full.Dockerfile to add buster

* Added tests for golang 1.18 and 1.19

* Replaced hardcoded build image name

* Modified test to handle full, full-buster,full-bullseye
2022-08-26 17:03:54 -07:00
snehapar9 a245a058aa
Snehapar/1583653 add support for dotnet 6.0.8 and 3.1.28 images and sdks (#1523)
* Added 6.0.8 sdks and runtime versions

* Added constants for 6.0.8 sdks and runtime

* Added sdks and runtime for 3.1.28

* Added constatns for dotnet 3.1.28

* Added runtime tag in constants.yaml

* Added Paul's change

* Updated runtime tag

* Added sdk versions for 3.1.28 and 6.0.8 for all debian flavors

* Updated runtime tag in constants.yaml

* Generated constants

* Modified test to use dev storage account for dynamic installation

* Modified unit test

* Added 6.0.8 sdks and runtime versions

* Added constants for 6.0.8 sdks and runtime

* Added sdks and runtime for 3.1.28

* Added constatns for dotnet 3.1.28

* Added runtime tag in constants.yaml

* Updated runtime tag

* Added sdk versions for 3.1.28 and 6.0.8 for all debian flavors

* Updated runtime tag in constants.yaml

* Generated constants

* Modified test to use dev storage account for dynamic installation

* Modified unit test

* Modified unit test to remove whitespace

* Updated runtime tag in constants.yaml

* Added dotnet 6.0.400 sdk to bullseye\versionsTobuild.txt

* Updated runtime tag

* Modified buildscript to pull sdks from dev storage account

* Deleted stretch/versionsToBuild.txt

* Added versionsToBuild.txt back - without dotnet 6.0.8 sdk
2022-08-23 23:32:18 -07:00
Cormac McCarthy 1f9a57ebe6
Pull Python 3.10 SDK from storage account for runtime image (#1521)
* Resolve issues with Python runtime images

* Remove setupEnv call for Python 3.10 which now builds with the same commands
2022-08-22 20:26:51 -07:00
waliMSFT e45c810dc9
run script changes (#1430)
* run script changes

* testing

* changes

* test for run changes

* Test for the run.sh task

* changes

* run.sh changes

* addressed PR commends

* run command integration test

* merged with main branch

* run command changes

* address pr changes

* customized run command for Node, PhP

* python run command change

* run command changes

* addressed PR changes

* bug fix
2022-08-16 15:59:37 -04:00
Paul Dorsch 35e9c4851a
Pauld/1559705 improve cli to detect viable sdks based on debian flavor (#1484)
* save point: splitting up versions to build by ostype

* restructured and modified the platforms scripts and updated the shared code generator to account for the new versions

* updated constants to include ostype change and newer python version

* added support for new file structure to the python dockerfiles and publishing from dev to prod sdks

* save point, starting to enrich all storage items with version number, and modifying tests for new logic

* clean up platforms shell scripts

* finish modifying scripts to add version to the metadata, regardless of OSType

* beginning to update cli to support pulling only relevant sdks

* added constants that relate to the different debian flavors we may see

* save point, added to constants yaml file to start adding support for pulling debian flavor sdks

* added debian flavor option to the build command, and starting to update tests to be compatible

* renamed the vso focal directories to focal scm, and fixed the sdk storage tests

* added a number of comments for the second PR and some tests to cover dotnet and node pulling the correct images

* added php and python tests for installing based on the available sdks

* updated sdk storage provider and platform installer to have bullseye images use buster sdks, since there are currently no bullseye sdks

* self reviewed pr: added comments, fixed some bugs and typos, and updated the pipeline scripts to correctly handle stretch images

* added default sdk storage metadata to be used for determining versions available

* added legacy versions to stretch version directories, so that the supported md file will contain the best information

* updated shared code generator to allow for the legacy versions text files

* update platform installation scripts to enrich the sdks with an updated version metadata name and the OS type

* some fixes for generating the platform binaries locally, and a fix for generating the maven binaries

* added legacy version metadata to storage constants

* updated the metadata names so that they exist in constants file and can be used throughout oryx

* saved leftover merge conflict file

* removed old default and versions to build files

* updated php fpm configuration to be in the constants.yaml file so that we support the generate constants script

* updated the debian flavor arg in the python template

* fix failing githubaction and vso focal tests

* saved file and added comment to version comparer

* fixed some spacing and added comments and a todo

* updated dotnet runtime version metadata to be backwards compatible

* use version info from elsewhere in oryx to streamline version comparing

* pr feedback, using constants during platform installation and sdk storage provider, and trimming whitespace from version files

* pr feedback: use constants for file names and renamed the new sdk versions metadata to be consistent

* limit bullseye sdks we push to storage to the ones that we know will be used by bullseye

* regenerated constants with updated bullseye versions, and removed extra logic in VersionInfo

* include all defaultVersion.txt files in the upload

* fixed spacing for vsts pipeline

* updated the maven base url to point to a source that contains legacy versions

* fixed php version sha

* use correct get pip url when version 3.6 and stretch

* add bullseye maven job

* added support to still build php 7.2 binaries

* allow enough time for php to generate and upload all sdks

* give php jobs 24 hours to run, as they have not been able to generate all versions in the given time

* updated python sdk generation to use the correct stretch buildpack for non-3.10 or greater versions

* updated logic so that python version 3.10 and above will have the correct prerequisites built

* updated common script to ignore whitespace differently

* readded deleted line and ran generate constants

* Pauld/1559705 PR2 cleanup and utilize bullseye images (#1497)

* initial pass at adding support for bullseye by resolving the PR2 todos

* allow build

* added test for php default versions

* added dotnetcore and python tests for invalid versions

* added more tests for correct pulling functionality

* support for finding default version with no debain flavor

* add working python versions

* whitespace

* added comments explaining the supported version logic, and fixed a statement to ensure that stretch images check for correct dotnet metadata

* add preview 7

* addressed PR comments by deleting un-needed method and adding comment
2022-08-15 13:35:32 -04:00
Zixuan Qian d56e28fb07
Update integration jobs and constant files (#1470)
* add php 8.1 and remove node 12 from integration jobs

* update constant files

* Revert "update constant files"

This reverts commit 4d62f63bd73958a79555729e213d88ab71fa052b.

* address feedbacks

* update

Co-authored-by: Stella Qian <zixuan.qian@microsoft.com>
2022-07-21 18:37:05 -07:00
Paul Dorsch 934a36dc82
Bugfix: storage account tests stopping at first empty line (#1482)
* updated storage account tests to view entire versions file, not stopping at the very first empty line

* trim lines in storage account tests to account for only whitespace lines
2022-07-19 11:52:28 -04:00
Paul Dorsch a1442955ff
Pauld/1551977 allow php fpm configuration (#1471)
* add some configuration to the startupscriptgenerator, and a test base

* added to startupscript generator to configure fpm before application run, and cooresponding tests

* added documentation surrounding the fpm configuration options, and configured the tests to include all of the fpm config options. Also lowered the amount of time waiting before checking for application readiness

* removed tests from sample php app

* removed the bullseye php dockerfiles

* bumped delaybetween retries back to 100

* give the php failures more time to pull the images before exiting the container

* condensed the php test invocations to a single method for sucess and failures, and added async to the naming

* remove php integration collection and update nightly tests to check more frequently for container liveliness

* updated docker cli to not duplicate code, and increased delay between tries in order to increase the max amount of time we take to wait for container startup

* revert nginx version

* update tags

* bumped the amount of time the container has to pull the image and fail to run the startup script, as it can occaisonally take a long time to pull and run

* address pr comments: styling and using isnullorempty for string comparison

* pr feedback: explained waiting for the container to start up and bumped the delay in between retrieving the host port to 10 seconds

Co-authored-by: Stella Qian <zixuan.qian@microsoft.com>
2022-07-18 20:19:37 -04:00