Граф коммитов

19 Коммитов

Автор SHA1 Сообщение Дата
kumaraksh1 7837b5a077
Add support for dotnet|6.0.31 and dotnet|8.0.6 (#2446)
* Update dotnet sdks

* update runtime version for dotnet|7

* update constants

* update constants
2024-06-11 16:20:45 +05:30
Sarath Chandra Bussa a4b0ab6e5c
Changes for Oryx pipeline migration. (#2430)
* SDKs and images onboard to onebranch

* removed V2 folder

* removed versions.txt

* not needed file

* these files are not auto generated

* gitignore

* Tests and other changes (#2441)

* tests changes

* fix

* empty

* these files are not auto generated

* gitignore

* tests fix

* githubactions fix

* tests fix

* fixes

* changes

* fixes

* changes

* changes

* jamstackInstallNode

* fixes

* commits

* changes

* fixes

* fixes

* fix versions

* publish sdks

* remove

* changes

* azcopy

* add creds

* hugo

* bug fix

* overrite logic fix

* command not found fix

* syntax fix

* enabling a few tests

* fix

* overrite

* enabled a few tests

---------

Co-authored-by: Sarath chandra Bussa <sbussa@microsoft.com>

* build images

* fix docker file

* remove set x and e

---------

Co-authored-by: Sarath chandra Bussa <sbussa@microsoft.com>
2024-05-31 16:30:11 +05:30
waliMSFT cb7d994701
Wali/oryx private environment setup 1675864 (#1878)
* setting up the private env

* private environment for build

* private account setup for buildBuildImages and buildRunTimeImages script

* copy sdks from prod to private staging account

* adding secrets to validation pipeline

* Authenticate with Azure DevOps

* env variable path bug fix

* debian package fix for nodejs

* fixed the local build issue related to the stretch package

* merged with main

* addressed PR change

* make the token hideen in local build
2023-07-10 15:11:03 -04:00
waliMSFT b5830e08a1
Wali/1634821 adopting private dotnet binaries (#1644)
* dotnet7 private rc2 changes

* adopting private binaries

* adopting private binaries changes

* private binaries changes

* private binaries changes

* private binaires changes

* pr changes

* pr changes

* env variable fix

* temporary fix

* private binaries changes

* dotnet 7 private sdk binaries

* check for null token

* allow sas token to be used to pull default version

Co-authored-by: Paul Dorsch <pauldorsch@microsoft.com>
2022-11-01 20:55:30 -04:00
Paul Dorsch 20c182c63e
Pauld/add support for backup storage account (#1572)
* updated storage account copy scripts to make sure that oryxprodbackup account will receive updates weekly

* added oryx prod backup constant and ran generate constants

* forgot job titles can't contain spaces

* once again forgot about the space
2022-09-21 09:10:35 -04:00
snehapar9 0f8eebe507
Concatenated blobs from multiple pages (#1545)
* Concatenated blobs from multiple pages

* Propogaated constants

* Addressed PR comments

* Replaced hardcoded "dotnet" by DotNetCoreConstants.PlatformName

* Added helper to list all blobs

* Fixed URL
2022-09-02 10:40:30 -07:00
Paul Dorsch a93a1521c7
Pauld/1597308 parameterize pipelines (#1534)
* add ability to pass in sdk base url as build arg

* parameterize storage account that platform binaries job uploads to

* added environment variable to control the storage account we use for testing

* update runtime and build image building so that it respects the passed in sdk storage account

* add some more parameterization to pipelines to allow for configurable storage accounts

* validation pipeline fix

* fix validation

* pass in parameter as variable

* add appsvc constant

* pass in parameters correctly

* make integration test use testing storage account, and add some versions that are missing

* allow platform binaries to be configured for different storage accounts

* add env var to integration testing

* removed added versions to build

* pr feedback: specify storage account name, fix some missing parameters, better logs

* make a dotnetcore 3.1 test use the testing storage account to pull SDKs
2022-08-30 13:45:28 -04:00
Paul Dorsch 35e9c4851a
Pauld/1559705 improve cli to detect viable sdks based on debian flavor (#1484)
* save point: splitting up versions to build by ostype

* restructured and modified the platforms scripts and updated the shared code generator to account for the new versions

* updated constants to include ostype change and newer python version

* added support for new file structure to the python dockerfiles and publishing from dev to prod sdks

* save point, starting to enrich all storage items with version number, and modifying tests for new logic

* clean up platforms shell scripts

* finish modifying scripts to add version to the metadata, regardless of OSType

* beginning to update cli to support pulling only relevant sdks

* added constants that relate to the different debian flavors we may see

* save point, added to constants yaml file to start adding support for pulling debian flavor sdks

* added debian flavor option to the build command, and starting to update tests to be compatible

* renamed the vso focal directories to focal scm, and fixed the sdk storage tests

* added a number of comments for the second PR and some tests to cover dotnet and node pulling the correct images

* added php and python tests for installing based on the available sdks

* updated sdk storage provider and platform installer to have bullseye images use buster sdks, since there are currently no bullseye sdks

* self reviewed pr: added comments, fixed some bugs and typos, and updated the pipeline scripts to correctly handle stretch images

* added default sdk storage metadata to be used for determining versions available

* added legacy versions to stretch version directories, so that the supported md file will contain the best information

* updated shared code generator to allow for the legacy versions text files

* update platform installation scripts to enrich the sdks with an updated version metadata name and the OS type

* some fixes for generating the platform binaries locally, and a fix for generating the maven binaries

* added legacy version metadata to storage constants

* updated the metadata names so that they exist in constants file and can be used throughout oryx

* saved leftover merge conflict file

* removed old default and versions to build files

* updated php fpm configuration to be in the constants.yaml file so that we support the generate constants script

* updated the debian flavor arg in the python template

* fix failing githubaction and vso focal tests

* saved file and added comment to version comparer

* fixed some spacing and added comments and a todo

* updated dotnet runtime version metadata to be backwards compatible

* use version info from elsewhere in oryx to streamline version comparing

* pr feedback, using constants during platform installation and sdk storage provider, and trimming whitespace from version files

* pr feedback: use constants for file names and renamed the new sdk versions metadata to be consistent

* limit bullseye sdks we push to storage to the ones that we know will be used by bullseye

* regenerated constants with updated bullseye versions, and removed extra logic in VersionInfo

* include all defaultVersion.txt files in the upload

* fixed spacing for vsts pipeline

* updated the maven base url to point to a source that contains legacy versions

* fixed php version sha

* use correct get pip url when version 3.6 and stretch

* add bullseye maven job

* added support to still build php 7.2 binaries

* allow enough time for php to generate and upload all sdks

* give php jobs 24 hours to run, as they have not been able to generate all versions in the given time

* updated python sdk generation to use the correct stretch buildpack for non-3.10 or greater versions

* updated logic so that python version 3.10 and above will have the correct prerequisites built

* updated common script to ignore whitespace differently

* readded deleted line and ran generate constants

* Pauld/1559705 PR2 cleanup and utilize bullseye images (#1497)

* initial pass at adding support for bullseye by resolving the PR2 todos

* allow build

* added test for php default versions

* added dotnetcore and python tests for invalid versions

* added more tests for correct pulling functionality

* support for finding default version with no debain flavor

* add working python versions

* whitespace

* added comments explaining the supported version logic, and fixed a statement to ensure that stretch images check for correct dotnet metadata

* add preview 7

* addressed PR comments by deleting un-needed method and adding comment
2022-08-15 13:35:32 -04:00
Paul Dorsch 7609df04ce
Add job to move sdks from prod to another storage account (#1499)
* Job to revert dev sdks to what is in prod

* renamed

* renamed various files and functions to be clearer and demonstrate functionality better

* added new sdk storage constant for sandbox account

* corrected storage account constant and updated copy script

* finalized logic to copy entire blob container to new storage account

* updated sdks job to have a dry run parameter, and to have actual parameters instead of variables

* made dry run default in case of empty val

* Pauld/sandbox to prod (#1501)

* Point python 3.6 get-pip to new source (#1498)

* add additional logic for python 3.6 download, pointing at another get-pip source

* fixed placement

* added pipeline that copies from a source storage account to the production one

* added parameters and dry run capabilities

* add clearer error message in case of bad argument
2022-08-08 12:44:32 -04:00
Arjun Roy Chaudhuri c2314bce46
Add run time buster images for oryx (#592)
* update 1

* update 2

* update node runtime base image creation

* update yarn-cache php and php-fpm runtime bases

* fix php base image docker file generation

* update few more runtime images

* update image_base argument to debian_flavor

* update

* udpate

* update

* update

* update

* update

* update python dockerfile argument for debian flavor

* update dotnetcore base images

* update

* update

* update

* update

* update

* update

* udpate based on codeflow review

* update
2020-06-08 10:56:51 -07:00
Zixuan Qian 574203296e
Update SDK storage Urls to production (#566)
* change sdk storage urls to prod

* apply dns url to cdn
2020-04-20 15:22:34 -07:00
Kiran 47bd796d3a
Do not delete the default Python binaries and update path dynamically based on environment variable (#553) 2020-04-08 18:45:19 -07:00
Kiran fe43df757f
Added a sentinel file to indicate earlier download was successful (#539) 2020-03-27 09:40:33 -07:00
Kiran 5e3a86b966
Make CDN ednpoint the default for Prod scenarios (#538) 2020-03-25 13:39:24 -07:00
Kiran 74ffb2f0a7
Make dynamic install controllable by an environment variable (#533) 2020-03-21 17:47:02 -07:00
Kiran 2046de9bc7
Cleanup: moved few sdk storage strings to constants.yaml (#520) 2020-03-10 12:38:32 -07:00
Kiran f5df5ebb3a
Ignore case when reading blob metadata (#511) 2020-03-02 13:19:27 -08:00
Kiran 3db6a7b373
Install sdks dynamically-part2. Python sdks installation (#478) 2020-02-18 15:41:25 -08:00
Kiran b4c7587a55
Install sdks dynamically-part1 (#475) 2020-02-04 18:50:00 -08:00