Граф коммитов

135 Коммитов

Автор SHA1 Сообщение Дата
aaronburtle 347bdad7a6
Add SQL Server 2022 workflow contained on runner VM with Python (#118)
* pthon installation

* configure python for MLS

* add python client install and tests

* add env variable passwords

* add some doc links use most recent python install version

* whitspace/format

* add logging for python installation

* add passive for python install

* try remove previous python installs

* using python-setup

* new strategy for Python installation

* use github native python path

* add explicit user and pw

* add explicit user and pw

* add explicit user and pw

* add explicit user and pw

* add explicit user and pw

* update some names continueOnError
2024-07-12 13:52:03 -07:00
aaronburtle ee717fa673
add newline update to v4 for checkout (#119) 2024-06-27 15:13:06 -07:00
Sean Leonard 095fdc813b
Update README.md formatting (#109) 2024-06-27 15:12:03 -07:00
aaronburtle 8c39055d59
Add SQL Server 2019 workflow contained on runner VM (#110)
* sqlserver19 install

* format

* format

* format

* format

* format

* try curl instead of wget

* try without cab files

* enable external script

* add env variables

* hard code values

* change connect string

* change connect string

* change connect string

* separate sql server 19 into base and CU

* separate sql server 19 into base and CU

* separate sql server 19 into base and CU

* format

* try to install from setup.exe

* sql19 vanilla install with params

* curl cab files and use MRCACHEDIRECTORY param

* formatting

* use C: for cabinet files

* use cwd for cab files

* format

* format

* use currentdir for cache

* use currentdir for cache

* format

* checking if known good yaml has internal server error

* format

* format

* format

* use redirect for curl

* save choco logs as artifact

* format

* run always the log artifact step

* use SA account and set to random password

* use random password to connect to SA:

* use github syntax for setting env variable

* format

* use cmd for pw generation

* pw generated now so log errors

* use sql security mode

* add letters and special char to pw

* add letters and special char to pw

* add letters and special char to pw

* enable TCP

* localhost for connection string

* format on Enable External Scripts

* add R tasks

* get files after checkout

* get files after checkout

* try backup

* remove go

* checking syntax

* add python to job

* remove matrix

* proper naming

* move logs to after CU update which is failing now

* typo in enable external script

* format

* use explicit python version

* SPEES execute for R and Python

* missing R dependencies so dont check R

* format

* format

* format

* move SPEES task

* reconfigure in own command

* missing params

* accept license terms missing

* python spees script format

* change name to deconflict for PR

* revert ci.yaml

* whitespace

* whitespace

* address comments

* log name

* continue on error

* try not to display pw in output

* fix log name

* try save good password without printing

* try save password without displaying

* try save password without displaying

* try save password without displaying

* continue on error

* change name to be more descriptive

* change name to be more descriptive

* better name

* change name in pipeline

* change name

* make name legal

* make name legal

* add users and logins and env vars for them

* newline

* remove newline
2024-06-27 14:43:07 -07:00
Sean Leonard 60d4099745
Updated GitHub Actions to latest version of actions/checkout which is 4 per https://github.com/actions/checkout/releases to remove node 12/16 deprecation warning. (#117) 2024-06-27 14:42:05 -07:00
Sean Leonard ec010824c6
add codeowners (#116) 2024-06-27 14:39:41 -07:00
Sean Leonard ae041a3b9d
remove Travis assets. Using GitHub Actions now. (#112) 2024-06-27 14:39:23 -07:00
aaronburtle bbf197df33
Add SQL Server 2022 workflow contained on runner VM with R runtime (#111)
* sql server install, airlines DB restore

* update commands remove CU

* change ci.yaml to run workflow in GHA

* add R installation for MLS

* add airline db users and permissions

* typo

* use correct DB

* typo

* typo

* revert ci.yaml move to SQL2022.yml

* just R for this PR

* name from 19 to 22

* change name in pipeline

* make name legal

* make name legal

* change cran address, add env variables for users

* change how we get dbpassword

* change env variable used for airline users

* use correct name for env vars

* add Rtools to package install

* add additional package installs

* escape char

* explicit libs in package install, remove duplicate and rtools

* try install rtools

* address comments
2024-06-27 14:03:41 -07:00
Sean Leonard 1060aef964
Update CRAN repo to latest, fix one test using removed CRAN packages, ignore another (#113)
* sql server install, airlines DB restore

* update commands remove CU

* change ci.yaml to run workflow in GHA

* add R installation for MLS

* add airline db users and permissions

* typo

* use correct DB

* typo

* typo

* revert ci.yaml move to SQL2022.yml

* just R for this PR

* name from 19 to 22

* fix cran link

* update package assertive.base to abc.data to fulfill test requirements of having special character in name and no/minimal dependencies. Assertive.base is no longer on cran.

* remove yaml as unrelated to pr. add newline per github warning
2024-06-27 13:17:59 -07:00
Sean Leonard 47c480fd3d
Dev/seleonar/r packagename parsing (#107)
* Fix filepath parsing and break large function into smaller chunks for easier testing and readability

* add unit tests for file parsing function and file existence function

* Add return statement so package list is populated
2022-12-13 08:40:30 -08:00
Sean Leonard b888ff1e87
Migrate Pipeline to Self-Hosted Runners and Remediate Tests (#104)
* GH runner pool support
with fixed tests.

* skip slow python test
remove legacy TravisCI skip tags.

* Fix R coercion to logical 1 error

* add sql MI

* update spacing.

* reduce code duplication and remove erroneous space
that caused issues

* remove conditional

* consolidate code and add conditional

* remove continue on error.

* Concise step title.

* fix R version
2022-08-29 11:32:21 -07:00
Sean Leonard 1f36ef30f9
Update Python Support for Python 3.10.5 with Integration Test Fixes (#101)
* Updated test packages due to
legacy package errors.

* Support for special character
connection string pwds

* Updated test_no_output composition

* Fix test script.

* test comments

* update version number

* skip long running test.

* Update skipped tests to not have long running python package install test.

Co-authored-by: Sean Leonard <seleonar@microsoft.com>
2022-08-15 17:05:37 -07:00
microsoft-github-policy-service[bot] 1273edd4d5
Microsoft mandatory file (#102)
Co-authored-by: microsoft-github-policy-service[bot] <77245923+microsoft-github-policy-service[bot]@users.noreply.github.com>
2022-08-15 16:49:46 -07:00
Sean Leonard 054c248f7c
Fix R Unit Tests and Invalid Cursor State Occurrences (#100)
* Fix code causing 'length(x) = 5 > 1' in coercion to 'logical(1)' warning.

* fix failing func execute in sql test due to differing environments

* add unittest for getServerVersion to detect bad cursor error on odbc

* add new R 4.2 to test workflow.

* adjust comment text and variable name

* Fix for spees generation codepath triggering cursor state invalid error

* Fix warning  longer object length is not a multiple of shorter object length

* support for special characters in connection string password

* updated version number of R package to 1.2.1 in DESCRIPTION

* update CRAN snapshot reference

Co-authored-by: Sean Leonard <seleonar@microsoft.com>
2022-07-11 09:24:18 -07:00
Sean Leonard 27612c6df1
Improve R Package Dependency Resolution and Script Execution Time (#99)
* When resolving dependencies, consolidation of duplicates keeps binary pkgs. Dependency Calculation doesn't fetch linkingTo packages for binary pkgs.

* Comment style for function now consistent. Updated comment phrasing

* Removed hardcoded cran repo check and add proper data.frame row count check. Added tests for LinkingTo package inclusion for binary vs source.

* Spacing consistency with connectionString argument

* Adjust test for purpose of checking source package installed due to successful compilation from source
2022-03-21 11:08:49 -07:00
Sean Leonard f27e8f1495
Update Pipeline Config and Fix Unit Test Execution in GitHub Actions (#97)
* Update pipeline with latest r-lib actions.

* Update readme to include build status GHA

* force upated testthat package to >= 2.0.1

* remove snapshot reference.

* new cache

* Fix cause of Invalid Cursor State

* Add fix for failing tests in CI

* Remove commented code in ci yaml
2022-02-25 12:18:10 -08:00
Sean Leonard f4b84b6769
Signing Add on: parameter to allow manually triggering github action workflow (#96)
Merging to enable feature branch testing. Will utilize for fixing unit test failures.
2022-01-21 16:38:26 -08:00
Jarupat Jisarojito 35a33ef82c
Migrate CI to github actions (#94)
* Migrate CI to github actions

Migrate to github actions because Travis CI is not supported and
recommended by Microsoft github organization anymore.

Fix some python tests
test_dependency_spec
change package from "azure_cli_telemetry" to "beautifulsoup4"
because even when we uninsatll azure_cli_telemetry, azure module is
still
available from other package.

test_installing_popular_ml_packages
Update the package and use correct module name for the package.
Previous code will use packagename with version number as a module. This
caused test failure.

Signed-off-by: Jarupat Jisarojito <guitarnana@gmail.com>

* Add github workflow file.
2021-11-03 15:42:40 -07:00
Mario S d0812a2c35
Update sqlPackage.R (#87)
* Update sqlPackage.R

sqlRemoteExecuteFun needs languageName to work

* Update sqlPackage.R

removed comment
2021-06-21 15:08:10 -07:00
Nikita Takru 3f303872e9
Updating docs to show how to use the same local version and binary packages for Windows servers (#88)
* Update for using the same local version and binary packages for Windows servers.

* Query to get the version of R the server is currently using

* Additional details for proper configuration

* Minor fix

* Fixing the formatting
2021-06-17 16:33:51 -07:00
Jonathan Zhu d154f6a6f2
Fix tests and remove binaries (#86)
* Fix tests and remove binaries

* add R files
2021-03-15 20:32:30 -07:00
Jonathan Zhu 3d694f29ea
Update README.md 2020-12-16 14:09:42 -08:00
Jonathan Zhu dc89449967
Update README.md 2020-12-15 18:36:09 -08:00
Jonathan Zhu c6ff0841aa
Add external language support (#82)
Add external language support - users can add a language_name to run on an already installed external language.
2020-10-27 13:56:37 -07:00
Jonathan Zhu 2070d75918
Set max wheel version for pep425tags (#83)
* max wheel version and sysconfig

* update version to 1.0.3
2020-10-13 10:49:13 -07:00
Jonathan Zhu 682873d2e8
Jonathan zhu11/source (#80)
* update dist files
2020-08-20 17:45:40 -07:00
Jonathan Zhu 57d7527e6a
Jonathan zhu11/source (#77)
* Build source packages on the client, if the server matches (windows or unix)

* update version number
2020-08-20 15:20:48 -07:00
Jonathan Zhu 53f42ab253
Add Travis CI for Python (#74)
- Add Python testing to the Travis-CI
- pip moved away from holding pep425tags in their codebase in pip version 20+, so we just import from wheel instead.
- The way we resolved requirement specs was not the most robust. We can just use pkg_resources's Requirement class functionality instead of writing our own. In particular, our original implementation did not work with "~=".
- Removed a number of tests that were redundant. These tests were fine when run on the user machine, but when run on the Travis-CI server they will time out.
2020-08-07 16:17:27 -07:00
Jonathan Zhu b0d8c1b456
Add back in old zips for ADS purposes, to remove later (#73) 2020-07-15 20:28:45 -07:00
Jonathan Zhu 8eb6408e9b
Add check login test (#71)
* Add check login test
* Update packages
2020-07-13 11:32:01 -07:00
Jonathan Zhu 6a343b69ec
Jonathan zhu11/odbc testing (#70)
* Change all sql package calls to use odbc instead of RODBC

* style fixes

* remove references to RODBC

* comment and whitespace changes

* Add timeout to 60 minutes in Travis-CI
2020-07-09 10:08:43 -07:00
Jonathan Zhu 50e09d93a3
Fix check for managed instance and update version number (#69) 2020-06-15 11:50:49 -07:00
Jonathan Zhu 57c00094f9
Change pyodbc connection from using args to using string (#67) 2020-05-29 16:21:43 -07:00
Jonathan Zhu 3b1398f66b
Add dist folder back (#64) 2020-04-07 14:16:03 -07:00
Jonathan Zhu 4a082eafdf
Modify READMEs for R installation (#63)
* Update repo from which RODBCext is found

* Add tar.gz for linux

* fix READMEs for RODBCext

* remove titling

* add extra space
2020-04-07 11:34:37 -07:00
Jonathan Zhu d5f8f80d69
Update repo from which RODBCext is found and add tar.gz (#62)
* Update repo from which RODBCext is found

* Add tar.gz for linux
2020-04-07 11:19:27 -07:00
Jonathan Zhu 3607b4b22f
Update README to remove pymssql reference
Update README for changes that came with sqlmlutils 1.0.0. No more pymssql and output parameters now work.
2020-03-25 11:58:12 -07:00
Jonathan Zhu dade183979
Change pymssql -> pyODBC (#58)
Major changes to sqlmlutils internal implementation. User experience should be largely the same as before, except with the addition of output parameters.

* Change to pyodbc instead of mssql
* Add print capture to exec
* Add Output Param support and stdout/err in sprocs
* change testing for python package management
* README updates
* Fix license headers
* Update version number to 1.0.0
2020-03-24 10:10:46 -07:00
Jonathan Zhu 1c82b56e68
Use sys.executable instead of hardcoded "python" (#59)
* Use sys.executable instead of hardcoded pyhton

* update requirements for pymssql

* update version to 0.7.3
2020-03-04 15:23:34 -08:00
Jonathan Zhu 07cb8a335d
Jonathan zhu11/readme (#57)
* Update README to be more concise and accurate

* Added an extra line in top level README to direct users to language-specific READMEs
2020-02-03 14:16:29 -08:00
Jonathan Zhu 660ac7bc48
Update for pip change in main structure (#52) 2019-11-01 12:46:22 -07:00
Jonathan Zhu 97ab5737b6
Update README to use a smaller package
Use astor instead of tensorflow for example package to install. Tensorflow is too large and takes too long, it is not a good example package.
2019-10-31 10:38:15 -07:00
Rahul Ajmera ddaa0f8aee Update README.md (#50) 2019-10-23 15:32:50 -07:00
Jonathan Zhu 0af29cfe8d
Merge pull request #49 from microsoft/JonathanZhu11/releaseForPyPI
Add and modify files for PyPI release
2019-10-15 14:54:20 -07:00
Jonathan Zhu a5d6867fce rename back no extension license 2019-10-15 14:15:00 -07:00
Jonathan Zhu 43a27dc37a Add and modify files for PyPI release 2019-10-15 12:07:48 -07:00
Jonathan Zhu 0703884ee8
Merge pull request #48 from microsoft/JonathanZhu11/outFile
Jonathan zhu11/out file
2019-10-02 16:56:54 -07:00
Jonathan Zhu 500cb9deb2 Fix transaction logic 2019-09-26 15:17:23 -07:00
Jonathan Zhu 314e6fd3cd Merge branch 'master' of https://github.com/Microsoft/sqlmlutils into Jonathanzhu11/outFile 2019-09-26 15:10:16 -07:00
Jonathan Zhu 9f816eec81 fix string escaping 2019-09-24 17:30:17 -07:00