Граф коммитов

35 Коммитов

Автор SHA1 Сообщение Дата
Brian Hoang 96bfc22662
Fix: Upgrading to R Batch SDK to 2018-12-01.8.0 (#354)
* Added resource files

* Added resource files

* Removed comments

* Fixed resource files documentation

* Added check on job state

* Fixed jobState
2019-06-18 21:04:30 -07:00
Brian Hoang 975858072e
Fix: Test Coverage on Azure Pipeline CI (#348)
* Added build.sh

* Fixed tests

* Added pipeline yml

* Fixed pipeline

* Removed

* Passing in args to script

* Added container image

* Fixed args

* Fixed args

* Fixed args

* Removed last script

* Added test management

* Added job dependency

* Moved package installation to build.sh

* fixed

* Added job dependency

* Added RProfile site

* Fixed REnvironment

* Added Rprofile

* Added ~/

* Fixing tests

* fixed method name

* Renaming samples & tests

* renamed more tests

* Fixed lint

* Removed other tests

* Fixed directory call for testthat

* Added typo and remove sample

* Fixed pipeline pointer
2019-02-13 21:36:40 -08:00
Brian Hoang 96081cca9a
Fix: File share sample (#312)
* Fixed sample

* Removed unchanged file name

* removed account

* Removed custom script
2018-09-18 14:44:00 -07:00
Brian b24f20c1f1
Switched to R6 sas client (#276)
* Switched to R6 sas client

* Added storage endpoint suffix
2018-05-18 11:03:43 -07:00
Brian 20c86f16ed
Feature/custom package (#272)
* Added custom package script

* Added feature custom download

* Fixed typo

* Fixed directory for installation

* Fixed full folder directory

* Add dependencies and fix pattern

* Fix pattern not found

* Added repo

* Switching to devtools

* Fixing devtools install with directory

* Fix in for merger.R

* Working cluster custom packages

* Removed printed statements

* Working on custom docs

* Custom packages sample docs

* Fixed typo in azure files typo

* Fixed typos based on PR
2018-05-14 13:47:00 -07:00
Chris Auld b6fbcda5a9 Fixing change of named parameter in makeCluster (#259)
Parameter name looks to have changed. Fixing. There are still some issues that I will open a separate ticket for.
2018-04-30 09:40:57 -07:00
zfengms 0fbfd4cb07
Feature/pkgmgmtdoc (#231)
* merge package management doc

* merge packagement docs

* address review feedback (#232)

* address review feedback

* add reference to github and bioconductor packages in worker

* update package management sample

* update package management doc (#233)

* address review feedback

* add reference to github and bioconductor packages in worker

* update package management sample

* update package management doc

* remove cluster.json

* remove package installation
2018-04-26 00:50:38 -07:00
Pablo Selem fa75afbbd2
fix sample link to sas resource files (#254) 2018-04-23 12:29:30 -07:00
Pablo Selem 3b0c08742b
Sample - Add a sample for using SAS resource files (#253)
* resubmit sas resource files example

* fixed typos and grammar

* remove unnecessary github reference
2018-04-23 11:08:08 -07:00
Brian fa2cdfc57b
Added cluster config for caret example (#237)
* Added cluster config for caret

* Reverted changes for installation

* Reverted fit model

* Changed to low priority
2018-03-20 21:20:47 -07:00
Pablo Selem cf02943ae6
Update sample to only use the first 6 files (#228)
The file format change over the year so only use the first 6 so the sample is consistent. This also has the added benefit that the sample runs a bit faster so users can get a feel for the tooling a bit more easily.
2018-02-23 10:15:03 -08:00
Ronan O'Malley 00373b9a1e Update long_running_job.R (#206)
renamed a misnamed azure options variable
2018-01-24 10:11:35 -08:00
zfengms cbbe32b9d2
Feature/longrunjob, long running job improvement, add deleteJob and terminateJob (#174)
* add documentation and sample for long running job

* update sample file name

* update long running job doc and test

* update metadata code

* add errorHandling to job metadata

* add deleteJob to delete both job defintion and job result

* styling fix

* save foreach wait setting to metadata

* implement retry logic in getjobresult

* add terminateJob

* handle various corner cases

* regenerate document

* add job state in getJob

* do not fail getJobResult if getMetadata failed for backward compatibility

* add deleteJob option to foreach, by default it is true for wait=TRUE job

* styling fix

* update version and changelog

* address review feedback

* add setJobAutoDelete function

* rename jobAutoDelete to autoDeleteJob to workaround R bugs and update docs

* update faq

* fix styling issues

* more styling fix

* roll back manual update to DESCRIPTION

* add namespace to api call
2017-12-06 16:51:50 -08:00
zfengms 5f1afc7929
Feature/configfromobj support programmatically created credentials and cluster configs (#168)
* support programmatically generated credentials/cluster config

* update docs for programmatically generated config

* reformat code

* styling fixes

* combine credentials cluster config methods

* fix set credentials issue and test input

* do not create az_config.json

* update messages

* move githubAuthenticationToken from cluster config to credentials
2017-11-16 23:18:09 -08:00
Pablo Selem a6e51c964e
Feature/container (#153)
* force add PATH to current user

* checkin docker setup script

* Update cluster_setup.sh

* install docker and start container on cluster setup

* WIP: Run task in container

* fix merge conflict

* run tasks and merge task from within container

* refactor code to proper docker commands and make a single R container per job

* refactor command line utils into its own file

* refactor job utilities into its own file

* move cluster setup script to inst folder

* remove unnecessary curl installs

* remove starting container from setup script

* check in WIP

* add apt_install file

* make required directories

* update cluster setup files as needed

* include libxml2 packages in apt installs

* working cluster create with cran and github dependencies

* update job prep to install apt-get and not each task

* use rocker containers instead of r-base

* remove unused & commented code

* remove unused install function

* address several lintr issues

* initial test dockerfile

* add spacing between commands

* temporarily point wget to feature branch

* update bioconductor install for non-jobPrep installs

* Delete Dockerfile

* minor changes to install bioc

* resolve merge conflicts

* update cluster to correctly install BioC packages using install_bioconductor

* fix issue where some packages were not getting installed

* add missing BioConductorCommand initializer

* remove print lines

* initial dockerfile implementations

* update docker files

* Only install packages if they are required

* Remove requirement on bioconductor installer script on start task

* remove duplicate environment variable entry

* update docs for container support

* update version to 0.6.0

* refactor changes updates

* remove poorly formatted whitespaces

* add full path to pacakges directory

* fix docker command line

* update file share sample

* update azure files cluster name

* update mandelbrot sample

* update package management sample

* update plyr samples

* make montecarlo sample more consistent

* update montecarlo sample

* remove plyr example

* fix bad environment pointer

* fix linter issues

* more linter fixes

* more linter issues

* use latest rAzureBatch version

* update resource files example

* remove reference to deleted sample

* pr feedback

* PR docs feedback

* Print errors from worker (#154)

* Fixed pool package command line lintr test

* Package installation tests fixed - too long lines

* Fixed json in customize cluster docs

* Fix: Typos in customize cluster docs

* Cleaning up files

* Feature/githubbiopackage (#150)

* install github package worked for foreach loop

* fix lintr error

* tests for github and bioc packages installation

* lintr fix

* add back lost code due to merge and update docs

* The Travis CI build failed for feature/githubbiopackage

* remove incorrect parameter for install_github

* Updated job prep task to have default command

* Use the latest version of rAzureBatch

* Updated description + Generate cluster config

* Fix: Bioconductor and Github packages installation (#155)

* Added multiple package install test and fix obj reading args

* Fixed naming for packages install

* Replaced validation exclusion for linter

* Fixed test validate test

* Fixing all interactive tests with skip

* Fixed renaming validation

* Removed default test - cannot be tested

* Removed  in validation

* Added cluster package install tests (#156)
2017-11-03 10:06:40 -07:00
zfengms 36fadf4287 Feature/longrunjobdoc (#139)
* add documentation and sample for long running job

* update sample file name

* update long running job doc and test
2017-10-10 17:27:18 -07:00
Pablo Selem 0744c437b6 fix bioconductor package install docs for multi-task race condition (#135)
* fix bioconductor package install docs for multi-task race condition

* fix typos

* remove docs on updating an existing cluster's packages from within the foreach loop

* support an install_bioconductor.R script

* update docs with working sample
2017-10-03 08:28:05 -07:00
Pablo Selem 9cd24f6d95 For BioConductor install, force remove MRO 3.3 prior to installing MRO 3.4 (#120)
* force add PATH to current user

* Update bioc_setup.sh
2017-09-19 10:55:39 -07:00
Pablo Selem 0f3654f7df point raw scripts at master branch (#118) 2017-09-18 09:34:58 -07:00
Pablo Selem 9645883ff1 Feature/add azure files cluster config (#108)
* initial command line instructions for bioconductor

* initial startup scripts for installing bioconductor

* fix if then syntax

* force update node environment with update path for R runtime

* install bioconductor

* wrap bioconductor install command in Rscript

* bioconductor sample docs

* update bioC docs

* remove .gitignore rule for .json files

* add pointer to BioC cluster config from docs

* add missing azureFiles cluster config to samples
2017-09-07 13:49:28 -07:00
Pablo Selem 661e2515a2 Feature/bio conductor docs (#106)
* initial command line instructions for bioconductor

* initial startup scripts for installing bioconductor

* fix if then syntax

* force update node environment with update path for R runtime

* install bioconductor

* wrap bioconductor install command in Rscript

* bioconductor sample docs

* update bioC docs

* remove .gitignore rule for .json files

* add pointer to BioC cluster config from docs
2017-09-07 09:39:03 -07:00
Brian 88ee21dd36 Updating documentation for default container permission settings (#88)
* Added containers default setting comment in docs

* Fixed new line with sas tokens

* Updated documentation with suggested comments

* Fixed relative url
2017-08-29 12:14:18 -07:00
Pablo Selem bac0109885 refactor sample directory and add azure_files sample (#83)
* refactor sample directory and add azure_files sample

* pr feedback. Add notes around limited support for non-azure files mounting
2017-08-28 11:15:00 -07:00
Brian d8bcd6f52f Fixed resource file samples (#33) 2017-06-26 11:57:54 -07:00
JS 15c13c84fe Update montecarlo_pricing_simulation.R 2017-05-26 11:07:30 -07:00
JS ae6b448102 Update README.md 2017-05-25 14:29:03 -07:00
JS 5e2b450916 Update caret_example.R 2017-05-25 14:25:02 -07:00
Brian 19ee363c88 Edited sample resource files doc
Changed the createSasToken with correct parameters
2017-05-25 13:25:31 -07:00
Brian 8c35a36568 Fix/export (#21)
* Added autoscale formula

* Fixing resource files example
2017-05-24 21:12:03 -07:00
JS a4b38269e2 Update resource_files_example.R 2017-05-24 16:24:16 -07:00
JS b9e541b219 Update plyr_example.R 2017-05-24 16:24:03 -07:00
JS 8d4837eefd Update montecarlo_pricing_simulation.R 2017-05-24 16:23:50 -07:00
JS 2f744c3bf5 Update caret_example.R 2017-05-24 16:23:34 -07:00
Brian 02c5eac6bf v0.3.0 Release (#20)
* Added set chunk size

* Adding resource files on pool creation

* renaming generate file functions

* Moved worker/merger scripts to doAzureParallel and created common job env

* Added stdout and stderr logs in uploads

* added to docs / README

* Switched params for cluster and added examples

* setCreds, resizeCluster, job management

* cred generator update

* Added samples, moved autoscale, and low-pri/output files

* Added documentation on methods for ??R feature

* Added export for makeCluster

* Namespace missing export

* clusterSetting param name

* cluster id param name

* NumOfNodes param for wait nodes completion fix

* Added proper naming for registerDoAzureParallel

* readme update'

* typo readme

* low pri in readme

* monte carlo simulation

* Added new sample for sas resource files

* caret + annotation on montecarlo sim

* samples readme.md

* samples readme

* Fixed the resource files to use proper storage account for example

* Update README.md

* Update 11-autoscale.md

* Fixed autoscale formula for task queue to take maxTaskPerNode

* Added named args to createSasToken

* Update resource-files-example.R

* Update 21-distributing-data.md

* Renamed samples files to underscore format

* Update 21-distributing-data.md

* Update README.md

* Update README.md

* Update README.md

* Edited changelog file

* Update plyr_example.R

* Update README.md
2017-05-22 17:22:40 -07:00
JS a22af385c5 Static Mandlebrot Sample (#9)
* samples

* mandlebrot sample update
2017-03-20 13:41:15 -04:00