зеркало из
1
0
Форкнуть 0
Граф коммитов

68 Коммитов

Автор SHA1 Сообщение Дата
Sushil Kumar 26d35823a4
Removed reference of storage account aoigeospatial (#98) 2022-11-10 23:58:23 -08:00
Tai Yee b6bdd7a32a
Merge pull request #97 from taiyee/tai/docupdate
updating documentation and images
2022-11-08 14:59:20 -08:00
Tai Yee 846fe54468 clarified instructions based on reviewer comment 2022-11-08 14:19:21 -08:00
Tai Yee f43e89f808 addressed comments made by reviewer 2022-11-08 08:14:16 -08:00
Tai Yee 94d7ec5a0d updating documentation and images 2022-11-07 08:13:24 -08:00
Sushil Kumar 8cc542a237
Updated tensorflow and numpy versions (#95) 2022-10-26 13:39:11 -07:00
Sushil Kumar 75cd960c8e
Moves the files into relevant directories in deploy directory (#94) 2022-10-25 12:42:02 -07:00
Karthick Narendran 6bf53ecbdc
Update Synapse gallery documentation (#84)
Co-authored-by: Karthick Narendan <kanarend@microsoft.com>
2022-10-18 11:48:10 +01:00
Sushil Kumar 5df7dc9e54
Simplifying the documentation (#87) 2022-10-17 12:30:36 -07:00
Sushil Kumar 3ef9163310
Remove environmentTag from nameSuffix (#90) 2022-10-11 12:48:15 -07:00
Sushil Kumar 73e85ffd54
Updated custom-vision-model-v2 to custom-vision-model (#86)
* Updated custom-vision-model-v2 to custom-vision-model

* Comments fixes
2022-10-07 09:36:45 -07:00
Kungumaraj Nachimuthu 5979c1c4be
Move Support.md to root (#79) 2022-09-09 13:56:03 -07:00
Kungumaraj Nachimuthu e4a3482123
Documentation update (#78)
* Update documentation

* Update parameters

* Add AKS pipeline option

* Add images for pipelines

* Update documentation

* Update parameters

* Add AKS pipeline option

* Add images for pipelines

* Update based on feedback

* Update based on feedback

* Correct typo and grammatical errors

* Add support.md file

* Add clarification on folder structure

* Remove support section

* Add removed section from Support.md

* Update support text
2022-09-09 11:57:05 -07:00
sjyang18 0341d734c1
generated nameSuffix from subscription,evcode,& location (#76)
* generated nameSuffix from subscription,namingprefix,environmentTag, and location

* query & set synapse_ws_name and acr_name from its environment

* updated deploy/README.md with the bicep version & deployment role expectation
2022-09-01 09:35:36 -07:00
Karthick Narendran ff1407ec43
Update gallery instructions (#73)
* Minor update to the gallery instructions

Co-authored-by: karthick-rn <kanarend@microsoft.com>
2022-08-24 15:07:08 +01:00
sjyang18 6f553ce4c9
Merge pull request #67 from sjyang18/aks-dp7
aks-based data-pipeline support
2022-07-06 11:01:15 -07:00
Seokwon Yang a9820a70f6 PR review update (2) 2022-07-06 10:53:20 -07:00
Seokwon Yang aba3b41c8c PR review update 2022-07-05 09:48:18 -07:00
Seokwon Yang 9a84ad5763 aks-based data-pipeline support 2022-07-05 09:32:27 -07:00
Karthick Narendran 675fd30b3c
Fix batch pool name (#71)
* Fix batch pool name
2022-07-04 20:23:02 +01:00
Sushil Kumar a9b82df836
Use variable instead of parameter (#70) 2022-06-29 18:20:42 -07:00
Sushil Kumar e1487802e5
Use postgresql with pipelines (#68) 2022-06-29 15:47:16 -07:00
Sushil Kumar bec009fdf9
Make entrypoint for multiple AI platform (#49) 2022-06-29 09:46:33 -07:00
Sushil Kumar 681756504f
Added DisableDockerDetector to pipeline definition (#65) 2022-06-28 15:55:06 -07:00
Kungumaraj Nachimuthu f6b29ac4f7
Update readme.md with optional parameters (#64)
* Update readme.md with optional parameters

* parameter typo fixed

Co-authored-by: Karthick Narendran <karthick.narendran@gmail.com>

Co-authored-by: Karthick Narendran <karthick.narendran@gmail.com>
2022-06-28 12:53:15 -07:00
Kungumaraj Nachimuthu 2b0d5a0e26
Copy noop replaced with data flow (#61)
* Add Dataflow in place of Copy-noop jobs

* Add Dataflow in place of Copy-noop jobs

* Add datasets for Dataflow replacing copy noop
2022-06-28 12:02:41 -07:00
Sushil Kumar d653751471
Remove echo from cleanup (#60) 2022-06-27 14:01:31 -07:00
Kungumaraj Nachimuthu 48396637fd
Pipeline postgres switch (#56)
* Manifest for postgres switch added

* Rename mode for postgres switch to no-postgres

* Fix minor true-false cond for no-postgres

* Remove AKS references and dependencies

* Rename manifests.json to manifest.json

* Add mode default value

* Move all assignments to top of script

* Add echo to the MODE

* Update workflow and manifest typo in package.py

Co-authored-by: Karthick Narendran <karthick.narendran@gmail.com>

Co-authored-by: Karthick Narendran <karthick.narendran@gmail.com>
2022-06-27 13:35:51 -07:00
Sushil Kumar 641884ae33
Adds ADO pipeline (#58) 2022-06-27 12:18:03 -07:00
Karthick Narendran 20bce07164
Standalone scripts to support pipeline template (#55)
* Standalone scripts & instructions to run pipeline template in Synapse gallery

Co-authored-by: karthick-rn <kanarend@microsoft.com>
Co-authored-by: Tai Yee <taiyee@microsoft.com>
2022-06-27 13:30:19 +01:00
Sushil Kumar 4eb6984687
Created ADO pipeline (#57)
- Disables the github workflow for infrastructures
- Adds an ADO pipeline
- Current code is just a dummy pipeline test
2022-06-23 16:09:38 -07:00
Sushil Kumar fb6c234734
Adds a flag DEPLOY_PGSQL to manage postgresql database server deployment (#52) 2022-06-17 17:21:04 -07:00
Sushil Kumar 50e792483e
Fixes cleanup.sh (#50) 2022-06-15 21:34:44 -07:00
Sushil Kumar db9be0d2a3
Fix the condition check for AAD_GROUP_PRINCIPAL_ID (#47) 2022-06-15 15:35:47 -07:00
Sushil Kumar b036ffbcfc
Added notebook creation to pipeline dependencies (#46) 2022-06-14 16:35:27 -07:00
Sushil Kumar a25de653c3
Fix the environment code for PR workflow (#43) 2022-06-14 14:23:20 -07:00
Sushil Kumar e7e673d5e8
Fixes the call to script use-pre-provisioned-batch-account.sh (#42) 2022-06-14 10:24:22 -07:00
Kungumaraj Nachimuthu 74d96dc26f
Data load to PostgreSQL database (#37)
* Added Postgres to deployment pipeline
Added table creation scripts and more to pipeline
Added scripts to insert data from custom object detections model to postgres
Added to the E2E Custom Vision Data Model Flow pipeline

* Converting Spark Job to Notebook Job
Additional updater per feedback

* Minor fixes post rebase for postgres changes

* Param skuSizeMB changed to string

* Updated workflow to pass postgresql password

Co-authored-by: Safiyah Sadiq <sasadiq@microsoft.com>
2022-06-13 15:53:20 -07:00
Karthick Narendran af04b41872
Fix param order in install.sh (#38)
Co-authored-by: karthick-rn <kanared@microsoft.com>
2022-06-09 17:36:12 +01:00
Karthick Narendran df432b6757
CI/CD to run on all branches (#40)
Co-authored-by: karthick-rn <kanared@microsoft.com>
2022-06-08 20:13:49 +01:00
Sushil Kumar daa7b0f853
Fixes workflow (#36) 2022-06-02 14:04:06 -07:00
Tushar Dhadiwal f47a12e692
Fix for Protobuf bug breaking Tensorflow, CI path (#33)
Co-authored-by: Tushar D <tudhadiw@microsoft.com>
2022-06-02 11:03:46 -07:00
Sushil Kumar 083f701902
Adds CI/CD test pipeline (#31) 2022-06-01 14:34:51 -07:00
Kungumaraj Nachimuthu 921a21922d
Updates to documentation (README.md) (#29)
* Add troubleshooting for getting tokenSecret

* Update README.md based on testing feedback

* Update to README.md to clarify image load

* Update to documentation based on feedback
2022-05-06 15:53:40 -07:00
Kungumaraj Nachimuthu ef4a02abbe
Update setup.sh with positional parameters (#28) 2022-05-02 11:25:17 -07:00
Kungumaraj Nachimuthu ba04ed5d30
Transforms simplified (#26)
* Add an optimized version of the custom vision model pipeline

* Add consolidated spark-job transform

* Check in missed files

* Add correction to detection pipeline spark jobs

* Test and validate pool geolocation transform

* Update README.md for one-click setup

* Change name for new cv model pipeline folder

* Update README.md with GitHub integration

* Update README.md based on feedback

* Update to README.md to clarify package.sh use

* Update to previous pipeline cv model

* Update format of AOI sent to Transform

* Update crop output file name to be constant

* Update pool-geolocation to remove config file

* Add relative path for setup.sh

* Updated the permissions for setup.sh

* Update to README.md file for typo correction

* Address feedback items

* Update deploy/README.md with option rename

Co-authored-by: Karthick Narendran <karthick.narendran@gmail.com>

* Updated based on feedback

* Update deploy/README.md with template issue

Co-authored-by: Karthick Narendran <karthick.narendran@gmail.com>

Co-authored-by: Karthick Narendran <karthick.narendran@gmail.com>
2022-04-29 14:09:18 -07:00
Karthick Narendran 9fdc298ff3
Update the deployment steps in README.md (#18)
Co-authored-by: karthick-rn <kanarend@microsoft.com>
2022-04-20 18:56:44 +01:00
sjyang18 53ab4e3db5
normalize eol to lf and set core.autocrlf to auto by default (#16)
* normalize eol to lf and set core.autocrlf to auto by default

* adding sjyang18 to contributor list
2022-04-14 10:43:58 -07:00
sjyang18 26567c4e4c
fixes to support IaC idempotency (#15)
* fixes to support IaC idempotency

* dropping greenfield deployment only restriction from README.md
2022-04-13 11:56:10 -07:00
Mandar Inamdar 424b38b879
Adds details of storage acct container for sample data (#14)
- Provide details for the parameters to be passed to Synapse Pipeline
2022-04-11 18:21:46 -07:00