Mark Hamilton
c2fdb05f44
chore: Adding Spark34 support ( #2052 ) ( #2116 )
...
* chore: bump to spark 3.4.1
---------
Co-authored-by: Jessica Wang <jessiwang@microsoft.com>
Co-authored-by: Scott Votaw <svotaw@gmail.com>
Co-authored-by: Brendan Walsh <37676373+BrendanWalsh@users.noreply.github.com>
Co-authored-by: JessicaXYWang <108437381+JessicaXYWang@users.noreply.github.com>
fixes
Co-authored-by: Keerthi Yanda <98137159+KeerthiYandaOS@users.noreply.github.com>
2023-11-01 02:00:49 -04:00
Puneet Pruthi
3bd5bef91d
style: improve style using pre-commit ( #1538 )
...
* chore: pre-commit first pass
* Add developer docs
* update version for pre-commit hooks
* remove manual black hook config
Co-authored-by: Puneet Pruthi <ppruthi@microsoft.com>
2022-06-21 14:31:34 -05:00
Serena Ruan
21833f5d36
style: Lint python code with black ( #1520 )
...
* feat: add black as hooks for changes to python files
* use black to auto-format previous python files
* update pipeline to check python style as well
* remove failedOnStdError
2022-06-07 12:36:34 -04:00
Mark Hamilton
f940017027
chore: update docker images to remain compliant ( #1500 )
2022-05-04 18:20:57 -04:00
Ashish Solanki
de4b47b8b6
Security upgrade required for openjdk from 8-alpine to 17-ea-22-jdk-oracle ( #1165 )
...
* fix: tools/helm/spark/mini.Dockerfile to reduce vulnerabilities
The following vulnerabilities are fixed with an upgrade:
- https://snyk.io/vuln/SNYK-ALPINE39-OPENSSL-588029
- https://snyk.io/vuln/SNYK-ALPINE39-SQLITE-1019958
- https://snyk.io/vuln/SNYK-ALPINE39-SQLITE-449671
- https://snyk.io/vuln/SNYK-ALPINE39-SQLITE-449762
- https://snyk.io/vuln/SNYK-ALPINE39-SQLITE-587441
* fix: tools/helm/spark/Dockerfile to reduce vulnerabilities
The following vulnerabilities are fixed with an upgrade:
- https://snyk.io/vuln/SNYK-DEBIAN10-LIBIDN2-474100
- https://snyk.io/vuln/SNYK-DEBIAN10-SYSTEMD-345386
- https://snyk.io/vuln/SNYK-DEBIAN10-SYSTEMD-345386
- https://snyk.io/vuln/SNYK-DEBIAN10-SYSTEMD-345391
- https://snyk.io/vuln/SNYK-DEBIAN10-SYSTEMD-345391
Co-authored-by: snyk-bot <snyk-bot@snyk.io>
2021-08-19 23:11:00 -04:00
Mark Hamilton
6218a5b4fd
Spark 3 ( #970 )
...
* feat: Update to Spark 3.0
Co-authored-by: Mark Hamilton <marhamil@microsoft.com>
Co-authored-by: Daniel Ciborowski <dciborow@microsoft.com>
Co-authored-by: Ilya Matiach <ilmat@microsoft.com>
Co-authored-by: Markus Cozowicz <marcozo@microsoft.com>
Co-authored-by: Jack Gerrits <jagerrit@microsoft.com>
2021-01-27 20:47:18 -05:00
David Lacalle Castillo
b431a61b06
fix: Updating regular Docker Images for helm chart. ( #885 )
...
* Updating regular Docker Images from helm chart.
* Removed image dependency
* Removed FBProphet
* Added maintainer.
2020-08-19 11:44:25 -04:00
marhamil723
d34f9d173d
Remove unused build scripts
2019-07-05 12:42:45 -04:00
Dalitso Banda
4473520018
squish runs together
2019-06-13 15:05:48 -07:00
Dalitso Banda
00ebf64bb3
use right python version
2019-06-13 15:05:48 -07:00
Dalitso Banda
216abea631
updated readme. more mini images
2019-06-13 15:05:48 -07:00
Dalitso Banda
2a31823c17
spark docker files
2019-04-21 21:19:00 -07:00