Граф коммитов

50 Коммитов

Автор SHA1 Сообщение Дата
Adam J. Stewart 6a5aaf4b93
Prettier: prefer single quotes (#2280)
* rettier: prefer single quotes

* Move lockfile to root directory

* Use single quotes in config files
2024-09-17 11:36:10 +02:00
Adam J. Stewart 067ae1af75
Ruff: enable ruff-specific rules (#2218)
* Ruff: enable ruff-specific rules

* Static class variables

* String colormap must be list

* String colormap must be list
2024-08-19 15:07:21 +02:00
dependabot[bot] 5174f8ad36
Bump matplotlib from 3.9.0 to 3.9.2 in /requirements (#2227)
* Bump matplotlib from 3.9.0 to 3.9.2 in /requirements

Bumps [matplotlib](https://github.com/matplotlib/matplotlib) from 3.9.0 to 3.9.2.
- [Release notes](https://github.com/matplotlib/matplotlib/releases)
- [Commits](https://github.com/matplotlib/matplotlib/compare/v3.9.0...v3.9.2)

---
updated-dependencies:
- dependency-name: matplotlib
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

* Fix everything except dates

* Suppress remaining mypy errors

---------

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Adam J. Stewart <ajstewart426@gmail.com>
2024-08-14 15:22:12 +00:00
dependabot[bot] f0a2571c98
Bump pillow from 10.3.0 to 10.4.0 in /requirements (#2150) 2024-07-02 10:44:30 +02:00
dependabot[bot] 5cfbd6512d
Bump ruff from 0.4.4 to 0.4.5 in /requirements (#2080)
* Bump ruff from 0.4.4 to 0.4.5 in /requirements

Bumps [ruff](https://github.com/astral-sh/ruff) from 0.4.4 to 0.4.5.
- [Release notes](https://github.com/astral-sh/ruff/releases)
- [Changelog](https://github.com/astral-sh/ruff/blob/main/CHANGELOG.md)
- [Commits](https://github.com/astral-sh/ruff/compare/v0.4.4...v0.4.5)

---
updated-dependencies:
- dependency-name: ruff
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

* min version of numpy now supports type hints

* pre-commit: update ruff

---------

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Adam J. Stewart <ajstewart426@gmail.com>
2024-05-23 21:35:27 +00:00
Adam J. Stewart b09122f3e4
Ruff: prefer single quotes over double quotes (#2001)
* Ruff: prefer single quotes over double quotes

* Apply ruff format
2024-05-03 19:30:14 +02:00
Slawek Bierwiaczonek bd9c75798e
Prettier formatter (#2018)
* Formatted with Prettier

* Added package-lock.json

* Removed the .idea folder

* Removed version

* Added .prettierignore with tests/data/*

* Added npm updates

* Updated prettier

* Update style.yaml

Co-authored-by: Adam J. Stewart <ajstewart426@gmail.com>

* Updated linters section

* Added Prettier hook

* Added Prettier hook

* Added exclude regex

* Update .prettierignore

Co-authored-by: Adam J. Stewart <ajstewart426@gmail.com>

* Added package.json and package-lock.json

* Added npm ci flag

* Formatted with Prettier

* Updated .gitignore

* Reverted changes in data folder

* Added .idea to ignored entries

* Delete package-lock.json from root

* Added cache dependency path

* Formatted with Prettier

* Updated tests.yaml

* Updated regex

* Updated actions/checkout to v4.1.4

* Updated SECURITY and dependabot

* Removed .idea and requirements/node_modules

* Updated package files

* Changed .yaml files format

* Added EOL

* Updated contributing.rst

* Updated style.yaml

* Updated style CI

* Added node_modules to ignored entries

* Updated npm install command

* Added *.json root files to ignored entries

* Updated prettier version range

* Updated prettier install command

* Relocated # Node stuff

---------

Co-authored-by: Adam J. Stewart <ajstewart426@gmail.com>
2024-05-03 15:35:34 +02:00
Adam J. Stewart d9991ed154
Use ruff (#1994)
* Update config files

* Fix deviations

* Update requirements files

* Update CI

* Update devcontainer

* Update pre-commit

* Check Jupyter notebooks too

* Better safe than sorry

* Update docs

* Undo removal of mypy

* Test a bug

* Also format

* pre-commit: fix indentation

* Test a bug

* Fix the bug

* Run format too

* Fix typo

* mypy requires pytest

* Fix docs link
2024-04-15 23:46:00 +02:00
Adam J. Stewart ea57469b0b
Drop Python 3.9 support (#1966) 2024-04-04 09:15:56 +02:00
dependabot[bot] f135e4573b
Bump pillow from 10.2.0 to 10.3.0 in /requirements (#1974)
* Bump pillow from 10.2.0 to 10.3.0 in /requirements

Bumps [pillow](https://github.com/python-pillow/Pillow) from 10.2.0 to 10.3.0.
- [Release notes](https://github.com/python-pillow/Pillow/releases)
- [Changelog](https://github.com/python-pillow/Pillow/blob/main/CHANGES.rst)
- [Commits](https://github.com/python-pillow/Pillow/compare/10.2.0...10.3.0)

---
updated-dependencies:
- dependency-name: pillow
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>

* Enum deprecation was reversed

* Ignore untyped call

---------

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Adam J. Stewart <ajstewart426@gmail.com>
2024-04-02 16:41:24 +00:00
Michiaki Tatsubori f8faf9fff3
Skip downloading when not in pre-sampled coords (#1821)
* Skip downloading an entry if it is not in the given pre-sampled list.

* Add warning message when skipping

---------

Co-authored-by: Michiaki Tatsubori <mich@mich-mbp5.local>
Co-authored-by: Adam J. Stewart <ajstewart426@gmail.com>
2024-03-02 14:35:31 -06:00
dependabot[bot] 7b8692b3f4
Bump black[jupyter] from 23.12.1 to 24.1.0 in /requirements (#1829)
* Bump black[jupyter] from 23.12.1 to 24.1.0 in /requirements

Bumps [black[jupyter]](https://github.com/psf/black) from 23.12.1 to 24.1.0.
- [Release notes](https://github.com/psf/black/releases)
- [Changelog](https://github.com/psf/black/blob/main/CHANGES.md)
- [Commits](https://github.com/psf/black/compare/23.12.1...24.1.0)

---
updated-dependencies:
- dependency-name: black[jupyter]
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>

* Update TorchGeo

---------

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Adam J. Stewart <ajstewart426@gmail.com>
2024-01-27 11:12:00 +00:00
dependabot[bot] 96a407cef1
Bump mypy from 1.6.1 to 1.8.0 in /requirements (#1783)
* Bump mypy from 1.6.1 to 1.8.0 in /requirements

Bumps [mypy](https://github.com/python/mypy) from 1.6.1 to 1.8.0.
- [Changelog](https://github.com/python/mypy/blob/master/CHANGELOG.md)
- [Commits](https://github.com/python/mypy/compare/v1.6.1...v1.8.0)

---
updated-dependencies:
- dependency-name: mypy
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>

* Fix most type hints

* Fix rest of type hints

* Alternative fix

* Remove unused import

---------

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Adam J. Stewart <ajstewart426@gmail.com>
2023-12-22 13:31:26 +00:00
dependabot[bot] 94d0619fe5
Bump matplotlib from 3.8.0 to 3.8.1 in /requirements (#1708)
* Bump matplotlib from 3.8.0 to 3.8.1 in /requirements

Bumps [matplotlib](https://github.com/matplotlib/matplotlib) from 3.8.0 to 3.8.1.
- [Release notes](https://github.com/matplotlib/matplotlib/releases)
- [Commits](https://github.com/matplotlib/matplotlib/compare/v3.8.0...v3.8.1)

---
updated-dependencies:
- dependency-name: matplotlib
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

* plt.show now has type hints

---------

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Adam J. Stewart <ajstewart426@gmail.com>
2023-11-01 23:00:12 +00:00
Adam J. Stewart 01fe8d5e5d
SSL4EO: fix invocation of training script (#1689) 2023-10-28 08:33:17 -05:00
Adam J. Stewart 73791b6f1e
SSL4EO: convert script from MiB to MB (#1669) 2023-10-20 08:05:18 -07:00
Adam J. Stewart d5bd9b3dd6
Move conf files to experiment subdirs (#1660) 2023-10-13 13:31:01 -07:00
dependabot[bot] 2fbdc85efd
Bump matplotlib from 3.7.3 to 3.8.0 in /requirements (#1566)
* Bump matplotlib from 3.7.3 to 3.8.0 in /requirements

Bumps [matplotlib](https://github.com/matplotlib/matplotlib) from 3.7.3 to 3.8.0.
- [Release notes](https://github.com/matplotlib/matplotlib/releases)
- [Commits](https://github.com/matplotlib/matplotlib/compare/v3.7.3...v3.8.0)

---
updated-dependencies:
- dependency-name: matplotlib
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>

* Use canonical import location

* Use canonical import location

* Use canonical import location

* More type fixes

* More type fixes

* More type fixes

* More type fixes

---------

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Adam J. Stewart <ajstewart426@gmail.com>
2023-09-21 11:35:57 +00:00
Adam J. Stewart 4d5e07ce37
Add script to plot example predictions (#1534) 2023-09-06 16:05:02 -05:00
Adam J. Stewart effa992bd8
SSL4EO: add script to measure flops of models (#1516)
* SSL4EO: add script to measure flops of models

* Calculate memory requirements too
2023-08-31 09:50:16 -07:00
Adam J. Stewart dc6fa51db4
SSL4EO: fix sampling script (#1510) 2023-08-13 12:57:28 -05:00
Adam J. Stewart 62f4ce3f0a
Make Landsats plural (#1481) 2023-07-19 12:56:06 -07:00
Adam J. Stewart 6c09cace3a
SSL4EO: Add script to delete excess files (#1425)
* SSL4EO: Add script to delete excess files

* Placate black
2023-06-18 11:36:15 -05:00
Adam J. Stewart 1ad8caa754
SSL4EO-L: add reproducibility instructions (#1416)
* Create landsat subdirectory

* Python scripts in superdirectory now

* Add README
2023-06-15 11:58:43 -05:00
Adam J. Stewart 06f91f7fbb
Minor updates to Landsat band plots (#1396) 2023-06-09 13:00:27 -05:00
Adam J. Stewart e53e9b0ba2
SSL4EO-L Benchmark ETM+: copy nodata pixels from img to mask (#1400)
* SSL4EO-L Benchmark ETM+: copy nodata pixels from img to mask

* black fix

* Simpler bounds

* Update checksums
2023-06-07 16:36:00 -05:00
Adam J. Stewart 99413397b8
Compute class imbalance (#1389)
* Compute class imbalance

* Add --ignore-index flag

* Higher range

* Fix mypy

* Add flags to select subset and compute weights

* Fix --keep calculation
2023-06-04 10:02:05 -05:00
Adam J. Stewart 51cdf363b5
Add copyright to files we forgot (#1390) 2023-06-02 16:07:22 -05:00
Yi Wang 7bc19aea9d
fix downloading success check bug (#1388)
* fix downloading success check bug

* fix downloading success check bug

* simplify fix

Co-authored-by: Adam J. Stewart <ajstewart426@gmail.com>

---------

Co-authored-by: Adam J. Stewart <ajstewart426@gmail.com>
2023-06-02 16:43:46 +00:00
Adam J. Stewart 9e4f7d12d4
Improve customizability of Landsat band plots (#1378)
* Improve customizability of Landsat band plots

* Better xlabel

* Display default values

* More band customization

* More band customization

* Fix ylim

* Fix vertical centering

* Fewer sensors

* flake8 fix

* usetex

* Shorter, simpler

* Wider thermal bands padding
2023-06-01 15:12:04 -05:00
Adam J. Stewart 02f2a6cb81
Add script to plot Landsat mission timeline (#1383)
* Add script to plot Landsat mission timeline

* No range, present, mission

* usetex

* Thinner lines

* Shorter, simpler
2023-06-01 15:11:47 -05:00
Adam J. Stewart 114b4d1666
sample_ssl4eo: faster top 10K (#1385) 2023-06-01 12:50:13 -05:00
Nils Lehmann 8177947f0a
Create matching CDL/NLCD chips for downstream tasks (#1336)
* create matching chips script

* change path directory

* mask_src.transform instead of img_src

* requested changes and fix bug adam found

* fix mypy error

* more requested changes

* remove comment
2023-05-21 15:42:23 +02:00
Adam J. Stewart f562378bcb
Fix compression range (#1348) 2023-05-18 21:30:43 -07:00
Adam J. Stewart 6ce1c4ef65
SSL4EO download script: optionally download nodata pixels (#1335) 2023-05-15 10:28:56 -05:00
Adam J. Stewart 777b68376f
Add script to compress dataset files (#1326)
* Add script to compress dataset files

* Fix type annotation

* Add script for L5 L1
2023-05-14 11:01:31 -05:00
Adam J. Stewart aa1c026108
Landsat 5 TOA also needs to be downloaded (#1334) 2023-05-14 10:52:53 -05:00
Adam J. Stewart 8fc9ff571f
Add script to compute grayscale image using PCA (#1299)
* Add script to compute grayscale image using PCA

* Fix isort

* Rename script

* Add scale parameter
2023-05-11 23:05:24 -05:00
Adam J. Stewart 8a19f086d5
Make sample_conus.py executable (#1327) 2023-05-11 23:03:52 -05:00
Adam J. Stewart 155b480987
Don't ignore warnings in download script (#1328) 2023-05-11 23:03:39 -05:00
Adam J. Stewart 9cd4844d4d
Add script to compute dataset statistics (#1298)
* Add script to compute mean/std dev

* Isort fix

* Rename script

* Add multithreading

* Fix type hints

* Fix type hints

* Make chunksize a parameter

* Support uint8, separate band per file

* Ignore mypy

* Add min/max

* Compute using rasterio statistics

* Add license

* Remove unused param

* Reduce memory consumption

* Simpler way to access # bands

* Add progress bar

* Remove unused arg

* Channel-wise min/max

* Better formatting

* linewidth must be int

* Fix docstring, add size arg

* No need for sizes

* Black

* mypy fixes

---------

Co-authored-by: Caleb Robinson <caleb.robinson@microsoft.com>
2023-05-11 17:57:46 -05:00
Adam J. Stewart 749065c0c0
Various fixes to SSL4EO sampler (#1318)
* Various fixes to SSL4OE sampler

* Fix type cast

* Revert changes to download script

* Flush file immediately

* Remove unused variable
2023-05-11 17:56:54 -05:00
Adam J. Stewart 281de96b16
Add script to delete mismatched scenes (#1320)
* Add script to delete mismatched scenes

* Fix indentation
2023-05-11 17:54:49 -05:00
Nils Lehmann 86c7ca7057
spelling bee (#1322) 2023-05-11 17:59:51 +00:00
Nils Lehmann 3cc1427c24
Add uniform sampling locations from CONUS script (#1311)
* add sampling script

* fix mypy

* add rtree logic

* adapt sampling script to suggestions

* add bash script for conus sampling

* requested changes and tested bash script

* simplify conus multipolygon computation
2023-05-11 11:31:23 -05:00
Adam J. Stewart 63c1840c3e
SSL4EO download script: fix type hints (#1319) 2023-05-10 17:03:47 -05:00
Adam J. Stewart b381b54563
Add copyright info to download scripts (#1314) 2023-05-07 22:38:07 -05:00
Adam J. Stewart 589201b42f
SSL4EO download script: don't download nodata pixels (#1310) 2023-05-05 08:28:57 -05:00
Adam J. Stewart 141239b6b8
SSL4EO: more generic download script (#1296)
* SSL4EO: more generic download script

* Fix type hints

* Fix support for ancient Linux

* Change nodata value to match docs

* Satellite-specific fill value

* Fix band duplication bug

* Support multiple processes too

* Revert "Support multiple processes too"

This reverts commit 6a655eb088.

* Add debug flag

* Add governor

* 40 threads is ideal
2023-05-04 00:00:47 -05:00
Adam J. Stewart 4627827925
Reorganize experiments directory (#1295) 2023-04-30 14:35:24 +00:00