Граф коммитов

216 Коммитов

Автор SHA1 Сообщение Дата
Nils Lehmann b9a09f5711
Add Digital typhoon dataset (#1748)
* analysis task dataset

* implement sequence sampling

* add outline datamodule

* add datamodule with two way splitting capabilities

* add plotting function

* download and verify

* add unit tests but they fail

* fix tests

* fix style

* trainer testing yaml

* test split logic

* fix tests

* fix tests2

* found bug

* try to fix mypy

* h5py error docs

* fix docs

* fix one mypy error

* mypy on test file

* fix coverage

* fix tests for trainers

* fix mypy

* try typed dict

* try to fix docs

* fix pytest

* linters

* suggested changes and normalization procedure

* regression target normalization

* update dataset splitting

* fix test

* quotes

* strings

* ruff

* quotes

* ruff format on all

* docs

* lazy import

* h5py

* h5py datamodule

* typo

* tests

* review

* pass tests

* fix tests

* list -> tuple

* mypy fix

* rename

* tests

* Remove Analysis

* min pandas 2.2.0

* resolve tests

---------

Co-authored-by: Adam J. Stewart <ajstewart426@gmail.com>
2024-08-29 11:29:04 +02:00
Daniele Rege Cambrin ccc314cd88
Add CaBuAr dataset (#2235)
* 🆕 Added CaBuAr dataset

* 🆕 Added CaBuAr datamodule

* 🔨 Added CaBuAr datamodule test

* 🔨 Corrected CaBuAr typing and datamodule test

* 🔨 updated test, corrected docs, minor fixes to dataset and datamodule

* 🔨 CaBuAr test fixes
2024-08-28 15:57:58 +02:00
Adam J. Stewart 451b5a5919
SkyScript: add new dataset (#2253)
* SkyScript: add new dataset

* Remove print statements

* Fix bug

* 100% coverage

* text -> caption

* Simpler tests

* Reformat
2024-08-27 16:38:45 +02:00
Nils Lehmann 2d6e27ebd0
Add GeoNRW dataset (#2209)
* dataset and module

* test with training

* add tests

* start the fight with mypy

* kick off tests

* class var ruff

* don't download

* forgot tests data

* already downloaded

* coverage

* review

* mypy

* docs

* docs

* suggestion

* plotting

* versionadded: 2 digits

* Type hint unnecessary

---------

Co-authored-by: Adam J. Stewart <ajstewart426@gmail.com>
2024-08-27 15:57:14 +02:00
Adam J. Stewart 067ae1af75
Ruff: enable ruff-specific rules (#2218)
* Ruff: enable ruff-specific rules

* Static class variables

* String colormap must be list

* String colormap must be list
2024-08-19 15:07:21 +02:00
Adam J. Stewart 880593e7ef
SpaceNet: add SpaceNet 8, radiant mlhub -> aws (#2203) 2024-08-17 20:49:48 +02:00
Adam J. Stewart 17b5ccf5ff
Redistribute NWPU datasets on Hugging Face (#2210)
* Redistribute NWPU datasets on Hugging Face

* unrar no longer needed in CI

* VHR-10: md5 monkeypatching is required
2024-08-17 17:01:44 +02:00
Adam J. Stewart e702c8f4ae
LEVIRCD: data module tests without download (#2231)
* LEVIRCD: data module tests without download

* Skip args
2024-08-17 15:01:40 +02:00
Adam J. Stewart 294a59b4ff
Chesapeake: update to 2022 edition (#2214)
* Chesapeake: update to 2022 edition

* Hard-code cmap, don't want to write yet another test file

* Update tests

* Update datamodule

* Bug fix

* Update test config

* Fix plotting

* More classes

* Fix docs
2024-08-17 10:10:02 +02:00
Adam J. Stewart e973c1e3ca
Ruff: ensure all functions have type hints (#2217)
* Ensure all functions have type hints

* Fix Callable

* Undo notebook changes
2024-08-12 14:32:31 +02:00
Adam J. Stewart 06aa33f151
WesternUSALiveFuelMoisture: radiant mlhub -> source coop (#2206)
* WesternUSALiveFuelMoisture: radiant mlhub -> source coop

* Finish updating dataset

* Recursive

* Update tests
2024-08-05 11:11:23 +02:00
Adam J. Stewart 900e8a1e74
NASA Marine Debris: radiant mlhub -> source coop (#2183) 2024-07-27 09:24:56 +02:00
Sieger Falkena ff66eba3c4
Update small mistake of attributeerror (#2162) 2024-07-12 14:28:33 +02:00
Adam J. Stewart 61635cd084
Rwanda Field Boundary: radiant mlhub -> source cooperative (#2118) 2024-07-10 17:40:23 +02:00
Adam J. Stewart 9df08d0ff5
Cloud Cover: radiant mlhub -> source cooperative (#2117) 2024-07-10 17:39:57 +02:00
Adam J. Stewart 32aa3492ca
CV4A Kenya Crop Type: radiant mlhub -> source cooperative (#2090) 2024-07-10 17:39:31 +02:00
Adam J. Stewart 83cad6017c
Benin Cashews: radiant mlhub -> source cooperative (#2116) 2024-07-10 10:35:55 +02:00
Adam J. Stewart ab258bfc96
Tropical Cyclone: radiant mlhub -> source cooperative (#2068)
* Tropical Cyclone: radiant mlhub -> source cooperative

* Update azcopy unit tests
2024-07-10 10:35:11 +02:00
Adam J. Stewart 9539fc837a
SSL4EO-L Benchmark: test len (#2084) 2024-05-25 20:32:09 +02:00
Adam J. Stewart cc2b860326
AgriFieldNet: fix dataset length (#2087)
* AgriFieldNet: fix dataset length

* Need more images to split data module

* Update test len
2024-05-25 20:31:50 +02:00
Adam J. Stewart b7f0cdea37
South Africa Crop Type: fix dataset length (#2088)
* South Africa Crop Type: fix dataset length

* Need more images to split data module

* Update test len
2024-05-25 20:31:10 +02:00
Yi-Chia Chang 96507bd3f1
Fix South America Soybean Filename Glob and Regex (#2062)
* fix filename glob and regex

* remove unwanted file

* update test data

* update dataset test

* remove zip file

* remove additional directory

* fix ruff check and format
2024-05-17 17:05:53 +02:00
Adam J. Stewart b09122f3e4
Ruff: prefer single quotes over double quotes (#2001)
* Ruff: prefer single quotes over double quotes

* Apply ruff format
2024-05-03 19:30:14 +02:00
Slawek Bierwiaczonek bd9c75798e
Prettier formatter (#2018)
* Formatted with Prettier

* Added package-lock.json

* Removed the .idea folder

* Removed version

* Added .prettierignore with tests/data/*

* Added npm updates

* Updated prettier

* Update style.yaml

Co-authored-by: Adam J. Stewart <ajstewart426@gmail.com>

* Updated linters section

* Added Prettier hook

* Added Prettier hook

* Added exclude regex

* Update .prettierignore

Co-authored-by: Adam J. Stewart <ajstewart426@gmail.com>

* Added package.json and package-lock.json

* Added npm ci flag

* Formatted with Prettier

* Updated .gitignore

* Reverted changes in data folder

* Added .idea to ignored entries

* Delete package-lock.json from root

* Added cache dependency path

* Formatted with Prettier

* Updated tests.yaml

* Updated regex

* Updated actions/checkout to v4.1.4

* Updated SECURITY and dependabot

* Removed .idea and requirements/node_modules

* Updated package files

* Changed .yaml files format

* Added EOL

* Updated contributing.rst

* Updated style.yaml

* Updated style CI

* Added node_modules to ignored entries

* Updated npm install command

* Added *.json root files to ignored entries

* Updated prettier version range

* Updated prettier install command

* Relocated # Node stuff

---------

Co-authored-by: Adam J. Stewart <ajstewart426@gmail.com>
2024-05-03 15:35:34 +02:00
George Huber 02402794ee
Add South Africa Crop Type DataModule (#1970)
* initial commit

* correct channels and classes

* fixed dataloader

* mypy

* pyupgrade

* flake8

* fix docs

* Add more aug

* revert testing changes

* Filter out s1 bands temporarily

* fix docs

* Simplify regex

* 100% test coverage

* Test plotting s1

---------

Co-authored-by: georgehuber <“georgehuber8@gmail.com”>
Co-authored-by: Adam J. Stewart <ajstewart426@gmail.com>
2024-04-25 20:58:17 +02:00
Isaac Corley 0f063916cc
QuakeSet dataset (#1997)
* add quakeset dataset

* add datamodule and tests

* update plot

* add plot title spacing

* fix tests

* fix tests finally

* fix mypy

* fix url

* fix mypy

* pin hf url to commit

* fix docs

* update dataset docs

* add missing h5py test

* fixes per suggestions

* updates per suggestions x3

* add setup method to define validation split

* undo split renaming

* update docstring
2024-04-19 22:27:43 +02:00
Adam J. Stewart 04a85a593a
I/O Bench: add new dataset (#1972)
* I/O Bench: add new dataset

* Add tests

* IOBenchDataModule: add new data module

* Style fixes

* Style fixes

* RandomGeoSampler == RandomBatchGeoSampler when 1 scene

* IOBenchDataModule: add tests

* Add API docs

* Smaller class size

* Fix typo

* Add config file

* Add IOBenchTask

* Add tests

* pyupgrade

* Fix support for older PyTorch

* Add another config file

* Add usage documentation
2024-04-19 18:21:56 +02:00
Adam J. Stewart d9991ed154
Use ruff (#1994)
* Update config files

* Fix deviations

* Update requirements files

* Update CI

* Update devcontainer

* Update pre-commit

* Check Jupyter notebooks too

* Better safe than sorry

* Update docs

* Undo removal of mypy

* Test a bug

* Also format

* pre-commit: fix indentation

* Test a bug

* Fix the bug

* Run format too

* Fix typo

* mypy requires pytest

* Fix docs link
2024-04-15 23:46:00 +02:00
Favyen Bastani 83353b038f
Add eurocrops data module. (#1869)
* Add eurocrops data module.

It is based on NAIPChesapeakeDataModule which splits bounding box of dataset
into 1/2 train, 1/4 val, and 1/4 test. This may not be the best way to train
an actual model.

* misc fixes

* various fixes per discussion

* update eurocrops test data

* fix

* fix version added placement

* fix failing test by forcing integrity test when checksum is requested

* Clarify SIZE setting in eurocrops test data

* fix currently remaining issues with eurocrops data module

* fix style

* more style fix

* Add documentation

---------

Co-authored-by: Adam J. Stewart <ajstewart426@gmail.com>
2024-04-12 15:16:31 +02:00
Adam J. Stewart ea57469b0b
Drop Python 3.9 support (#1966) 2024-04-04 09:15:56 +02:00
Jingtong 5d253c55d8
Add South America Soybean DataModule (#1959)
* Add South America Soybean DataModule

* Add train_aug

* Regenerate data

---------

Co-authored-by: Adam J. Stewart <ajstewart426@gmail.com>
2024-03-25 17:34:13 +00:00
shreyakannan1205 bd48efe988
sentinel2nccm datamodule on new branch (#1950)
* sentinel2nccm datamodule

* Fixed style errors

* added 2019 to sentinel2, removed 2022 from nccm

* fixed error

* Use matching split size

---------

Co-authored-by: shreya28 <“shreya28@illinois.edu”>
Co-authored-by: Adam J. Stewart <ajstewart426@gmail.com>
2024-03-22 22:05:01 +00:00
Yi-Chia Chang 5a7b9e58bc
Add Sentinel2_CDL Datamodule (#1889)
* cdlsentinel2

* update kwargs

* style

* arg type

* add cov

* kwargs

* update cdl data.py for intersection

* style

* create 2022 cdl for intersection

* test roi method

* style

* test_cdl year update

* intersection

* random_grid_cell_assignment

* add comments and line

* add description

* add doc

* Update SIZE variable in sentinel2/data.py and test stage in datamodules/cdlsentinel2.py

* merge val_aug and test_aug to aug

* rename cdlsentinel2 to sentinel2cdl

* fix isort

* No need to monkeypatch CDL

* Smaller backbone == faster tests

* Sort docs alphabetically

* Smaller Sentinel-2 test files

* Smaller CDL files, don't delete directory

* Sort imports alphabetically

* Fix doc names

* extra_args not needed

* center crop doesn't do anything

* blacken

* Revert "extra_args not needed"

This reverts commit 859f24ef15.

* Add underscore to filename

* Add plot method

* import Figure

* split 80-10-10

* style

---------

Co-authored-by: Adam J. Stewart <ajstewart426@gmail.com>
2024-03-22 17:03:01 +01:00
George Huber 1f6e974571
Add South Africa Crop Type Competition Dataset (#1840)
* initial commit

* add init description

* correct scanning of files in init

* added random data generation

* remove test directory

* Update metadata

* fix formatting

* add s1 data and update regex

* fix dataset and add tests

* formatting

* mypy

* add timeseries test and take images from july

* fix bug in merging files across dates

* mypy

* Bump lightly from 1.4.25 to 1.5.0 in /requirements (#1894)

* Additional Satlas pretrained models (#1884)

* Documentation, satellite-specific transform and weights for additional Satlas single-image rgb&multispectral Swin-v2 models. Tests pass.

* Address 3 of comments

* Address comments, fix readmydocs and isort, mypy still unhappy

* update

* Add bands to meta dicts

* Add comment about Satlas S2 RGB using TCI product

* linting

---------

Co-authored-by: Piper Wolters <piperw@allenai.org>
Co-authored-by: Piper Wolters <piperw@prior-cirrascale-79.reviz.ai2.in>

* Update tests/data/south_africa_crop_type/data.py

Co-authored-by: Adam J. Stewart <ajstewart426@gmail.com>

* Update tests/data/south_africa_crop_type/data.py

Co-authored-by: Adam J. Stewart <ajstewart426@gmail.com>

* Update torchgeo/datasets/south_africa_crop_type.py

Co-authored-by: Adam J. Stewart <ajstewart426@gmail.com>

* Update torchgeo/datasets/south_africa_crop_type.py

Co-authored-by: Adam J. Stewart <ajstewart426@gmail.com>

* Update torchgeo/datasets/south_africa_crop_type.py

Co-authored-by: Adam J. Stewart <ajstewart426@gmail.com>

* Update torchgeo/datasets/south_africa_crop_type.py

Co-authored-by: Adam J. Stewart <ajstewart426@gmail.com>

* refactor gettitem and bug fixes

* typo

* data.py style

* Update torchgeo/datasets/south_africa_crop_type.py

Co-authored-by: Adam J. Stewart <ajstewart426@gmail.com>

* Update torchgeo/datasets/south_africa_crop_type.py

Co-authored-by: Adam J. Stewart <ajstewart426@gmail.com>

* added comments for nonstandard functionality

* Update torchgeo/datasets/south_africa_crop_type.py

Co-authored-by: Adam J. Stewart <ajstewart426@gmail.com>

* small change

* add verbose documentation

---------

Co-authored-by: georgehuber <“georgehuber8@gmail.com”>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Piper Wolters <46272042+piperwolters@users.noreply.github.com>
Co-authored-by: Piper Wolters <piperw@allenai.org>
Co-authored-by: Piper Wolters <piperw@prior-cirrascale-79.reviz.ai2.in>
Co-authored-by: Adam J. Stewart <ajstewart426@gmail.com>
2024-03-15 12:21:02 +01:00
Adam J. Stewart 8527141006
VHR-10: add decompressed files (#1927) 2024-03-03 11:00:21 -06:00
Yi-Chia Chang f3270ca6ae
Resolve NCCM checksum error and add years args (#1870)
* add new download links, years Args, and new test data

* remove download test file

* include all years by default

* sort year and verify
2024-02-12 22:25:04 +00:00
Yi-Chia Chang 8af188c72e
Add AgriFieldNet India Challenge dataset (#1459)
* add agrifieldnet dataset

* modified len check

* improve _download

* remove augmentation and wrong datamodule names

* update data.py and dataset

* update splits

* remove patch_size change

* fix style issues

* add yaml and modify/test for training

* fix data path and add trainer

* export prediction

* fix integrity check and len

* extract predction

* adding create submission file function

* adding create submission file function

* hyperparam tuning exp

* backup experiments

* remove redundant files

* reverse segmentation.py

* resolve minor issues

* modify yaml and add exp files

* update data.py

* remove outdated train.py

* update dataset, test, and new data

* fix style

* fix doc api

* remove datamodule

* fix geo_datasets.csv

* fix codecov

* fix read tif issue

* Update torchgeo/datasets/agrifieldnet.py

Co-authored-by: Adam J. Stewart <ajstewart426@gmail.com>

* fix init

* add ordinal_cmap to pred and remove comments

* remove suffix

* remove download entirely

* style

* Update agrifieldnet.py

Co-authored-by: Adam J. Stewart <ajstewart426@gmail.com>

* Update agrifieldnet.py

Co-authored-by: Adam J. Stewart <ajstewart426@gmail.com>

* remove url and if statement

---------

Co-authored-by: Adam J. Stewart <ajstewart426@gmail.com>
2024-02-12 12:41:51 -06:00
Jingtong f5624ac2cc
Adding South America Soybean Dataset (#1668)
* Created file for South America Soybean dataset and added it to __init__.py

* Updated south_america_soybean.py

* Added tests

* Updated data.py

* Update torchgeo/datasets/south_america_soybean.py

Co-authored-by: Yi-Chia Chang <61452667+yichiac@users.noreply.github.com>

* Update tests/datasets/test_south_america_soybean.py

Co-authored-by: Yi-Chia Chang <61452667+yichiac@users.noreply.github.com>

* Update tests/datasets/test_south_america_soybean.py

Co-authored-by: Yi-Chia Chang <61452667+yichiac@users.noreply.github.com>

* Update tests/datasets/test_south_america_soybean.py

Co-authored-by: Yi-Chia Chang <61452667+yichiac@users.noreply.github.com>

* Update tests/datasets/test_south_america_soybean.py

Co-authored-by: Yi-Chia Chang <61452667+yichiac@users.noreply.github.com>

* Update tests/datasets/test_south_america_soybean.py

Co-authored-by: Yi-Chia Chang <61452667+yichiac@users.noreply.github.com>

* Update tests/datasets/test_south_america_soybean.py

Co-authored-by: Yi-Chia Chang <61452667+yichiac@users.noreply.github.com>

* Update tests/datasets/test_south_america_soybean.py

Co-authored-by: Yi-Chia Chang <61452667+yichiac@users.noreply.github.com>

* Update torchgeo/datasets/south_america_soybean.py

Co-authored-by: Yi-Chia Chang <61452667+yichiac@users.noreply.github.com>

* Update torchgeo/datasets/south_america_soybean.py

Co-authored-by: Yi-Chia Chang <61452667+yichiac@users.noreply.github.com>

* Update torchgeo/datasets/south_america_soybean.py

Co-authored-by: Yi-Chia Chang <61452667+yichiac@users.noreply.github.com>

* Update torchgeo/datasets/south_america_soybean.py

Co-authored-by: Yi-Chia Chang <61452667+yichiac@users.noreply.github.com>

* Update torchgeo/datasets/south_america_soybean.py

Co-authored-by: Yi-Chia Chang <61452667+yichiac@users.noreply.github.com>

* Update torchgeo/datasets/south_america_soybean.py

Co-authored-by: Yi-Chia Chang <61452667+yichiac@users.noreply.github.com>

* Update torchgeo/datasets/south_america_soybean.py

Co-authored-by: Yi-Chia Chang <61452667+yichiac@users.noreply.github.com>

* Update torchgeo/datasets/south_america_soybean.py

Co-authored-by: Yi-Chia Chang <61452667+yichiac@users.noreply.github.com>

* Update torchgeo/datasets/south_america_soybean.py

Co-authored-by: Yi-Chia Chang <61452667+yichiac@users.noreply.github.com>

* Update torchgeo/datasets/south_america_soybean.py

Co-authored-by: Yi-Chia Chang <61452667+yichiac@users.noreply.github.com>

* Update tests/datasets/test_south_america_soybean.py

Co-authored-by: Yi-Chia Chang <61452667+yichiac@users.noreply.github.com>

* Update tests/datasets/test_south_america_soybean.py

Co-authored-by: Yi-Chia Chang <61452667+yichiac@users.noreply.github.com>

* Update tests/datasets/test_south_america_soybean.py

Co-authored-by: Yi-Chia Chang <61452667+yichiac@users.noreply.github.com>

* Update tests/datasets/test_south_america_soybean.py

Co-authored-by: Yi-Chia Chang <61452667+yichiac@users.noreply.github.com>

* Update torchgeo/datasets/south_america_soybean.py

Co-authored-by: Yi-Chia Chang <61452667+yichiac@users.noreply.github.com>

* Update tests/datasets/test_south_america_soybean.py

Co-authored-by: Yi-Chia Chang <61452667+yichiac@users.noreply.github.com>

* Update tests/datasets/test_south_america_soybean.py

Co-authored-by: Yi-Chia Chang <61452667+yichiac@users.noreply.github.com>

* Update tests/datasets/test_south_america_soybean.py

Co-authored-by: Yi-Chia Chang <61452667+yichiac@users.noreply.github.com>

* Update torchgeo/datasets/south_america_soybean.py

Co-authored-by: Yi-Chia Chang <61452667+yichiac@users.noreply.github.com>

* Update torchgeo/datasets/south_america_soybean.py

Co-authored-by: Yi-Chia Chang <61452667+yichiac@users.noreply.github.com>

* Update torchgeo/datasets/south_america_soybean.py

Co-authored-by: Yi-Chia Chang <61452667+yichiac@users.noreply.github.com>

* Update torchgeo/datasets/south_america_soybean.py

Co-authored-by: Yi-Chia Chang <61452667+yichiac@users.noreply.github.com>

* Update torchgeo/datasets/south_america_soybean.py

Co-authored-by: Yi-Chia Chang <61452667+yichiac@users.noreply.github.com>

* Update torchgeo/datasets/south_america_soybean.py

Co-authored-by: Yi-Chia Chang <61452667+yichiac@users.noreply.github.com>

* Update torchgeo/datasets/south_america_soybean.py

Co-authored-by: Yi-Chia Chang <61452667+yichiac@users.noreply.github.com>

* Update tests/datasets/test_south_america_soybean.py

Co-authored-by: Yi-Chia Chang <61452667+yichiac@users.noreply.github.com>

* Update tests/datasets/test_south_america_soybean.py

Co-authored-by: Yi-Chia Chang <61452667+yichiac@users.noreply.github.com>

* Update tests/datasets/test_south_america_soybean.py

Co-authored-by: Yi-Chia Chang <61452667+yichiac@users.noreply.github.com>

* Update torchgeo/datasets/south_america_soybean.py

Co-authored-by: Yi-Chia Chang <61452667+yichiac@users.noreply.github.com>

* Update torchgeo/datasets/south_america_soybean.py

Co-authored-by: Yi-Chia Chang <61452667+yichiac@users.noreply.github.com>

* Update torchgeo/datasets/south_america_soybean.py

Co-authored-by: Yi-Chia Chang <61452667+yichiac@users.noreply.github.com>

* Update tests/datasets/test_south_america_soybean.py

Co-authored-by: Yi-Chia Chang <61452667+yichiac@users.noreply.github.com>

* Update tests/datasets/test_south_america_soybean.py

Co-authored-by: Yi-Chia Chang <61452667+yichiac@users.noreply.github.com>

* Update tests/datasets/test_south_america_soybean.py

Co-authored-by: Yi-Chia Chang <61452667+yichiac@users.noreply.github.com>

* Updated tests

* fixed an error in init

* fixed some path inconsistencies

* fixed all errors

* Fix comments

* added dataset to datasets.rst

* edit datasets.rst

* pushed again

* Delete tests/data/south_america_soybean/.DS_Store

* Update docs/api/datasets.rst

Co-authored-by: Yi-Chia Chang <61452667+yichiac@users.noreply.github.com>

* Edited datasets.rst

* Edited datasets.rst

* Fixed styling

* Fix docstring formatting

* Fix whitespace

* Add blank line

* Fixed download urls

* Update geo_datasets.csv

* Update torchgeo/datasets/south_america_soybean.py

Co-authored-by: Adam J. Stewart <ajstewart426@gmail.com>

* Update torchgeo/datasets/south_america_soybean.py

Co-authored-by: Adam J. Stewart <ajstewart426@gmail.com>

* Update torchgeo/datasets/south_america_soybean.py

Co-authored-by: Adam J. Stewart <ajstewart426@gmail.com>

* Updated geo_datasets.csv and added years parameter to class

* Delete tests/data/.DS_Store

* Delete tests/.DS_Store

* Update south_america_soybean.py

* Fix docstring formatting

---------

Co-authored-by: Yi-Chia Chang <61452667+yichiac@users.noreply.github.com>
Co-authored-by: Adam J. Stewart <ajstewart426@gmail.com>
2024-02-06 06:11:17 -06:00
Favyen Bastani a3f3e40541
Add EuroCrops dataset (#1813)
* Add EuroCrops vector dataset.

* Fix flake8 errors.

* apply black check reformatting

* flake8/black checks

* more test fixes

* more test fixes

* remove itertools product import

* isort test

* Cast integer indexes to long to work with old pytorch version.

* Add EuroCrops to files in docs/api/

* Update resolution to correspond to 10 m/pixel in WGS-84.

But EuroCrops shapefiles are in many different CRS depending on the country,
some WGS-84 others EPSG:31287, EPSG:5514, etc.

* Add int_array_to_tensor function to convert numpy uint16/32 arrays to
pytorch int32/64 tensors.

* add number of polygons to eurocrops dataset description

* Updates per PR discussion

* Add filename_glob and implement filename_regex to work with automatic date extraction.

* Update torchgeo/datasets/eurocrops.py

Co-authored-by: Adam J. Stewart <ajstewart426@gmail.com>

* Fix int_array_to_tensor for non-int inputs.

* type annotation fix

* type annotation fix x2

* Add additional classes parameters to test to improve coverage of eurocrops dataset

* Update label_fn change to overloadable VectorDataset._get_label function.

* Use color gradient for visualizing EuroCrops masks

* Fix apply_cmap bugs.

* Fix get_cmap call for old matplotlib version

* public get_label and eurocrops regex update

* Match two-letter country code only

* versionadded notes and fiona.Feature type/doc fix

* test dataset integrity failure

* Use fiona.model.Feature consistently.

---------

Co-authored-by: Adam J. Stewart <ajstewart426@gmail.com>
2024-01-26 11:04:22 -06:00
Adam J. Stewart d998cb7459
Airphen: add new dataset (#1803)
* Airphen: add new dataset

* Add paper to cite

* Make it sound less like marketing material
2024-01-26 09:32:08 -06:00
Ashwin Nair 0f8b0ac3ea
Add VHR10 datamodule (#1082)
* Add VHR10 datamodule

* Add newline

* patch_size accepts int and tuple of ints

* Update conf

* VHR10 Datamodule v2

* Remove auto_lr_find

* Remove preprocess

* Update config

* Remove setting of matplotlib backend

* Remove import

* Typing update

* Key fix

* Coverage fix

* Update conf

* Update conf

* Dowload=True

* Use weights

* Empty commit

* Switch to ndim

* Remove conf, tight_layout and spacing

* Set constrained layout via rcParams

* Revert and bump min matplotlib version

* Switch back to dataset_split

* Separate out AugPipe

* Increase figsize & revert matplotlib

* Common collate_fn

* Class var std

* Undo std change in BaseDataModule

* Undo req changes

* Remove unused line

* Add version strings

* mypy fix

---------

Co-authored-by: Adam J. Stewart <ajstewart426@gmail.com>
2024-01-25 18:06:11 +00:00
Odd Eirik Igland 79cba043da
VectorDataset: extract mint/maxt from filename (#1814)
* filter by date

* added date format docstring

* added test

* moving match

* simpler date

* changed the name in data

* mypy
2024-01-19 13:21:46 -06:00
George Huber 43d7133614
Add CropHarvest Dataset (#1677)
* initial commit

* Added functionality to cropharvest dataset

* Added test coverage

* test fixes

* mdpy typing

* flake8 revision

* added docs

* fixed h5py import

* fix .rst underline

* updated tests to mock h5py module

* fixed documentation

* fixed black formating

* turn labels to tensors

* fix data generationa and mdpy for tensor encoding

* update verify model

* doc style

* test coverage

* fix test coverage leaks

* Update torchgeo/datasets/cropharvest.py

Co-authored-by: Adam J. Stewart <ajstewart426@gmail.com>

* Update torchgeo/datasets/cropharvest.py

Co-authored-by: Adam J. Stewart <ajstewart426@gmail.com>

* Update torchgeo/datasets/cropharvest.py

Co-authored-by: Adam J. Stewart <ajstewart426@gmail.com>

* Update torchgeo/datasets/cropharvest.py

Co-authored-by: Adam J. Stewart <ajstewart426@gmail.com>

* update test data path and monkeypatch

* Update torchgeo/datasets/cropharvest.py

Co-authored-by: Adam J. Stewart <ajstewart426@gmail.com>

* Update torchgeo/datasets/cropharvest.py

Co-authored-by: Adam J. Stewart <ajstewart426@gmail.com>

* remove hard coded classes

* fixed plot and label one hot encoding

* refactor datasetnotfounderror

* resolve conflict with main

* refactored importerror

* mdpy

* Update torchgeo/datasets/cropharvest.py

Co-authored-by: Adam J. Stewart <ajstewart426@gmail.com>

* Update torchgeo/datasets/cropharvest.py

Co-authored-by: Adam J. Stewart <ajstewart426@gmail.com>

* Update torchgeo/datasets/cropharvest.py

Co-authored-by: Adam J. Stewart <ajstewart426@gmail.com>

* Update torchgeo/datasets/cropharvest.py

Co-authored-by: Adam J. Stewart <ajstewart426@gmail.com>

* Update torchgeo/datasets/cropharvest.py

Co-authored-by: Adam J. Stewart <ajstewart426@gmail.com>

* Update torchgeo/datasets/cropharvest.py

Co-authored-by: Adam J. Stewart <ajstewart426@gmail.com>

* Update torchgeo/datasets/cropharvest.py

Co-authored-by: Adam J. Stewart <ajstewart426@gmail.com>

* Update torchgeo/datasets/cropharvest.py

Co-authored-by: Adam J. Stewart <ajstewart426@gmail.com>

* Remove empty class and correct csv

* Update cropharvest.py

* formatting changes

---------

Co-authored-by: georgehuber <“georgehuber8@gmail.com”>
Co-authored-by: Adam J. Stewart <ajstewart426@gmail.com>
Co-authored-by: Caleb Robinson <calebrob6@gmail.com>
2024-01-19 06:39:24 -06:00
Caleb Robinson 436baa9773
Fix the default folds and assertion for checking valid folds in PASTIS (#1810)
* Fix the default folds and assertion for checking valid folds in PASTIS

* Maybe fix PASTIS tests

* Update data
2024-01-16 06:26:12 -06:00
Adam J. Stewart 5c673575ea
Ensure that all files have the license header at the top (#1787) 2023-12-22 07:29:06 -06:00
Isaac Corley 46f4be7b72
LEVIR-CD Dataset and Datamodule (#1770)
* add LEVIRCD datamodule

* refactor to base class and add LEVIR-CD dataset

* refactor and add LEVIRCD dataset and datamodule

* add version added

* fix mypy errors

* remove temp notebook

* add data.py script for levircdplus

* update docs

* fix docs

* add versionchanged
2023-12-17 03:51:19 +00:00
Adam J. Stewart 59755dd3eb
Add PRISMA dataset (#1743)
* Add PRISMA dataset

* Add documentation

* Add plotting

* Add tests

* Widest possible time range

* Fix sorting

* Document how to convert HDF5 to GeoTIFF
2023-12-08 10:52:20 -06:00
Isaac Corley 4cc0cbb327
Add ChaBuD Dataset (#1259)
* add chabud dataset and datamodule

* add clarifying comment for min/max

* fix wrong channel plotting

* cast image as float

* sort uuids

* add chabud dataset and datamodule

* add clarifying comment for min/max

* fix wrong channel plotting

* cast image as float

* sort uuids

* add chabud dataset and datamodule

* add clarifying comment for min/max

* fix wrong channel plotting

* cast image as float

* sort uuids

* update docs

* update test data

* fix order of operations

* update chabud config

* update per suggestions

* fix mypy error

* update to new test config format

* update version added

* use DatasetNotFoundError

* fix tests

* updates per suggestions

* Matching bands/mean/std

---------

Co-authored-by: Adam J. Stewart <ajstewart426@gmail.com>
2023-11-25 15:19:20 -06:00
shreyakannan1205 bc5cb4c83f
Adding Northeastern China Crop Map Dataset (#1666)
* Add files via upload

Initial commit for adding Northeastern China Crop Map dataset

* Added northeastern_china_cropmap (NCCM) definition to _init_.py

* Update northeastern_china_cropmap.py

* Added tests/data

* added test_nccm.py

* Updated datasets.rst and geo_datasets.csv

* Latest changes to nccm.py

* changes to data.py, nccm.py, test_nccm.py

* Update test_nccm.py

* Debug 1

* new changes

* Latest update

* Update torchgeo/datasets/nccm.py

Co-authored-by: Yi-Chia Chang <61452667+yichiac@users.noreply.github.com>

* Fixed style errors

* Fixed style errors

* Fixed style errors

* Update docs/api/datasets.rst

Co-authored-by: Adam J. Stewart <ajstewart426@gmail.com>

* Update torchgeo/datasets/nccm.py

Co-authored-by: Adam J. Stewart <ajstewart426@gmail.com>

* Update torchgeo/datasets/nccm.py

Co-authored-by: Adam J. Stewart <ajstewart426@gmail.com>

* Delete tests/data/nccm/.DS_Store

* Update data.py

* Update nccm.py

* Update torchgeo/datasets/nccm.py

Co-authored-by: Adam J. Stewart <ajstewart426@gmail.com>

* Update torchgeo/datasets/nccm.py

Co-authored-by: Adam J. Stewart <ajstewart426@gmail.com>

* Update torchgeo/datasets/nccm.py

Co-authored-by: Adam J. Stewart <ajstewart426@gmail.com>

* Update torchgeo/datasets/nccm.py

Co-authored-by: Adam J. Stewart <ajstewart426@gmail.com>

* Update nccm.py

* Update nccm.py

* Resolved few comments

* Fixed plotting functions, resolved comments

* Fixed test cases

* Fixed doc issue

* Latest

* Fixed doc

* Latest

* Latest

* Latest

* Update torchgeo/datasets/nccm.py

Co-authored-by: Adam J. Stewart <ajstewart426@gmail.com>

* Latest changes: removed years

* Update torchgeo/datasets/nccm.py

Co-authored-by: Yi-Chia Chang <61452667+yichiac@users.noreply.github.com>

* Update torchgeo/datasets/nccm.py

Co-authored-by: Yi-Chia Chang <61452667+yichiac@users.noreply.github.com>

* Update torchgeo/datasets/nccm.py

Co-authored-by: Yi-Chia Chang <61452667+yichiac@users.noreply.github.com>

* Update torchgeo/datasets/nccm.py

Co-authored-by: Yi-Chia Chang <61452667+yichiac@users.noreply.github.com>

* Update torchgeo/datasets/nccm.py

Co-authored-by: Yi-Chia Chang <61452667+yichiac@users.noreply.github.com>

* Update torchgeo/datasets/nccm.py

Co-authored-by: Yi-Chia Chang <61452667+yichiac@users.noreply.github.com>

* Removed unnecessary variables and fixed download path

* Latest changes

* Latest changes

* Latest changes

* Fixed spacing

* Latest changes

* Update torchgeo/datasets/nccm.py

Co-authored-by: Adam J. Stewart <ajstewart426@gmail.com>

* Update docs/api/geo_datasets.csv

Co-authored-by: Adam J. Stewart <ajstewart426@gmail.com>

* Update nccm.py

* Update data.py

* Update nccm.py

* Update torchgeo/datasets/nccm.py

Co-authored-by: Yi-Chia Chang <61452667+yichiac@users.noreply.github.com>

* latest changes

* Latest

* Latest changes

* Fixed torch.full()

* removed print linke

---------

Co-authored-by: shreya28 <“shreya28@illinois.edu”>
Co-authored-by: Yi-Chia Chang <61452667+yichiac@users.noreply.github.com>
Co-authored-by: Adam J. Stewart <ajstewart426@gmail.com>
2023-11-17 21:25:07 +00:00
Nils Lehmann fa1862ab2b
Fix Download Link AGB Live Woody Biomass dataset (#1713)
* fix link

* one line link
2023-11-05 14:59:07 -06:00