Граф коммитов

201 Коммитов

Автор SHA1 Сообщение Дата
Siyu Yang 34ae8c4e88
Update geospatial_recipes.md 2020-12-22 23:39:47 -08:00
Siyu Yang b8807acb39 Add another example for gdal_rasterize. Mention rclone can be used to access data exported to gDrive. 2020-12-22 23:23:44 -08:00
Caleb Robinson a06b3c6d74 Ignoring .vscode/
Co-authored-by: Anthony Ortiz <anort@microsoft.com>
2020-12-21 10:28:17 -08:00
Caleb Robinson e64ff96e94 Small changes to the geospatial datasets 2020-12-18 00:59:09 +00:00
Caleb Robinson bf02d81add Added some relevant functionality to StreamingDatasets 2020-12-17 23:08:25 +00:00
Caleb Robinson b1e832245c Adding per tile groups to use for normalization 2020-12-17 21:02:24 +00:00
Dan Morris cd98c1e634 Allow multiple regexes in blob enumeration 2020-12-10 14:21:14 -08:00
Caleb Robinson d21ced8d6a Import fix, and adding a little bit more verbosity 2020-12-10 08:55:08 +00:00
Dan Morris cd937aeccd Removing some Windows-specific elements from azure-*-calc-storage 2020-11-28 18:30:30 -08:00
Caleb Robinson 222d70fb17 Added functionality to lookup NAIP tiles by geometry and accompanying test 2020-11-06 01:25:14 +00:00
Caleb Robinson 18a13406cc Fixing bug where `base_path` could not exist 2020-11-05 21:52:57 +00:00
Caleb Robinson 263d2687be
Merge pull request #22 from microsoft/calebrob6-patch-2
Created a class for interfacing with the NAIP data on Azure
2020-11-05 13:50:06 -08:00
Caleb Robinson 6d4f5704c7
Created a class for interfacing with the NAIP data on Azure
Based almost entirely on the code from the example notebook at https://azure.microsoft.com/en-us/services/open-datasets/catalog/naip/.
2020-11-05 13:39:40 -08:00
Siyu Yang 365ca160b4 Fix RasterLabelVisualizer to not use antialiasing that led to artifacts around masks. 2020-11-04 14:23:16 -08:00
Siyu Yang 3923cf0f70 Allow Imagery Visualizer to work on numpy arrays. Order classes to use in the tool in Raster Label Visualizer. 2020-11-04 14:23:16 -08:00
Dan Morris b73da9879b Merge branch 'master' of https://github.com/Microsoft/ai4eutils 2020-10-29 12:55:21 -07:00
Dan Morris ecaa5ef90c Added scripts for enumerating folders in a blob container a specified depth, enumerating blobs in parallel in a large blob container, and removing empty folder in a local file system 2020-10-29 12:55:09 -07:00
Caleb Robinson 58c9c2428b
Merge pull request #20 from microsoft/calebrob6-patch-2
Adding a Dataset for running inference over a single tile
2020-10-12 09:51:42 -07:00
Caleb Robinson aab47b86a2
Adding a Dataset for running inference over a single tile 2020-10-09 16:24:08 -07:00
Dan Morris 88b75a42ef Merge branch 'master' of https://github.com/Microsoft/ai4eutils 2020-10-07 10:20:42 -07:00
Dan Morris 4815860d74 Sample invocation for directory_listing.py 2020-10-07 10:20:36 -07:00
Siyu Yang bffe855250
Minor modification to terminology section. 2020-10-01 15:47:09 -07:00
Dan Morris 57341ed369 Optionally allow overwrite in file upload to blob 2020-10-01 10:21:53 -07:00
Dan Morris 61ce752006 Allowing optional leading question marks in SAS tokens 2020-09-22 07:22:35 -07:00
Dan Morris 4f08390390 Minor ws changes in path_utils 2020-09-21 12:50:47 -07:00
Caleb Robinson 6cc0a374a6
Broken formatting 2020-09-14 15:19:09 -07:00
Dan Morris c2a5fb4fdc Merge branch 'master' of https://github.com/Microsoft/ai4eutils
# Conflicts:
#	ai4e_azure_utils.py
2020-09-14 14:38:14 -07:00
Dan Morris 1e7db4aa1b Fixed line break inconsistency in comments 2020-09-14 14:36:35 -07:00
Christopher Yeh 483f49661c sas_blob_utils.py: fix type hint 2020-09-11 06:35:00 +00:00
Christopher Yeh f64dcd10a6 Update sas_blob_utils.py and unit tests
azure-storage-blob is now on version 12.5.0, which has fixed a lot of the bugs that placed the earlier 12.x versions. Those fixes mean that we can actually run the unit tests now
2020-09-11 01:10:20 +00:00
Christopher Yeh 44251e597a Update sas_blob_utils.py to use azure-storage-blob 12.5.0
azure-storage-blob 12.5.0 now has native BlobClient.exists() method
2020-09-10 23:34:06 +00:00
Caleb Robinson 0c46baa92d
Merge pull request #19 from microsoft/calebrob6-patch-2
Added recipe for creating a polygon based on a raster's extent
2020-09-02 20:07:17 -07:00
Caleb Robinson 15b9695c64
Added recipe for creating a polygon based on a raster's extent 2020-09-02 20:06:52 -07:00
Christopher Yeh 36d5edacb7 Remove note about Azure Storage Python SDK issue 12563, which has been fixed with SDK v12.4.0 2020-08-23 04:46:44 +00:00
Christopher Yeh ad57866d79 sas_blob_utils.py: rename check_blob_existence() => check_blob_exists() 2020-08-23 04:45:49 +00:00
Christopher Yeh f858789981 sas_blob_utils.py: URL-escape blob name where appropriate 2020-08-20 18:47:39 +00:00
Christopher Yeh f0884fa1d4 ai4e_azure_utils.py: update to azure-storage-blob=12.4.0 2020-08-14 16:11:49 +00:00
Chris Yeh 74b2d6479e Add mypy.ini
Same mypy.ini as in the CameraTraps repo
2020-08-13 15:16:15 -07:00
Caleb Robinson 21ddbd1ecc
Merge pull request #18 from microsoft/calebrob6-patch-1
Adding a pytorch Dataset for us to build on
2020-08-13 09:26:05 -07:00
Caleb Robinson 03777cef4e Added a comment 2020-08-13 00:45:26 +00:00
Caleb Robinson 22cf561b5b Updating the dataset class 2020-08-13 00:32:29 +00:00
Siyu Yang cd949af39b
Return str from get_tool_colormap(). (#17) 2020-08-12 14:19:32 -07:00
Siyu Yang 347951613d
Add instructions for gdal2tiles for satellite imagery. (#16)
* Add instructions for gdal2tiles for satellite imagery.

* Add get_tool_colormap() to RasterLabelVisualizer.
2020-08-11 15:32:04 -07:00
Dan Morris b6baa156d1 Removed string return value from human_readable_to_bytes 2020-08-11 11:49:53 -07:00
Dan Morris 82c4de01d7 Added ai4e_string_utils.py 2020-08-11 11:44:42 -07:00
Siyu Yang 16befbc117
Delete todo section from geospatial readme 2020-08-10 17:15:41 -07:00
Siyu Yang 4a32fa69a8
Blob storage endpoint. Fix ImageryVisualizer (#15)
* Add a method to get the blob storage endpoint used by a SAS URL.

* Fix issues in imagery_visualizer to display Landsat8 tiles.

* Use better default values for viewing Landsat imagery.
2020-08-10 17:13:53 -07:00
Caleb Robinson 5331c860e9
Adding streaming dataset 2020-07-31 18:55:01 -07:00
Caleb Robinson df89c7b7a2
Update geospatial_recipes.md 2020-07-31 14:27:46 -07:00
Caleb Robinson 6e62d1a74b
`gdal_rasterize` doesn't have -overwrite 2020-07-27 15:57:50 -07:00