Siyu Yang
34ae8c4e88
Update geospatial_recipes.md
2020-12-22 23:39:47 -08:00
Siyu Yang
b8807acb39
Add another example for gdal_rasterize. Mention rclone can be used to access data exported to gDrive.
2020-12-22 23:23:44 -08:00
Caleb Robinson
a06b3c6d74
Ignoring .vscode/
...
Co-authored-by: Anthony Ortiz <anort@microsoft.com>
2020-12-21 10:28:17 -08:00
Caleb Robinson
e64ff96e94
Small changes to the geospatial datasets
2020-12-18 00:59:09 +00:00
Caleb Robinson
bf02d81add
Added some relevant functionality to StreamingDatasets
2020-12-17 23:08:25 +00:00
Caleb Robinson
b1e832245c
Adding per tile groups to use for normalization
2020-12-17 21:02:24 +00:00
Dan Morris
cd98c1e634
Allow multiple regexes in blob enumeration
2020-12-10 14:21:14 -08:00
Caleb Robinson
d21ced8d6a
Import fix, and adding a little bit more verbosity
2020-12-10 08:55:08 +00:00
Dan Morris
cd937aeccd
Removing some Windows-specific elements from azure-*-calc-storage
2020-11-28 18:30:30 -08:00
Caleb Robinson
222d70fb17
Added functionality to lookup NAIP tiles by geometry and accompanying test
2020-11-06 01:25:14 +00:00
Caleb Robinson
18a13406cc
Fixing bug where `base_path` could not exist
2020-11-05 21:52:57 +00:00
Caleb Robinson
263d2687be
Merge pull request #22 from microsoft/calebrob6-patch-2
...
Created a class for interfacing with the NAIP data on Azure
2020-11-05 13:50:06 -08:00
Caleb Robinson
6d4f5704c7
Created a class for interfacing with the NAIP data on Azure
...
Based almost entirely on the code from the example notebook at https://azure.microsoft.com/en-us/services/open-datasets/catalog/naip/ .
2020-11-05 13:39:40 -08:00
Siyu Yang
365ca160b4
Fix RasterLabelVisualizer to not use antialiasing that led to artifacts around masks.
2020-11-04 14:23:16 -08:00
Siyu Yang
3923cf0f70
Allow Imagery Visualizer to work on numpy arrays. Order classes to use in the tool in Raster Label Visualizer.
2020-11-04 14:23:16 -08:00
Dan Morris
b73da9879b
Merge branch 'master' of https://github.com/Microsoft/ai4eutils
2020-10-29 12:55:21 -07:00
Dan Morris
ecaa5ef90c
Added scripts for enumerating folders in a blob container a specified depth, enumerating blobs in parallel in a large blob container, and removing empty folder in a local file system
2020-10-29 12:55:09 -07:00
Caleb Robinson
58c9c2428b
Merge pull request #20 from microsoft/calebrob6-patch-2
...
Adding a Dataset for running inference over a single tile
2020-10-12 09:51:42 -07:00
Caleb Robinson
aab47b86a2
Adding a Dataset for running inference over a single tile
2020-10-09 16:24:08 -07:00
Dan Morris
88b75a42ef
Merge branch 'master' of https://github.com/Microsoft/ai4eutils
2020-10-07 10:20:42 -07:00
Dan Morris
4815860d74
Sample invocation for directory_listing.py
2020-10-07 10:20:36 -07:00
Siyu Yang
bffe855250
Minor modification to terminology section.
2020-10-01 15:47:09 -07:00
Dan Morris
57341ed369
Optionally allow overwrite in file upload to blob
2020-10-01 10:21:53 -07:00
Dan Morris
61ce752006
Allowing optional leading question marks in SAS tokens
2020-09-22 07:22:35 -07:00
Dan Morris
4f08390390
Minor ws changes in path_utils
2020-09-21 12:50:47 -07:00
Caleb Robinson
6cc0a374a6
Broken formatting
2020-09-14 15:19:09 -07:00
Dan Morris
c2a5fb4fdc
Merge branch 'master' of https://github.com/Microsoft/ai4eutils
...
# Conflicts:
# ai4e_azure_utils.py
2020-09-14 14:38:14 -07:00
Dan Morris
1e7db4aa1b
Fixed line break inconsistency in comments
2020-09-14 14:36:35 -07:00
Christopher Yeh
483f49661c
sas_blob_utils.py: fix type hint
2020-09-11 06:35:00 +00:00
Christopher Yeh
f64dcd10a6
Update sas_blob_utils.py and unit tests
...
azure-storage-blob is now on version 12.5.0, which has fixed a lot of the bugs that placed the earlier 12.x versions. Those fixes mean that we can actually run the unit tests now
2020-09-11 01:10:20 +00:00
Christopher Yeh
44251e597a
Update sas_blob_utils.py to use azure-storage-blob 12.5.0
...
azure-storage-blob 12.5.0 now has native BlobClient.exists() method
2020-09-10 23:34:06 +00:00
Caleb Robinson
0c46baa92d
Merge pull request #19 from microsoft/calebrob6-patch-2
...
Added recipe for creating a polygon based on a raster's extent
2020-09-02 20:07:17 -07:00
Caleb Robinson
15b9695c64
Added recipe for creating a polygon based on a raster's extent
2020-09-02 20:06:52 -07:00
Christopher Yeh
36d5edacb7
Remove note about Azure Storage Python SDK issue 12563, which has been fixed with SDK v12.4.0
2020-08-23 04:46:44 +00:00
Christopher Yeh
ad57866d79
sas_blob_utils.py: rename check_blob_existence() => check_blob_exists()
2020-08-23 04:45:49 +00:00
Christopher Yeh
f858789981
sas_blob_utils.py: URL-escape blob name where appropriate
2020-08-20 18:47:39 +00:00
Christopher Yeh
f0884fa1d4
ai4e_azure_utils.py: update to azure-storage-blob=12.4.0
2020-08-14 16:11:49 +00:00
Chris Yeh
74b2d6479e
Add mypy.ini
...
Same mypy.ini as in the CameraTraps repo
2020-08-13 15:16:15 -07:00
Caleb Robinson
21ddbd1ecc
Merge pull request #18 from microsoft/calebrob6-patch-1
...
Adding a pytorch Dataset for us to build on
2020-08-13 09:26:05 -07:00
Caleb Robinson
03777cef4e
Added a comment
2020-08-13 00:45:26 +00:00
Caleb Robinson
22cf561b5b
Updating the dataset class
2020-08-13 00:32:29 +00:00
Siyu Yang
cd949af39b
Return str from get_tool_colormap(). ( #17 )
2020-08-12 14:19:32 -07:00
Siyu Yang
347951613d
Add instructions for gdal2tiles for satellite imagery. ( #16 )
...
* Add instructions for gdal2tiles for satellite imagery.
* Add get_tool_colormap() to RasterLabelVisualizer.
2020-08-11 15:32:04 -07:00
Dan Morris
b6baa156d1
Removed string return value from human_readable_to_bytes
2020-08-11 11:49:53 -07:00
Dan Morris
82c4de01d7
Added ai4e_string_utils.py
2020-08-11 11:44:42 -07:00
Siyu Yang
16befbc117
Delete todo section from geospatial readme
2020-08-10 17:15:41 -07:00
Siyu Yang
4a32fa69a8
Blob storage endpoint. Fix ImageryVisualizer ( #15 )
...
* Add a method to get the blob storage endpoint used by a SAS URL.
* Fix issues in imagery_visualizer to display Landsat8 tiles.
* Use better default values for viewing Landsat imagery.
2020-08-10 17:13:53 -07:00
Caleb Robinson
5331c860e9
Adding streaming dataset
2020-07-31 18:55:01 -07:00
Caleb Robinson
df89c7b7a2
Update geospatial_recipes.md
2020-07-31 14:27:46 -07:00
Caleb Robinson
6e62d1a74b
`gdal_rasterize` doesn't have -overwrite
2020-07-27 15:57:50 -07:00