microsoft
/
ai4eutils
зеркало из
1
0
Форкнуть 0
Код Задачи Пакеты Проекты Релизы Вики Активность
Shared utility scripts for AI for Earth projects and team members
190 коммитов 8 Ветки 0 Теги 2,7 MiB
Jupyter Notebook 76.1%
HTML 13.8%
Python 10%
Shell 0.1%
Перейти к файлу
Dan Morris 1bbbb8030d Added some new utility functions to path_utils and url_utils that are used a bunch in the CameraTraps repo. 2022-07-26 13:02:46 -07:00
TF_OD_API Added dockerfile and sh script to install TFODAPI (TF v 1.15) on Azure Ubuntu 16.04 DSVM (#6) 2020-01-22 12:17:48 -08:00
azcopy-bandwidth-test no message 2020-01-06 11:11:34 -08:00
azure-metrics-calc-storage-size no message 2021-07-20 13:48:27 -07:00
azure-sdk-calc-storage-size Merge branch 'master' of https://github.com/microsoft/ai4eutils 2021-11-07 15:14:54 -08:00
geospatial Updating docs 2021-06-22 23:38:43 +00:00
tests Update sas_blob_utils.py and unit tests 2020-09-11 01:10:20 +00:00
.gitignore Ignoring .vscode/ 2020-12-21 10:28:17 -08:00
LICENSE Initial commit 2018-12-07 14:40:39 -08:00
README.md Add directory structure to /geospatial. (#9) 2020-06-30 14:38:30 -07:00
ai4e_azure_utils.py Verbosity indicator in blob listing 2021-08-23 16:05:58 -07:00
ai4e_string_utils.py Removed string return value from human_readable_to_bytes 2020-08-11 11:49:53 -07:00
ai4e_web_utils.py verbosity control in download_url 2020-05-01 08:59:18 -07:00
back_up_blob_containers.py typo 2020-03-20 11:22:41 -07:00
directory_listing.py Sample invocation for directory_listing.py 2020-10-07 10:20:36 -07:00
enumerate_blob_folders_at_depth.py Comment change in enumerate_blob_folders_at_depth 2021-03-15 05:51:09 -07:00
gDrive_download.py Added gDrive_download.py 2019-03-14 16:47:33 -07:00
matlab_porting_tools.py moved some path functions from matlab_porting_tools to the much-more-sensible path_utils 2019-08-09 15:27:48 -07:00
mypy.ini Add mypy.ini 2020-08-13 15:16:15 -07:00
parallel_change_blob_access_tier.py Bug fix in rehydration verification 2021-08-09 18:01:02 +00:00
parallel_delete_blobs.py Bug fix in parallel_enumerate_blobs 2021-12-24 11:01:13 -08:00
parallel_enumerate_blobs.py Merge branch 'master' of https://github.com/microsoft/ai4eutils 2021-12-24 11:01:27 -08:00
parallel_enumerate_containers.py Printing sizes and access tiers in parallel_enumerate_containers 2021-11-08 07:51:23 -08:00
path_utils.py Added some new utility functions to path_utils and url_utils that are used a bunch in the CameraTraps repo. 2022-07-26 13:02:46 -07:00
pylintrc Add directory structure to /geospatial. (#9) 2020-06-30 14:38:30 -07:00
remove_empty_folders.py Added scripts for enumerating folders in a blob container a specified depth, enumerating blobs in parallel in a large blob container, and removing empty folder in a local file system 2020-10-29 12:55:09 -07:00
sas_blob_utils.py Verbosity indicator in blob listing 2021-08-23 16:05:58 -07:00
url_utils.py Added some new utility functions to path_utils and url_utils that are used a bunch in the CameraTraps repo. 2022-07-26 13:02:46 -07:00
write_html_image_list.py Added some new utility functions to path_utils and url_utils that are used a bunch in the CameraTraps repo. 2022-07-26 13:02:46 -07:00

README.md

Overview

Shared utilities developed by the Microsoft AI for Earth team

The general convention in this repo is that users who want to consume these utilities will add the top-level path of the repo to their Python path, so it's okay to assume that other packages/modules within the repo are available. The "scrap" directory can be used for standalone, one-time-use scripts that you might otherwise have emailed to someone.

Contents

  • path_utils.py: Miscellaneous useful utils for path manipulation, things that could almost be in os.path, but aren't.

  • matlab_porting_tools.py: A few ported Matlab functions that makes it easier to port other, larger Matlab functions to Python.

  • write_html_image_list.py: Given a list of image file names, writes an HTML file that shows all those images, with optional one-line headers above each.

  • sas_blob_utils.py: Helper functions for dealing with Shared Access Signatures (SAS) tokens for Azure Blob Storage.

  • TF_OD_API: A Dockerfile and a script to prepare a Docker image for use with the TensorFlow Object Detection API.

  • gDrive_download.py: Semi-automatic script for bulk download from shared Google Drives using the gDrive Python SDK.

  • azure-sdk-calc-storage-size: Script for recursively computing the size of all blobs and files in an Azure subscription.

  • azure-metrics-calc-storage-size: Script for computing the total size of all storage accounts in an Azure subscription (using Azure Metrics).

  • ai4e_azure_utils.py: Functions for interacting with the Azure Storage SDK

  • ai4e_web_utils.py: Functions for interacting with http requests

  • geospatial: Classes and utility functions for processing geospatial data for machine learning applications

Contributing

This project welcomes contributions and suggestions. Most contributions require you to agree to a Contributor License Agreement (CLA) declaring that you have the right to, and actually do, grant us the rights to use your contribution. For details, visit https://cla.microsoft.com.

When you submit a pull request, a CLA-bot will automatically determine whether you need to provide a CLA and decorate the PR appropriately (e.g., label, comment). Simply follow the instructions provided by the bot. You will only need to do this once across all repos using our CLA.

This project has adopted the Microsoft Open Source Code of Conduct. For more information see the Code of Conduct FAQ or contact opencode@microsoft.com with any additional questions or comments.