Shared utility scripts for AI for Earth projects and team members
Перейти к файлу
Chris Yeh 4e1f207282 Improve sas_blob_utils and add unit tests
There are many bugs in Azure's Python SDK
2020-07-15 23:53:44 -06:00
TF_OD_API Added dockerfile and sh script to install TFODAPI (TF v 1.15) on Azure Ubuntu 16.04 DSVM (#6) 2020-01-22 12:17:48 -08:00
azcopy-bandwidth-test no message 2020-01-06 11:11:34 -08:00
azure-metrics-calc-storage-size ws only 2019-12-06 10:08:54 -08:00
azure-sdk-calc-storage-size ws only 2019-12-06 10:08:54 -08:00
.gitignore Add utility functions for dealing with Azure blob storage SAS tokens. 2019-03-01 10:24:54 -08:00
LICENSE Initial commit 2018-12-07 14:40:39 -08:00
README.md Added functions for downloading files to temporary storage, started ai4e_web_utils 2020-04-25 17:02:34 -07:00
ai4e_azure_utils.py Allowing specification of a max number of blobs to enumerate 2020-06-07 00:24:16 +00:00
ai4e_web_utils.py verbosity control in download_url 2020-05-01 08:59:18 -07:00
back_up_blob_containers.py typo 2020-03-20 11:22:41 -07:00
directory_listing.py no message 2019-07-30 09:26:53 -07:00
gDrive_download.py Added gDrive_download.py 2019-03-14 16:47:33 -07:00
matlab_porting_tools.py moved some path functions from matlab_porting_tools to the much-more-sensible path_utils 2019-08-09 15:27:48 -07:00
path_utils.py Merge branch 'master' of https://github.com/Microsoft/ai4eutils 2019-11-25 19:28:43 -08:00
sas_blob_utils.py Improve sas_blob_utils and add unit tests 2020-07-15 23:53:44 -06:00
sas_blob_utils_test.py Improve sas_blob_utils and add unit tests 2020-07-15 23:53:44 -06:00
write_html_image_list.py Now removing unicode characters in write_html_image_list; unicode causes fwrite to fail in some scenarios. 2019-05-26 08:07:42 -07:00

README.md

Overview

Shared utilities developed by the Microsoft AI for Earth team

The general convention in this repo is that users who want to consume these utilities will add the top-level path of the repo to their Python path, so it's okay to assume that other packages/modules within the repo are available. The "scrap" directory can be used for standalone, one-time-use scripts that you might otherwise have emailed to someone.

Contents

  • path_utils.py: Miscellaneous useful utils for path manipulation, things that could almost be in os.path, but aren't.

  • matlab_porting_tools.py: A few ported Matlab functions that makes it easier to port other, larger Matlab functions to Python.

  • write_html_image_list.py: Given a list of image file names, writes an HTML file that shows all those images, with optional one-line headers above each.

  • sas_blob_utils.py: Helper functions for dealing with Shared Access Signatures (SAS) tokens for Azure Blob Storage.

  • TF_OD_API: A Dockerfile and a script to prepare a Docker image for use with the TensorFlow Object Detection API.

  • gDrive_download.py: Semi-automatic script for bulk download from shared Google Drives using the gDrive Python SDK.

  • azure-sdk-calc-storage-size: Script for recursively computing the size of all blobs and files in an Azure subscription.

  • azure-metrics-calc-storage-size: Script for computing the total size of all storage accounts in an Azure subscription (using Azure Metrics).

  • ai4e_azure_utils.py: Functions for interacting with the Azure Storage SDK

  • ai4e_web_utils.py: Functions for interacting with http requests

Contributing

This project welcomes contributions and suggestions. Most contributions require you to agree to a Contributor License Agreement (CLA) declaring that you have the right to, and actually do, grant us the rights to use your contribution. For details, visit https://cla.microsoft.com.

When you submit a pull request, a CLA-bot will automatically determine whether you need to provide a CLA and decorate the PR appropriately (e.g., label, comment). Simply follow the instructions provided by the bot. You will only need to do this once across all repos using our CLA.

This project has adopted the Microsoft Open Source Code of Conduct. For more information see the Code of Conduct FAQ or contact opencode@microsoft.com with any additional questions or comments.