2018-08-11 02:48:16 +03:00
|
|
|
## ignore .DS_Store on macOS
|
|
|
|
|
*.DS_Store
|
|
|
|
|
|
2017-10-31 00:24:08 +03:00
|
|
|
## Ignore Visual Studio temporary files, build results, and
|
|
|
|
|
## files generated by popular Visual Studio add-ons.
|
|
|
|
|
##
|
|
|
|
|
## Get latest from https://github.com/github/gitignore/blob/master/VisualStudio.gitignore
|
|
|
|
|
|
|
|
|
|
# User-specific files
|
|
|
|
|
*.suo
|
|
|
|
|
*.user
|
|
|
|
|
*.userosscache
|
|
|
|
|
*.sln.docstates
|
|
|
|
|
|
|
|
|
|
# User-specific files (MonoDevelop/Xamarin Studio)
|
|
|
|
|
*.userprefs
|
|
|
|
|
|
|
|
|
|
# Build results
|
|
|
|
|
[Dd]ebug/
|
|
|
|
|
[Dd]ebugPublic/
|
|
|
|
|
[Rr]elease/
|
|
|
|
|
[Rr]eleases/
|
|
|
|
|
x64/
|
|
|
|
|
x86/
|
|
|
|
|
bld/
|
|
|
|
|
[Bb]in/
|
|
|
|
|
[Oo]bj/
|
|
|
|
|
[Ll]og/
|
|
|
|
|
|
|
|
|
|
# Visual Studio 2015 cache/options directory
|
|
|
|
|
.vs/
|
|
|
|
|
# Uncomment if you have tasks that create the project's static files in wwwroot
|
|
|
|
|
#wwwroot/
|
|
|
|
|
|
|
|
|
|
# MSTest test Results
|
|
|
|
|
[Tt]est[Rr]esult*/
|
|
|
|
|
[Bb]uild[Ll]og.*
|
|
|
|
|
|
|
|
|
|
# NUNIT
|
|
|
|
|
*.VisualState.xml
|
|
|
|
|
TestResult.xml
|
|
|
|
|
|
|
|
|
|
# Build Results of an ATL Project
|
|
|
|
|
[Dd]ebugPS/
|
|
|
|
|
[Rr]eleasePS/
|
|
|
|
|
dlldata.c
|
|
|
|
|
|
|
|
|
|
# .NET Core
|
|
|
|
|
project.lock.json
|
|
|
|
|
project.fragment.lock.json
|
|
|
|
|
artifacts/
|
|
|
|
|
**/Properties/launchSettings.json
|
|
|
|
|
|
|
|
|
|
*_i.c
|
|
|
|
|
*_p.c
|
|
|
|
|
*_i.h
|
|
|
|
|
*.ilk
|
|
|
|
|
*.meta
|
|
|
|
|
*.obj
|
|
|
|
|
*.pch
|
|
|
|
|
*.pdb
|
|
|
|
|
*.pgc
|
|
|
|
|
*.pgd
|
|
|
|
|
*.rsp
|
|
|
|
|
*.sbr
|
|
|
|
|
*.tlb
|
|
|
|
|
*.tli
|
|
|
|
|
*.tlh
|
|
|
|
|
*.tmp
|
|
|
|
|
*.tmp_proj
|
|
|
|
|
*.log
|
|
|
|
|
*.vspscc
|
|
|
|
|
*.vssscc
|
|
|
|
|
.builds
|
|
|
|
|
*.pidb
|
|
|
|
|
*.svclog
|
|
|
|
|
*.scc
|
|
|
|
|
|
|
|
|
|
# Chutzpah Test files
|
|
|
|
|
_Chutzpah*
|
|
|
|
|
|
|
|
|
|
# Visual C++ cache files
|
|
|
|
|
ipch/
|
|
|
|
|
*.aps
|
|
|
|
|
*.ncb
|
|
|
|
|
*.opendb
|
|
|
|
|
*.opensdf
|
|
|
|
|
*.sdf
|
|
|
|
|
*.cachefile
|
|
|
|
|
*.VC.db
|
|
|
|
|
*.VC.VC.opendb
|
|
|
|
|
|
|
|
|
|
# Visual Studio profiler
|
|
|
|
|
*.psess
|
|
|
|
|
*.vsp
|
|
|
|
|
*.vspx
|
|
|
|
|
*.sap
|
|
|
|
|
|
|
|
|
|
# TFS 2012 Local Workspace
|
|
|
|
|
$tf/
|
|
|
|
|
|
|
|
|
|
# Guidance Automation Toolkit
|
|
|
|
|
*.gpState
|
|
|
|
|
|
|
|
|
|
# ReSharper is a .NET coding add-in
|
|
|
|
|
_ReSharper*/
|
|
|
|
|
*.[Rr]e[Ss]harper
|
|
|
|
|
*.DotSettings.user
|
|
|
|
|
|
|
|
|
|
# JustCode is a .NET coding add-in
|
|
|
|
|
.JustCode
|
|
|
|
|
|
|
|
|
|
# TeamCity is a build add-in
|
|
|
|
|
_TeamCity*
|
|
|
|
|
|
|
|
|
|
# DotCover is a Code Coverage Tool
|
|
|
|
|
*.dotCover
|
|
|
|
|
|
|
|
|
|
# Visual Studio code coverage results
|
|
|
|
|
*.coverage
|
|
|
|
|
*.coveragexml
|
|
|
|
|
|
|
|
|
|
# NCrunch
|
|
|
|
|
_NCrunch_*
|
|
|
|
|
.*crunch*.local.xml
|
|
|
|
|
nCrunchTemp_*
|
|
|
|
|
|
|
|
|
|
# MightyMoose
|
|
|
|
|
*.mm.*
|
|
|
|
|
AutoTest.Net/
|
|
|
|
|
|
|
|
|
|
# Web workbench (sass)
|
|
|
|
|
.sass-cache/
|
|
|
|
|
|
|
|
|
|
# Installshield output folder
|
|
|
|
|
[Ee]xpress/
|
|
|
|
|
|
|
|
|
|
# DocProject is a documentation generator add-in
|
|
|
|
|
DocProject/buildhelp/
|
|
|
|
|
DocProject/Help/*.HxT
|
|
|
|
|
DocProject/Help/*.HxC
|
|
|
|
|
DocProject/Help/*.hhc
|
|
|
|
|
DocProject/Help/*.hhk
|
|
|
|
|
DocProject/Help/*.hhp
|
|
|
|
|
DocProject/Help/Html2
|
|
|
|
|
DocProject/Help/html
|
|
|
|
|
|
|
|
|
|
# Click-Once directory
|
|
|
|
|
publish/
|
|
|
|
|
|
|
|
|
|
# Publish Web Output
|
|
|
|
|
*.[Pp]ublish.xml
|
|
|
|
|
*.azurePubxml
|
|
|
|
|
# TODO: Comment the next line if you want to checkin your web deploy settings
|
|
|
|
|
# but database connection strings (with potential passwords) will be unencrypted
|
|
|
|
|
*.pubxml
|
|
|
|
|
*.publishproj
|
|
|
|
|
|
|
|
|
|
# Microsoft Azure Web App publish settings. Comment the next line if you want to
|
|
|
|
|
# checkin your Azure Web App publish settings, but sensitive information contained
|
|
|
|
|
# in these scripts will be unencrypted
|
|
|
|
|
PublishScripts/
|
|
|
|
|
|
|
|
|
|
# NuGet Packages
|
|
|
|
|
*.nupkg
|
|
|
|
|
# The packages folder can be ignored because of Package Restore
|
|
|
|
|
**/packages/*
|
|
|
|
|
# except build/, which is used as an MSBuild target.
|
|
|
|
|
!**/packages/build/
|
|
|
|
|
# Uncomment if necessary however generally it will be regenerated when needed
|
|
|
|
|
#!**/packages/repositories.config
|
|
|
|
|
# NuGet v3's project.json files produces more ignorable files
|
|
|
|
|
*.nuget.props
|
|
|
|
|
*.nuget.targets
|
|
|
|
|
|
|
|
|
|
# Microsoft Azure Build Output
|
|
|
|
|
csx/
|
|
|
|
|
*.build.csdef
|
|
|
|
|
|
|
|
|
|
# Microsoft Azure Emulator
|
|
|
|
|
ecf/
|
|
|
|
|
rcf/
|
|
|
|
|
|
|
|
|
|
# Windows Store app package directories and files
|
|
|
|
|
AppPackages/
|
|
|
|
|
BundleArtifacts/
|
|
|
|
|
Package.StoreAssociation.xml
|
|
|
|
|
_pkginfo.txt
|
|
|
|
|
|
|
|
|
|
# Visual Studio cache files
|
|
|
|
|
# files ending in .cache can be ignored
|
|
|
|
|
*.[Cc]ache
|
|
|
|
|
# but keep track of directories ending in .cache
|
|
|
|
|
!*.[Cc]ache/
|
|
|
|
|
|
|
|
|
|
# Others
|
|
|
|
|
ClientBin/
|
|
|
|
|
~$*
|
|
|
|
|
*~
|
|
|
|
|
*.dbmdl
|
|
|
|
|
*.dbproj.schemaview
|
|
|
|
|
*.jfm
|
|
|
|
|
*.pfx
|
|
|
|
|
*.publishsettings
|
|
|
|
|
orleans.codegen.cs
|
|
|
|
|
|
|
|
|
|
# Since there are multiple workflows, uncomment next line to ignore bower_components
|
|
|
|
|
# (https://github.com/github/gitignore/pull/1529#issuecomment-104372622)
|
|
|
|
|
#bower_components/
|
|
|
|
|
|
|
|
|
|
# RIA/Silverlight projects
|
|
|
|
|
Generated_Code/
|
|
|
|
|
|
|
|
|
|
# Backup & report files from converting an old project file
|
|
|
|
|
# to a newer Visual Studio version. Backup files are not needed,
|
|
|
|
|
# because we have git ;-)
|
|
|
|
|
_UpgradeReport_Files/
|
|
|
|
|
Backup*/
|
|
|
|
|
UpgradeLog*.XML
|
|
|
|
|
UpgradeLog*.htm
|
|
|
|
|
|
|
|
|
|
# SQL Server files
|
|
|
|
|
*.mdf
|
|
|
|
|
*.ldf
|
|
|
|
|
*.ndf
|
|
|
|
|
|
|
|
|
|
# Business Intelligence projects
|
|
|
|
|
*.rdl.data
|
|
|
|
|
*.bim.layout
|
|
|
|
|
*.bim_*.settings
|
|
|
|
|
|
|
|
|
|
# Microsoft Fakes
|
|
|
|
|
FakesAssemblies/
|
|
|
|
|
|
|
|
|
|
# GhostDoc plugin setting file
|
|
|
|
|
*.GhostDoc.xml
|
|
|
|
|
|
|
|
|
|
# Node.js Tools for Visual Studio
|
|
|
|
|
.ntvs_analysis.dat
|
|
|
|
|
node_modules/
|
|
|
|
|
|
|
|
|
|
# Typescript v1 declaration files
|
|
|
|
|
typings/
|
|
|
|
|
|
|
|
|
|
# Visual Studio 6 build log
|
|
|
|
|
*.plg
|
|
|
|
|
|
|
|
|
|
# Visual Studio 6 workspace options file
|
|
|
|
|
*.opt
|
|
|
|
|
|
|
|
|
|
# Visual Studio 6 auto-generated workspace file (contains which files were open etc.)
|
|
|
|
|
*.vbw
|
|
|
|
|
|
|
|
|
|
# Visual Studio LightSwitch build output
|
|
|
|
|
**/*.HTMLClient/GeneratedArtifacts
|
|
|
|
|
**/*.DesktopClient/GeneratedArtifacts
|
|
|
|
|
**/*.DesktopClient/ModelManifest.xml
|
|
|
|
|
**/*.Server/GeneratedArtifacts
|
|
|
|
|
**/*.Server/ModelManifest.xml
|
|
|
|
|
_Pvt_Extensions
|
|
|
|
|
|
|
|
|
|
# Paket dependency manager
|
|
|
|
|
.paket/paket.exe
|
|
|
|
|
paket-files/
|
|
|
|
|
|
|
|
|
|
# FAKE - F# Make
|
|
|
|
|
.fake/
|
|
|
|
|
|
|
|
|
|
# JetBrains Rider
|
|
|
|
|
.idea/
|
|
|
|
|
*.sln.iml
|
|
|
|
|
|
|
|
|
|
# CodeRush
|
|
|
|
|
.cr/
|
|
|
|
|
|
|
|
|
|
# Python Tools for Visual Studio (PTVS)
|
|
|
|
|
__pycache__/
|
|
|
|
|
*.pyc
|
|
|
|
|
|
|
|
|
|
# Cake - Uncomment if you are using it
|
|
|
|
|
# tools/**
|
|
|
|
|
# !tools/packages.config
|
|
|
|
|
|
|
|
|
|
# Telerik's JustMock configuration file
|
|
|
|
|
*.jmconfig
|
|
|
|
|
|
|
|
|
|
# BizTalk build output
|
|
|
|
|
*.btp.cs
|
|
|
|
|
*.btm.cs
|
|
|
|
|
*.odx.cs
|
2018-01-03 04:05:41 +03:00
|
|
|
*.xsd.cs
|
|
|
|
|
|
|
|
|
|
vendor/
|
Provide default values for UploadStreamToBlockBlobOptions and refactor UploadStreamToBlockBlob (#167)
* Refactor of UploadStreamToBlockBlobOptions
Refactor to remove bugs and extra complexity.
* Migrate stream code to own file. Add concurrency.
After benchmarking, code was 25% slower without concurrency in azcopy, regardless of buffer sizing.
This change introduces back concurrency, but with a much simpler model and still eliminating the the atomic operations.
* Update to use io.ReadFull()
Adding test.
Benchmarks are now on par with the original code. Here is 10 runs using the current azcopy binary and a binary built from changed code:
Binary = bins/azcopy_original(run 1)
Benchmark 1KiB file: 338.314573ms
Benchmark 1MiB file: 484.967288ms
Benchmark 10MiB file: 760.810541ms
Benchmark 100MiB file: 1.351661794s
Benchmark 1GiB file: 10.826069714s
Binary = bins/azcopy_original(run 2)
Benchmark 1KiB file: 207.941537ms
Benchmark 1MiB file: 460.838416ms
Benchmark 10MiB file: 760.783836ms
Benchmark 100MiB file: 1.501405998s
Benchmark 1GiB file: 7.18717018s
Binary = bins/azcopy_original(run 3)
Benchmark 1KiB file: 212.47363ms
Benchmark 1MiB file: 467.623706ms
Benchmark 10MiB file: 698.447313ms
Benchmark 100MiB file: 1.292167757s
Benchmark 1GiB file: 7.637774779s
Binary = bins/azcopy_original(run 4)
Benchmark 1KiB file: 276.746547ms
Benchmark 1MiB file: 465.676606ms
Benchmark 10MiB file: 646.126277ms
Benchmark 100MiB file: 1.087617614s
Benchmark 1GiB file: 6.546629743s
Binary = bins/azcopy_original(run 5)
Benchmark 1KiB file: 224.753013ms
Benchmark 1MiB file: 468.194201ms
Benchmark 10MiB file: 658.754858ms
Benchmark 100MiB file: 1.287728254s
Benchmark 1GiB file: 7.349753091s
Binary = bins/azcopy_original(run 6)
Benchmark 1KiB file: 215.433224ms
Benchmark 1MiB file: 468.2654ms
Benchmark 10MiB file: 736.859155ms
Benchmark 100MiB file: 1.288282248s
Benchmark 1GiB file: 9.901807484s
Binary = bins/azcopy_original(run 7)
Benchmark 1KiB file: 309.374802ms
Benchmark 1MiB file: 466.3705ms
Benchmark 10MiB file: 764.919816ms
Benchmark 100MiB file: 1.288119942s
Benchmark 1GiB file: 12.568692895s
Binary = bins/azcopy_original(run 8)
Benchmark 1KiB file: 223.696311ms
Benchmark 1MiB file: 459.585207ms
Benchmark 10MiB file: 861.388787ms
Benchmark 100MiB file: 2.001739213s
Benchmark 1GiB file: 14.062394287s
Binary = bins/azcopy_original(run 9)
Benchmark 1KiB file: 213.478124ms
Benchmark 1MiB file: 472.516087ms
Benchmark 10MiB file: 888.345447ms
Benchmark 100MiB file: 1.712670977s
Benchmark 1GiB file: 7.351456844s
Binary = bins/azcopy_original(run 10)
Benchmark 1KiB file: 211.893325ms
Benchmark 1MiB file: 461.4607ms
Benchmark 10MiB file: 810.622545ms
Benchmark 100MiB file: 1.649993952s
Benchmark 1GiB file: 12.236548842s
Binary = bins/azcopy_changed(run 1)
Benchmark 1KiB file: 253.721968ms
Benchmark 1MiB file: 498.897549ms
Benchmark 10MiB file: 787.010372ms
Benchmark 100MiB file: 1.381749395s
Benchmark 1GiB file: 10.446411529s
Binary = bins/azcopy_changed(run 2)
Benchmark 1KiB file: 252.710169ms
Benchmark 1MiB file: 531.817803ms
Benchmark 10MiB file: 829.688513ms
Benchmark 100MiB file: 1.385873084s
Benchmark 1GiB file: 8.47119338s
Binary = bins/azcopy_changed(run 3)
Benchmark 1KiB file: 257.306962ms
Benchmark 1MiB file: 505.047536ms
Benchmark 10MiB file: 784.31337ms
Benchmark 100MiB file: 1.555737854s
Benchmark 1GiB file: 8.552681344s
Binary = bins/azcopy_changed(run 4)
Benchmark 1KiB file: 247.846574ms
Benchmark 1MiB file: 497.231545ms
Benchmark 10MiB file: 815.651525ms
Benchmark 100MiB file: 2.697350445s
Benchmark 1GiB file: 7.516749079s
Binary = bins/azcopy_changed(run 5)
Benchmark 1KiB file: 252.352667ms
Benchmark 1MiB file: 501.701337ms
Benchmark 10MiB file: 707.436865ms
Benchmark 100MiB file: 1.36936469s
Benchmark 1GiB file: 9.73502422s
Binary = bins/azcopy_changed(run 6)
Benchmark 1KiB file: 310.863688ms
Benchmark 1MiB file: 502.052735ms
Benchmark 10MiB file: 1.002850071s
Benchmark 100MiB file: 1.506176604s
Benchmark 1GiB file: 11.832881097s
Binary = bins/azcopy_changed(run 7)
Benchmark 1KiB file: 257.951257ms
Benchmark 1MiB file: 504.845129ms
Benchmark 10MiB file: 897.192408ms
Benchmark 100MiB file: 3.660229033s
Benchmark 1GiB file: 8.277701479s
Binary = bins/azcopy_changed(run 8)
Benchmark 1KiB file: 248.399669ms
Benchmark 1MiB file: 510.47592ms
Benchmark 10MiB file: 660.498819ms
Benchmark 100MiB file: 983.16489ms
Benchmark 1GiB file: 9.696608161s
Binary = bins/azcopy_changed(run 9)
Benchmark 1KiB file: 256.139558ms
Benchmark 1MiB file: 509.733119ms
Benchmark 10MiB file: 787.046948ms
Benchmark 100MiB file: 1.304473257s
Benchmark 1GiB file: 10.392113698s
Binary = bins/azcopy_changed(run 10)
Benchmark 1KiB file: 253.185361ms
Benchmark 1MiB file: 500.357929ms
Benchmark 10MiB file: 852.302359ms
Benchmark 100MiB file: 1.555795815s
Benchmark 1GiB file: 9.234134017s
* Improve comments, use getErr() instead of old statement, add test for write errors
Added some comment fixes.
Adding some TODOs.
Had an error detection using select that could just use getErr() instead.
Wrote support and test for having a write error.
* Updates to comments provided by ze
* Reduces construction of chunk ids for the commit list, moves azblob_test to azblob
azblob_test should be azblob test, allowing access to private types and removing the need for azblob. as a prefix. Could find no reason to make as a seperate package in a non-go standard way.
This packages' derivation from the blobstore standard of a new UUID per chunk has merits as discussed with Adele(faster, less memory, possible upload resumes, etc...). So it was decided to keep it.
However, wanted to make this easier for us to autoincrement ids and provide the list of IDs to commit instead of recreating them at the end at the cost of CPU we didn't have to spend (we were going to spend the memory anyways). So provided a better way to get the IDs.
This change required changes to the tests. Most tests use a single blockID. For those tests we now use a var created on init() that is a UUID+ math.MaxUint32. That allows us to test the maximum value.
For others, we now use our id type. This changed one test that was trying to test order, which wasn't necessary.
All tests are passing.
* Update gomod to import uuid an update of adal
* Update go.mod via go tidy command
The adal change was because one of the zt tests uses it. It always should have been there and won't cause any change in functionality.
errors gets added as an indirecty from check.v1, which it should have always had. This is because check doesn't have a go.mod file.
Adds a minimum version of Go compiler 1.13
* Update go.mod
* Just the mod updates
* Get it back into shape
Some git thing on my side, had to get us hand patched back right.
Co-authored-by: John Doak <jdoak@janama-2.redmond.corp.microsoft.com>
Co-authored-by: John Doak <jdoak@Fan061719.northamerica.corp.microsoft.com>
2020-05-02 01:42:05 +03:00
|
|
|
*.env
|
