зеркало из https://github.com/microsoft/DeepSpeed.git
Граф коммитов
Выбрать ветку
Скрыть запросы на слияние
AutoPR/0.12.2
AutoPR/0.14.0
AutoPR/0.14.5
CUDA-Graph-support
HeyangQin/deepspeed-ulysses-chinese-blog
HeyangQin/enable_hpz_nograd
HeyangQin/fastgen_moe_h100
HeyangQin/fix_hpz_nograd
HeyangQin/fix_issue_3062
HeyangQin/fix_issue_3068
HeyangQin/fix_issue_3156
HeyangQin/fix_issue_5205
HeyangQin/fix_pr_3462_standalone
HeyangQin/hpz_convergence
HeyangQin/inference_t5_phase1
HeyangQin/mixed_precision_lora_sam
HeyangQin/mixz_tutorial
HeyangQin/skip_bias_quant
HeyangQin/staging-zero-pp-v1
HeyangQin/ucp_blog_chinese
HeyangQin/ulysses_fp8
Megtron-Kernel-Integration
SA_feature_tag
SA_tutorial_update
SA_update_tutorial_link
add-bfp16-support
add-comm-layout
add-inference-comm
add-llama2-support
add-quantizer
add-shared-lib
adk9/phi3-inference
adk9/phi3-small
adk9/update-minor-cuda
amawa/1-bit-alltoall
amawa/1bit-adam-nccl
amawa/add-moe-container
amawa/aml-get-hosts
amawa/auto-save-ckpt
amawa/config-pass-down
amawa/debug
amawa/fix-amd-rocm
amawa/fix-auto-tp-load-ckpt
amawa/fix-tracer-zero3
amawa/fix-z3-for-hf-accelerate
amawa/fix-z3-warn-print-v2
amawa/inference-fix
amawa/remove-deepcopy
amawa/split-a2a
amawa/zero-inf-refactor
amd-jiting
aml-autotuner
arashb-patch-1
arashb/fix-phi-2
arpan/auto-check
autocast-fix
awan-10-patch-1
awan-10-patch-2
awan-10-patch-3
azure
big-science
big-science-v2
bing/debugging
bing/ds-adam
bing/formatting-correction
bing/io-tutorial
bing/modify-ds-optimizer
bing/optimizer-naming
bloom-debug
chatgpt-chinese-blog
check-linear-sizes
cholmes/activation-utils
cholmes/checkpoints-inference-v2-2
cholmes/comm-group-cache
cholmes/fix-asym-quant
cholmes/fix_reduction_utils_amd
cholmes/isolate-src-code
cholmes/kv-cache-flexibility
cholmes/mem-access-predicated-load
cholmes/migrate-to-dequant-lib
cholmes/pipelined-quant
cholmes/reduce-quantized-gpus
cholmes/sd-extension
cholmes/ts-builder
cholmes/unique-cuda-graphs
ckpt-fix-unfused
clean-llama
clean-llama-v2
clean-opt
clean-opt-base
clean-opt-v2
clean-opt-v2-base
codegen-inference
comm-opt2
costineseanu/windows_inference_build
cpu-adam/optional_CUDA-copy
debug-base-attn
debug-ds-inf
debug-ds-inf-torch-matmul
ds-chat-blog-8-31
ds-chat-clean-opt
ds-chat-news
ds-chat-release
ds-inference/add-falcon-support
ds-inference/bloom-support-meta
ds-inference/fix-generation
ds-inference/fix-mp
ds-inference/remove-randgen
ds-inference/simplify
ds-inference/support-large-token-length
ds-seq-tutorial
ds-vchat-blog-v1
ds-vchat-blog-v2
duli/capability
duli/cuda_op_builder
duli/op_builder
duli/pre_post
duli/zero_debugging
elastic-ckpt-refresh
elasticity-v2
eltonz/copy_grad_stream
enable-neox
encoded-ds-config
fairseq-moe
fairseq-moe-debug
falcon-180b
fastgen-blog
fastgen-blog-2
features/rebase-quant-fp6
fix-MoQ
fix-autotuning-docs
fix-autotuning-exit
fix-autotuning-reqs
fix-flops-profiler
fix-fp16-test
fix-injection
fix-max_train_batch_size
fix-misaligned-grad
fix-moe-top1gating
fix-sp-dense
fix-sparse-attn
fix-tuner-prescale_gradients
fix-tuner-scheduler-bug
fix-twitter
fix-typos
fix_mpu_ckpt
flash-attention
flops-profiler-skip-unused-args
fp6-blog
fs-82
fs-soft-kernel
fs-z2-fix
fs/soft-kernel
gcooper/make_optimizer_optional
generic-ckpt-loading
gh-pages
gh-readonly-queue/master/pr-3852-3491e32d72746ec3d990108a23e67b2666b3e0e0
gh-readonly-queue/master/pr-3852-adb9bc14b780115fd54f3f1234abcb7ab52fa975
gh-readonly-queue/master/pr-3854-85503dab878875175b6d5eb6a39125878c172273
gh-readonly-queue/master/pr-3892-548451ba4e8ea71029d738c33f639e0439aad1dd
gh-readonly-queue/master/pr-3892-9f8817b2425bb82d9b6355caa6d2d0ebd036885d
gh-readonly-queue/master/pr-3893-cc71eec8c85c4437d8139e53372da7f22224fed5
gh-readonly-queue/master/pr-3928-82115d9059ce8271229c8f63153a02f2d323cfc1
gh-readonly-queue/master/pr-4163-5e16eb2c939707d0d0062a458d77998fccb3afad
gma/xpu_compile_analysis
good-moe
gpt2-debug
guanhua/adam-timer
guanhua/adam-timer2
guanhua/check-bf16
guanhua/fix-cutlass-ver
guanhua/h2d-offload
guanhua/kernel-test
guanhua/mics-fix
guanhua/overflow-check
guanhua/quant-dequant-test
guanhua/quant-test
guanhua/rocm-cpu-adam
guanhua/v14.0-bf16-check
hf-workaround
hp-sam
hpzero-preview
inference-api/tutorial
inference-read-checkpoint
inference-refactor-v1-mro-test
inference/ElutherAI-GPTJ
inference/TP-general-support
inference/add-bf16-support
inference/engine-api
inference/fix-masking
inference/fix-mp-init
inference/support-encoder-decoder
injection-fixes
jeff-test
jeffra-patch-2
jeffra/1node-launcher-fix
jeffra/2904
jeffra/auto-bucket
jeffra/available_memory
jeffra/bf16-updates
jeffra/bf16-updates-v2
jeffra/ci-updates
jeffra/ckpt-barrier
jeffra/docker-update
jeffra/engine-xthru
jeffra/engine-xthru-v2
jeffra/engine-xthru-v2-no-padding
jeffra/external-skip
jeffra/fix-1416
jeffra/fs-diverge
jeffra/fs-gas-fix
jeffra/fs-gas-fix-v2
jeffra/fs-support
jeffra/fs-z3
jeffra/fs-z3-v0510
jeffra/gptj-fixes
jeffra/inf-engine-refactor
jeffra/inf-tests
jeffra/jit-fix
jeffra/latest-hf
jeffra/op-build-api
jeffra/prepost_fwd_and_generate
jeffra/saksham-zero1-fixes
jeffra/savepid2
jeffra/shm-report
jeffra/staging-comms-logging-v1
jeffra/turn-on-opt-test
jeffra/update-z3-check
jeffra/z1-refresh
jeffra/z1-refresh-2
jeffra/z1-refresh-3
jeffra/z3-fix
jeffra/z3-new-param
jeffra/zero-1-fix
jeffra/zero-1-fix-test
jeffra/zero-ckpt-fixes
jeffra/zero-moe-noCG
jeffra/zero1-grad-norm
jerasley/mac
jomayeri/aio-file-offset
jomayeri/aio-locked-tensor
jomayeri/aio-mem-fix
jomayeri/aio-type-mismatch
jomayeri/bf16-zero-check
jomayeri/bug-5880
jomayeri/debug-2361
jomayeri/deepnvme-perf-debug
jomayeri/destroy-zero
jomayeri/fp8-init
jomayeri/gds-swapper-fix
jomayeri/h100-unittest
jomayeri/he-mp-assert
jomayeri/issue-3367
jomayeri/issue-3560
jomayeri/issue-3598
jomayeri/issue-3769
jomayeri/issue-4083
jomayeri/issue-4095
jomayeri/issue-4183
jomayeri/issue-5087
jomayeri/lr-step-init
jomayeri/lr-step-move
jomayeri/model-param-list
jomayeri/new-zero-accum
jomayeri/swap-with-locked
jomayeri/zero-grad-accum
jomayeri/zero3-hooks
kv-cache-reset
landing-training
landing-updates
lekurile/add_ds_chat_workflow
lekurile/add_hip_abstraction
lekurile/clean_up_params
lekurile/container_param_cleanup
lekurile/ds_chat_attn_mlp_base
lekurile/ds_chat_fix_test
lekurile/ds_chat_gh_wf
lekurile/ds_chat_mlp_debug
lekurile/ds_chat_revert_54c06872
lekurile/ds_chat_test_54c06872
lekurile/ds_chat_test_7b5b0660
lekurile/ds_chat_test_exit_first
lekurile/ds_chat_test_f69f8840
lekurile/fix_ds_chat_bloom
lekurile/fix_formatting
lekurile/fix_he_print
lekurile/fix_issue_2330
lekurile/fix_opt_meta_tensor
lekurile/fix_phi_2
lekurile/fix_sd
lekurile/fix_sd_ci
lekurile/fix_unet_vae
lekurile/general_local_cg
lekurile/infv2_lm_eval
lekurile/kernel_hip_amd
lekurile/load_ckpt_inf_eng
lekurile/mlp_functions
lekurile/offload_fix_test
lekurile/sd_min_ver
lekurile/test_rearrange_ops
lekurile/update_ds_chat_ci
lekurile/update_ds_chat_ci_2
lekurile/update_ds_chat_ci_test
lekurile/update_dschat_wf
lekurile/update_inf_ckpt_load
lf-test
loadams/adam-params
loadams/add-contributing-release-md-files
loadams/add-gaudi-badge-readme
loadams/add-scheduled-open-issue-check-ds-chat
loadams/add-torch-2-support
loadams/amd-57
loadams/amd-mi200-tests
loadams/amd-pre-compile
loadams/amd-updates
loadams/auto-stage3-prefetch-bucket-size
loadams/auto-task-open-failure
loadams/build-for-cpu
loadams/changes-to-op-builder
loadams/check-ds-chat-transformers-debug
loadams/check-pydantic-v2-support
loadams/clear-cache
loadams/cpu-inf
loadams/cpu-inf-triggers
loadams/cpu-inf-v0-docker
loadams/cpu-inference-shorten
loadams/cpu-torch
loadams/cu118
loadams/debug-torch
loadams/disable-h100-ci
loadams/disable-windows-ops-build-script
loadams/dot-deepspeed_env-test
loadams/dpkg-libaio
loadams/empty-env-var-setup
loadams/enable-amdmi200
loadams/enable-workflow-dispatch-nv-torch-nightly-v100
loadams/engine-pos-args
loadams/fix-check-valid-version
loadams/fix-cpu-inf-test-time
loadams/fix-cuda-build-ops
loadams/fix-ds-chat-transformers
loadams/fix-fp16-bf16-logging-issue
loadams/fix-hpu
loadams/fix-lightning-pytorch2
loadams/fix-mpi4py
loadams/fix-nccl-comm-torch-check
loadams/fix-no-torch-failure-mlu
loadams/fix-nv-inference
loadams/fix-nv-inference-hang
loadams/fix-nv-torch-latest-v100
loadams/fix-onebit-skip
loadams/fix-torch-2
loadams/fix-torch-compiler-hasattr
loadams/fix-triggers-no-torch-workflow
loadams/flops-profiler-scaled-dor-attn-torch-2
loadams/get-amd-team-ci
loadams/gh-cpu-inf
loadams/gh-release-version-update
loadams/hf-transformers-ci-fix
loadams/hpu-uts
loadams/ignore-unused-params-default
loadams/lamb-bf16
loadams/libaio
loadams/low-cpu-mem-ut
loadams/lsb-release
loadams/megatron
loadams/megatron-lm-112
loadams/megatron-new-pypi
loadams/megatron-version
loadams/mii-transformers-debug
loadams/more-torch-2-support
loadams/nv-inf-jobs-test
loadams/nv-inf-test
loadams/nv-inference-revert
loadams/nv-nightly
loadams/nv-nightly-fix-transformers
loadams/nv-sd-badge
loadams/openmpi-eth0
loadams/pin-torch-latest-ver
loadams/py36
loadams/pynvml
loadams/recurse-flops-profiler
loadams/reenable-cpu-inference
loadams/remove-dead-code
loadams/remove-modeling
loadams/remove-python-36-check
loadams/rename-fp-quantize-cu
loadams/rename-nv-torch-latest-cpu-workflow
loadams/revert-4660
loadams/revert-5608
loadams/revert-cpu-inf
loadams/revert-loss
loadams/revert-nv-inference-changes
loadams/revert-pr-5608
loadams/revert-userwarning
loadams/rocm-fixes
loadams/rocm57
loadams/rocm6
loadams/sd-paths
loadams/setup-h100-triggers
loadams/shuffle-data-sampler
loadams/sigterm
loadams/skip-nv-inference
loadams/sparse-attn-fix
loadams/sparse-attn-torch-2
loadams/stablediffusion-test-triton2
loadams/switch-modeling-compression
loadams/tar-vuln
loadams/test-0.15.0
loadams/test-amp-futurewarning
loadams/test-b421e8c8f31af254b63ad6e9839f617ab6d9c060
loadams/test-ccl-fixes
loadams/test-compile
loadams/test-cpu
loadams/test-cpu-inf-fix
loadams/test-f0e3f01d7c7a3d8748212e61eaf487fab41168a7
loadams/test-fix-nv-inference
loadams/test-glibc228
loadams/test-merged-changes
loadams/test-model-task
loadams/test-nv-ds-chat-failure-mode
loadams/test-nv-latest-cpu
loadams/test-nv-torch-latest-v100
loadams/test-pytest-ordering
loadams/test-runsc
loadams/test-torch-2.3.0
loadams/torch-cpu-mismatch-cudaopbuilder
loadams/torch-nightly-debug
loadams/transformers-fixes
loadams/transformers-torch
loadams/transformers-torch-update
loadams/transformers-workflow-dispatch
loadams/triton-22-update
loadams/try-bump-pydantic
loadams/unpin-hf-transformers-nv-workflows
loadams/unpin-nv-torch-latest
loadams/unpin-transformers
loadams/update-2004-checkout-actions
loadams/update-accelerate
loadams/update-amd-required-paths
loadams/update-conda-pydantic
loadams/update-container-a6000
loadams/update-docker
loadams/update-dockerfile
loadams/update-hostname-I
loadams/update-hpu-1-18
loadams/update-hpu-docker-container
loadams/update-hpu-docker-image
loadams/update-hpu-gaudi-flow-more
loadams/update-just-nv-a6000-container
loadams/update-mii-transformers
loadams/update-nodejs-reate-pr-action
loadams/update-nv-accelerate
loadams/update-nv-inference-torch-ver
loadams/update-nv-lightning-test-cu-ver
loadams/update-nv-torch-latest-cpu-torch-ver
loadams/update-nv-torch-latest-cpu-version
loadams/update-pre-compile-ops-docker
loadams/update-pydantic
loadams/update-pytest
loadams/update-pytest-error-codes
loadams/update-real-latest
loadams/update-sd-triton
loadams/update-torch-113
loadams/update-transformers
loadams/update-transformers-cu116
loadams/update-ubuntu24.04
loadams/update-version-txt-post-release
loadams/update-website-sidebar
loadams/x86-accelerator
loadams/xpu-readme
loadams/xpu-test
loadams/xpu-yml
lokoppak/ln_schedule_update
lokoppak/low_cpu_mem_usage_ut
lokoppak/new_pt_binding
lokoppak/quantization_3d
lokoppak/ref_ln
lsh
master
master-test
megatron2.4-3d
minjiaz/ds-seq-tutorial
minjiaz/moe-comm
minjiaz/moe-sharing
moe-full-tp
moe-inference-tutorial
moe-inference-tutorial1
moe-inference/add-tutorial
moe-pipelining
moe-timing
mosm/autotp-he
mosm/autotp_llama
mosm/bloom_dev
mosm/codegen
mosm/debug-ds-attn
mosm/debugger
mosm/dschat-news
mosm/inf-refactor
mosm/llama2
mosm/matmul_test
mosm/module_parser
mosm/mp_tutorial
mosm/opt-kernel
mosm/softmax
mosm/softmax-longseq
mosm/t5
mosm/test
mosm/tp_dev
mosm/wb-param
mrwyattii/expand-fp16-tests
mrwyattii/fix-accelerate-tests
mrwyattii/fix-for-mii-UT
mrwyattii/fix-inference-skipped-tests
mrwyattii/fix-launcher-user-args
mrwyattii/fix-multi-node-checks
mrwyattii/pin-datasets
mrwyattii/pydantic-2-support
mrwyattii/remove-symlinks
mrwyattii/rename-cpu-accelerator
mrwyattii/safetensor
mrwyattii/silence-backend-warning
mrwyattii/update-GH-permission
mrwyattii/update-MII-tests-infV2
multi-z3-prs
multi-z3-prs-r2
mz/llama-support
neox-q-int8
niumanar/gan_optimizer
offloadpp-news
olruwase/accelerator_abstraction
olruwase/adam_types
olruwase/align_rrg_rs_param_order
olruwase/all_gather_profiling
olruwase/amd_configurable_pp_rtol
olruwase/assert_unused_parameters
olruwase/b16-debugging
olruwase/bf16-updates-2
olruwase/bf16_tied_weights_reduce
olruwase/bf16_update_hp_params
olruwase/bloom-support
olruwase/bloom_176b_checkpoint_bc
olruwase/build_compat_ops
olruwase/ci_pytorch_1x
olruwase/deepnvme_abstract_class
olruwase/deepnvme_docs
olruwase/disable_prefetch_profiler
olruwase/disable_z3_prefetcher
olruwase/dnvme_docs
olruwase/ds_2449
olruwase/ds_2921
olruwase/ds_3481
olruwase/ds_3680_2
olruwase/ds_3948
olruwase/dynamic_graph_activation_checkpoint
olruwase/elastic-ckpt-refresh
olruwase/engine_destroy
olruwase/fix_kernel_memory_bloat
olruwase/frozen_weights_unit_test
olruwase/fs-zero3_trace_fix
olruwase/fs_z3_trace_error_disable
olruwase/fs_z3_trace_log
olruwase/fuse_torch_adam_w
olruwase/gpt3-finetuning
olruwase/grad_accum_loss
olruwase/issue_3062
olruwase/llama2_empty_group
olruwase/local_storage_checkpoint
olruwase/lr_warmup_decay
olruwase/no_grad_sync_ctxt
olruwase/non_tensor_activation_checkpoint
olruwase/nvme_finetune
olruwase/nvme_offload_bug
olruwase/nvme_perf_sweep
olruwase/nvme_testsuite
olruwase/override_module_apply
olruwase/refactor_universal_checkpoint
olruwase/restore_from_bit16_weights
olruwase/round_robin_gradient_option
olruwase/safe_pkg_check
olruwase/safe_py_subprocess
olruwase/save_checkpoint_latest_false
olruwase/save_zero3_fp16_weights
olruwase/set_zero_opt_grad
olruwase/setup_env_libaio
olruwase/trainable_parameters
olruwase/windows_blog
olruwase/z3_perf_tune
olruwase/z3_suppress_warning
olruwase/zcode_model_expert
olruwase/zero1_non_tensor_checkpoint
olruwase/zero2_grad_accum_bug
olruwase/zero2_offload_keyerror
olruwase/zero2_offload_rrb_divergence
olruwase/zero2_offload_slowdown
olruwase/zero2_trainable_parameters
olruwase/zero2_trainable_parameters_v0.5.7
olruwase/zero2_unbalanced_grad_reduction
olruwase/zero3_amp_autocast
olruwase/zero3_broken_tracing
olruwase/zero3_dp_norm_allreduce
olruwase/zero3_profile_fetch
olruwase/zero3_unboundlocal_bug
olruwase/zero_inference_tokgen
olruwase/zero_inference_torch_version
olruwase/zero_multi_models
olruwase/zero_offload_e2e
olruwase/zero_offload_fix_corner_case
olruwase/zero_offload_v3
olruwase/zero_optional_reduce_scatter
olruwase/zero_stage1_checkpoint_layout
olruwase/zero_stage1_elastic_checkpoint
olruwase/zinf_none_swapper
paper
patch-z1-cont-grad
pr_moe_tutorial
preserve-CVDs
profiler-add-shape
qanthony/bigbird
qanthony/comms-bench
qanthony/nccl-backend
quantization-refresh
quantize-inference
refine-quantizer
remotes/origin/dev/tput
remove-tbx
remove-unused-quantize-settings
reyazda/adam-scalar-fix
reyazda/cpu_adam_jit_v2
reyazda/fix-inference-api
reyazda/pytorch-workspace-allocate
reyazda/remove_bertid
reyazda/support_AVX2_by_default
reyazda/test-hidden-dimension
reyazda/test-sparse
reyazda/test-sparse-v2
reyazda/test-transformer
reyazda/testing_embedding
reyazda/triton-new-sparse
reza/deepspeed_adam_merge_v3
reza/fix-adam-copyfp16
reza/fix_adam_corner_case
reza/fix_adam_perf
reza/megatron_kernel_integration
rtd-staging
saksham-zero1-fixes
samyam-overlap-comm
samyamr/elasticity
samyamr/fix-for-fragmented-linear-inputs
samyamr/gpt3-finetuning
samyamr/gpt3-finetuning-mixed-precision
samyamr/stage3-alignment-fix
samyamr/zero-2-debug
security-patch
shaden/textgen
smartreply_hotfix
sp/comm-opt
sparse-attn-cuda11
sparse-attn/support-latest-triton
staging-amd
staging-amd-port
staging-amd-v2
staging-amd-v3
staging-comms-next-v2
staging-comms-v1
staging-deepnvme-gds-v1
staging-demo-feature-v0
staging-ds-chat-blog-v1
staging-ds-seq-v1
staging-inference-v2-5
staging-mii-update
staging-moe-next-v1
staging-oaas
staging-pld-v1
staging-pp
staging-test
staging-zero-dual-v2
staging-zero-dual-v3
staging-zero-dual-v5
staging-zero-inference-v1
stale-issues
styoun/triton-flash2
styoun/triton2.1
styoun/triton2.1-autotune
styoun/zero-inf-8bit-q
subprocess-test
test-ac
test-cuda-11.7
tmp
tmp-old
tohtana/add_slides_meetup_japan
tohtana/allocate_test_port
tohtana/autocast_only_floating_values
tohtana/bcast_warning_z3
tohtana/blog_win_jp
tohtana/cache_kv_requirements
tohtana/clean_after_test
tohtana/clean_all_param_coordinators
tohtana/clean_up_prefetch_param
tohtana/compile-zero
tohtana/compile_no_grad
tohtana/consistent_zero_grad
tohtana/debug_compile_backends
tohtana/debug_semaphore_leak
tohtana/file_store_for_tests
tohtana/fix-save-checkpoint-step
tohtana/fix_bf16_opt_update_hp
tohtana/fix_chkpt_alignment
tohtana/fix_sort_dp_univ_ckpt
tohtana/fix_univ_chkpt_load
tohtana/fix_zero_init_patch
tohtana/get_offload_state_api
tohtana/lock_hf_cache_update
tohtana/log_run_tests
tohtana/merge_FPDT
tohtana/model_declaration_in_init_context
tohtana/offload_zero_buffers
tohtana/pipeline_with_compiled_module
tohtana/remove_step_on_init
tohtana/simplify_param_coordinator
tohtana/test_with_pt25
tohtana/univ_ckpt_custom_shape
tohtana/z3_multi_dtypes
tohtana/z3_no_mixed_precision
token-drop
transformer-injection
transformer-kernel/support-arbitrary-hidden
transformer/fix-layer-norm
transformer/injection
transformer/large-seq-support
transformer/triangular-mask
triton-fix
ucp_blog
umchand/test_compiler
umchand/triton/bias_act
unify-benchmark-knowledge
update-flops-profiler-doc
update-flops-profiler-pool-compute
workaround-zero3
z1-offload-multigpu
z3-mem-leak
zero-ckpt-cpu-issue-v2
zhenyzhang-data
zheweiyao/quantize_update
#1
#10
#100
#1000
#1001
#1004
#1008
#1012
#1013
#1014
#1014
#1015
#1017
#1021
#1023
#1024
#1025
#1026
#1027
#103
#1032
#1036
#1038
#1039
#104
#1040
#1042
#1044
#105
#1052
#1053
#1058
#1059
#106
#1060
#1065
#1066
#1067
#1068
#107
#1071
#1072
#1076
#1078
#108
#1085
#1086
#1090
#1091
#1092
#1093
#1094
#1095
#1096
#1097
#1099
#110
#1100
#1102
#1103
#1104
#111
#1113
#1114
#112
#1128
#1129
#113
#1134
#1135
#1136
#1139
#1140
#1146
#1148
#1149
#1150
#1151
#1154
#1157
#1160
#1160
#1163
#1164
#1166
#1167
#1168
#1169
#117
#1170
#1178
#1181
#1185
#1188
#1190
#1191
#1195
#1198
#1199
#12
#1202
#1204
#1210
#1212
#1213
#1214
#1215
#1219
#1220
#1221
#1223
#1224
#1225
#1227
#123
#1234
#1239
#124
#1240
#1244
#1246
#1247
#1249
#125
#1250
#1251
#1252
#1254
#1256
#1258
#1259
#126
#1261
#1263
#1264
#1271
#1273
#1274
#1278
#128
#1280
#1284
#1286
#1287
#1290
#1292
#1293
#1294
#13
#1305
#1307
#1309
#1310
#1311
#1312
#1314
#1316
#1318
#1318
#132
#1321
#1322
#1324
#1325
#1326
#1328
#1329
#133
#1330
#1333
#1337
#1338
#1339
#1344
#1349
#135
#1350
#1352
#1353
#1354
#1358
#1359
#136
#1360
#1361
#1362
#1366
#1368
#1370
#1372
#1373
#1374
#1376
#1377
#1380
#1382
#1383
#1387
#1388
#1389
#139
#1391
#1393
#1396
#1397
#1398
#1399
#1400
#1404
#1405
#1406
#1407
#1408
#1409
#141
#1411
#1417
#1418
#1419
#142
#1420
#1421
#1422
#1423
#1424
#1425
#1427
#1428
#1429
#143
#1430
#1433
#1434
#1438
#1439
#144
#1440
#1443
#1446
#1447
#1448
#145
#1450
#1453
#1455
#1456
#1457
#146
#1461
#1462
#1463
#147
#1473
#1474
#1476
#148
#1484
#1486
#1487
#1489
#149
#1490
#1491
#1492
#1494
#1498
#15
#1500
#1501
#1503
#1504
#1505
#1506
#1509
#151
#1510
#1511
#1512
#1514
#1516
#1518
#1519
#1520
#1521
#1524
#1525
#1527
#1528
#1529
#1530
#1531
#1532
#1536
#1537
#1540
#1542
#1544
#1545
#1548
#1549
#1550
#1552
#1553
#1554
#1555
#1556
#1557
#1558
#1560
#1562
#1564
#1565
#1567
#1568
#1569
#1571
#1573
#1577
#1578
#1579
#1582
#1582
#1583
#1585
#1587
#1588
#1589
#159
#1591
#1592
#1593
#1596
#1597
#1598
#1601
#1602
#1605
#1606
#1606
#1607
#1608
#161
#1615
#1615
#1616
#162
#1622
#1623
#1626
#1628
#1632
#1633
#1634
#1636
#1637
#164
#1641
#1642
#1646
#165
#1651
#1652
#1655
#1657
#1659
#166
#1660
#1663
#1664
#1665
#1670
#1673
#1675
#1676
#1679
#168
#1681
#1683
#1688
#1689
#1690
#1698
#170
#1700
#1704
#1705
#1706
#1707
#1708
#1709
#171
#1711
#1712
#1714
#1715
#1717
#1718
#1724
#1725
#1726
#1727
#1728
#173
#1732
#1733
#1734
#1736
#1737
#1741
#1745
#1747
#1750
#1754
#1755
#1758
#1759
#1760
#1764
#1765
#1768
#177
#1774
#1775
#1775
#1778
#1779
#178
#1780
#1790
#1794
#1798
#1799
#1801
#1802
#1803
#1805
#1807
#181
#1811
#1812
#1815
#1817
#1818
#1819
#1821
#1822
#1823
#1826
#1827
#1828
#1829
#1832
#1836
#184
#1841
#1842
#1844
#1845
#1848
#1849
#185
#1850
#1851
#1853
#1854
#1855
#1857
#186
#1866
#1868
#1869
#187
#1873
#1874
#1875
#1877
#1879
#188
#1880
#1881
#1882
#1882
#1884
#1885
#1887
#1889
#1892
#1894
#1899
#190
#1900
#1901
#1906
#1907
#1908
#1913
#1914
#1915
#1916
#1917
#1920
#1921
#1922
#1929
#1930
#1932
#1933
#1934
#194
#1941
#1942
#1943
#1944
#1947
#1951
#1952
#1953
#1954
#1957
#1958
#1959
#1962
#1963
#1964
#1965
#1966
#1968
#197
#1970
#1972
#1974
#1977
#1979
#198
#1981
#1984
#1985
#1988
#1989
#1990
#1992
#1994
#1996
#1998
#2
#2000
#2004
#2007
#2008
#2009
#201
#2011
#2012
#2013
#2014
#2015
#2016
#2017
#2018
#202
#2021
#2024
#2026
#2027
#2028
#203
#2032
#2035
#2038
#204
#2040
#2041
#2042
#2043
#2044
#2045
#2047
#2049
#205
#2050
#2051
#2053
#2058
#2059
#206
#2064
#2065
#2068
#2072
#2074
#2075
#2076
#2079
#208
#2083
#2085
#2087
#2088
#2089
#209
#2091
#2093
#2095
#2098
#2104
#2105
#2106
#2107
#2108
#2110
#2111
#2114
#2118
#212
#2120
#2121
#2122
#2123
#2124
#2126
#2127
#213
#2130
#2132
#2133
#2134
#2135
#2136
#2138
#214
#2140
#2141
#2142
#2143
#2144
#2145
#2146
#2147
#2148
#215
#2150
#2152
#2153
#2155
#2156
#2157
#2158
#216
#2160
#2162
#2164
#2165
#2167
#217
#2170
#2171
#2172
#2173
#2175
#2177
#2178
#2179
#218
#2180
#2181
#2182
#2188
#2189
#219
#2190
#2192
#2196
#2197
#2198
#220
#2201
#2202
#2204
#2205
#2208
#221
#2210
#2210
#2211
#2212
#2213
#2214
#2215
#2216
#2217
#2218
#222
#2220
#2221
#2224
#2225
#2228
#223
#2232
#2235
#2236
#2237
#2238
#224
#2241
#2245
#2247
#2249
#225
#2250
#2253
#2254
#2256
#2257
#2258
#2259
#2260
#2261
#2267
#2269
#2270
#2271
#2274
#2276
#2278
#2279
#228
#2280
#2282
#2284
#2285
#2286
#2289
#2291
#2296
#2297
#2298
#2299
#230
#2303
#2306
#2307
#231
#2310
#2311
#2312
#2313
#2314
#2315
#2316
#2317
#2318
#232
#2320
#2321
#2322
#2323
#2325
#2327
#2328
#233
#2331
#2332
#2333
#2336
#2338
#234
#2340
#2342
#2344
#2345
#2346
#2347
#2348
#2349
#235
#2350
#2351
#2353
#2354
#2356
#2358
#2359
#236
#2362
#2363
#2364
#2369
#2370
#2371
#2373
#2374
#2374
#238
#2380
#2381
#2383
#2384
#2387
#239
#2390
#2391
#2393
#2395
#2397
#24
#240
#2401
#2402
#2403
#2404
#2405
#2409
#2410
#2411
#2415
#2418
#2419
#242
#2420
#2422
#2423
#2425
#2426
#2428
#2429
#243
#2430
#2431
#2432
#2433
#2436
#2437
#2437
#2438
#244
#2440
#2443
#2445
#2446
#2447
#2448
#245
#2450
#2451
#2454
#2455
#2457
#2458
#2459
#246
#2460
#2460
#2464
#247
#2470
#2471
#2472
#2474
#2476
#2477
#2479
#248
#2481
#2483
#2486
#2489
#249
#2491
#2493
#2494
#2495
#2496
#2499
#250
#2500
#2504
#2505
#2507
#2508
#2509
#2511
#2512
#2515
#2516
#2518
#2519
#252
#2521
#2522
#2523
#2524
#2525
#2526
#2526
#2528
#2529
#2530
#2533
#2534
#2535
#2536
#2537
#2538
#2539
#254
#2540
#2541
#2542
#2544
#2545
#2547
#2548
#2550
#2551
#2553
#2554
#2555
#2555
#2556
#2559
#2560
#2561
#2562
#2564
#2566
#2567
#257
#2570
#2571
#2573
#2574
#2575
#2579
#258
#2580
#2580
#2581
#2585
#2586
#2587
#2589
#2590
#2591
#2592
#2599
#26
#260
#2600
#2603
#2604
#2605
#261
#2611
#2613
#2614
#262
#2620
#2621
#2623
#2625
#2626
#2627
#2628
#263
#2630
#2630
#2631
#2633
#2633
#2634
#2635
#2635
#2639
#2640
#2641
#2641
#2642
#2643
#2643
#2645
#2646
#2647
#2649
#265
#2653
#2655
#2657
#266
#2660
#2661
#2662
#2663
#2664
#2665
#2668
#2669
#267
#2670
#2671
#2677
#268
#2683
#2685
#2687
#2688
#269
#2695
#2698
#2699
#27
#270
#2703
#2704
#2705
#2705
#2706
#2709
#271
#2711
#2712
#2713
#2714
#2718
#2725
#2726
#2727
#273
#2732
#2738
#2741
#2742
#2743
#2744
#2745
#2748
#2748
#2749
#2749
#275
#2750
#2753
#2754
#2756
#2757
#2757
#2758
#2759
#276
#2761
#2763
#2764
#2766
#2769
#2769
#277
#2771
#2773
#2774
#2775
#2776
#2779
#278
#2780
#2781
#2782
#2783
#2784
#2786
#2791
#2792
#2795
#2796
#2799
#28
#2803
#2804
#2805
#2806
#2807
#2808
#2810
#2814
#2815
#282
#2822
#2823
#2824
#2825
#2826
#2828
#2829
#2831
#2832
#2832
#2833
#2834
#2836
#2839
#2843
#2844
#2847
#2849
#2850
#2851
#2854
#286
#2862
#2863
#2866
#287
#2875
#2877
#2881
#2883
#2884
#2888
#2889
#289
#2891
#2896
#29
#290
#2905
#2907
#2909
#291
#2916
#2916
#2919
#2922
#293
#2932
#2939
#2940
#2941
#2943
#2944
#2948
#2950
#2953
#296
#2962
#2963
#2964
#297
#2970
#2971
#2972
#2972
#2975
#298
#2981
#2987
#2988
#2989
#299
#2990
#2995
#2999
#3
#30
#300
#3005
#3007
#3008
#3009
#3009
#301
#3010
#3013
#3015
#3017
#3018
#3019
#302
#3020
#3021
#3022
#3023
#303
#3030
#3031
#3033
#3034
#3035
#3036
#3037
#3039
#304
#3040
#3041
#3042
#3046
#3047
#3048
#3049
#305
#3051
#3052
#306
#3060
#3064
#3066
#307
#3072
#3074
#3078
#3082
#3083
#3085
#309
#3092
#3095
#3096
#3097
#3098
#310
#3101
#3102
#3109
#311
#3110
#3110
#3111
#3112
#3115
#3116
#3119
#312
#3120
#3127
#3129
#313
#3133
#3135
#3136
#3137
#3138
#314
#3140
#3141
#3142
#3147
#3148
#3149
#315
#3152
#3157
#3159
#316
#3162
#3162
#3164
#3165
#3165
#3166
#3169
#317
#3170
#3179
#318
#3180
#3183
#3184
#3185
#3186
#3187
#3188
#3189
#3190
#3191
#3193
#3194
#3198
#3199
#32
#320
#3200
#3201
#3203
#3204
#3205
#321
#3212
#3216
#3218
#3219
#322
#323
#3236
#3237
#3243
#3245
#3245
#3256
#3265
#3266
#3266
#3269
#3270
#3275
#3276
#3277
#3278
#3282
#3289
#3290
#3294
#3295
#3298
#33
#330
#3300
#3306
#3311
#3315
#3316
#3323
#3324
#3325
#3327
#333
#334
#3343
#3344
#3345
#3346
#3347
#3348
#335
#3354
#3354
#336
#3362
#3368
#3369
#337
#3370
#3371
#3372
#338
#3380
#3388
#3388
#3389
#3390
#3397
#3398
#3399
#34
#340
#3400
#3401
#3407
#3409
#341
#3413
#3415
#3417
#3417
#342
#3420
#3421
#3422
#3424
#3425
#3426
#3427
#3427
#3428
#343
#3432
#3433
#3434
#3435
#3436
#344
#3440
#3441
#3443
#3449
#345
#3451
#3457
#346
#3462
#3469
#347
#3470
#3473
#348
#3482
#3484
#3486
#349
#3494
#3497
#3498
#35
#350
#3501
#3504
#3505
#3509
#351
#3514
#3514
#3519
#3519
#352
#3520
#3522
#3523
#3526
#3527
#353
#3532
#3533
#3534
#3537
#354
#3545
#3545
#3547
#355
#3551
#3551
#3553
#3555
#3555
#3556
#3559
#356
#3563
#3565
#3569
#357
#3571
#3572
#3573
#3575
#3576
#3577
#3578
#3579
#358
#3580
#3585
#3586
#3587
#359
#3592
#3595
#3596
#3597
#36
#360
#3600
#3602
#3608
#3609
#361
#3611
#3616
#3617
#3618
#362
#3621
#3622
#3629
#363
#3630
#3633
#3636
#3637
#3638
#3639
#364
#3640
#3641
#3642
#3643
#365
#3651
#3656
#366
#3663
#3664
#3667
#3668
#367
#3670
#3675
#368
#3682
#3683
#3684
#3685
#3687
#3689
#369
#3694
#3695
#3696
#3696
#3697
#3698
#37
#370
#3700
#3702
#3703
#3704
#3705
#3706
#3707
#3708
#3709
#371
#3713
#3714
#3716
#372
#3720
#3726
#3727
#3727
#3728
#3730
#3731
#3736
#3739
#374
#3740
#3740
#3741
#3745
#3747
#3748
#3749
#375
#3754
#3755
#3756
#3759
#3759
#376
#3761
#3761
#3763
#3765
#3768
#377
#3773
#3774
#3774
#3778
#378
#3782
#3783
#3784
#3786
#3787
#3788
#3789
#3790
#3792
#3793
#3796
#3797
#3798
#3799
#38
#380
#3800
#3801
#3802
#3805
#3806
#381
#3817
#3819
#382
#3821
#3825
#3829
#383
#3831
#3832
#3833
#3834
#3838
#384
#3842
#3843
#3844
#3846
#3847
#3848
#3849
#385
#3850
#3852
#3854
#3861
#3865
#387
#3879
#388
#3881
#3882
#3883
#3884
#3885
#3886
#389
#3892
#3893
#3894
#3899
#39
#390
#3902
#3903
#3907
#391
#3912
#3913
#3914
#3915
#3917
#3918
#3919
#392
#3920
#3921
#3923
#3927
#3928
#393
#3930
#3931
#3933
#3936
#3939
#394
#3940
#3943
#395
#3950
#3951
#3952
#3953
#3954
#3955
#3956
#3957
#3957
#3962
#3971
#3972
#3972
#3973
#3973
#3974
#3975
#3976
#398
#3981
#3984
#3991
#3994
#3996
#3997
#40
#400
#4006
#4007
#4008
#4009
#401
#4010
#4011
#4015
#4019
#402
#4020
#4022
#4025
#4026
#4028
#403
#4030
#4031
#4033
#404
#4040
#4041
#4043
#4044
#4048
#4049
#405
#4051
#4053
#4057
#4061
#4062
#4069
#4070
#4071
#4071
#4077
#4077
#4078
#4079
#408
#4084
#4085
#4087
#4087
#4088
#4088
#4089
#409
#4090
#41
#410
#4101
#4102
#4106
#4107
#411
#4110
#4111
#4114
#4115
#4117
#4118
#4119
#4120
#4126
#4127
#4128
#413
#4130
#4131
#4137
#4138
#4139
#414
#4140
#4141
#4144
#4146
#4147
#415
#4150
#4152
#4157
#416
#4160
#4161
#4162
#4163
#4167
#417
#4171
#4172
#4173
#4174
#418
#4184
#4185
#4186
#419
#4192
#4193
#4197
#4198
#4199
#42
#420
#4200
#4201
#4202
#4203
#4204
#4205
#4206
#4207
#4209
#421
#4210
#4211
#4213
#4214
#4215
#4216
#4216
#422
#4223
#4224
#4228
#4228
#423
#4230
#4232
#4235
#4236
#4238
#424
#4240
#4241
#4242
#4243
#4244
#4251
#4252
#4258
#4259
#4262
#4263
#4265
#4266
#4267
#4267
#4268
#4269
#427
#4270
#4277
#4278
#4279
#4280
#4282
#4284
#4286
#4288
#4289
#429
#4291
#4297
#43
#4300
#4300
#4303
#4308
#4310
#4312
#4313
#4316
#4317
#4317
#4318
#4319
#4320
#4321
#4322
#4323
#4323
#4324
#4325
#4326
#4327
#4328
#4329
#4329
#433
#4331
#4336
#4337
#4338
#4339
#4340
#4343
#4347
#4348
#4349
#4351
#4351
#4353
#4357
#4358
#436
#4360
#4361
#4362
#4363
#4364
#4366
#4368
#4369
#437
#4373
#4374
#4375
#4378
#4383
#4383
#4384
#4388
#4389
#439
#4390
#4391
#4396
#4398
#4399
#44
#440
#4401
#4404
#4405
#4407
#4408
#441
#4411
#4412
#4413
#4416
#4418
#4419
#442
#4420
#4424
#4425
#4427
#4430
#4431
#4432
#4434
#4436
#4438
#4439
#4444
#4445
#4446
#4449
#4450
#4451
#4451
#4452
#4454
#4456
#4457
#4458
#446
#4461
#4466
#4467
#4468
#4480
#4481
#4483
#4484
#4485
#4486
#4487
#449
#4493
#4493
#4494
#4496
#4499
#45
#450
#4500
#4501
#4502
#4508
#451
#4512
#4516
#4517
#4518
#4519
#4520
#4521
#4522
#4524
#4525
#453
#4530
#4531
#4536
#4537
#4538
#4539
#4540
#4541
#4542
#4543
#4547
#4549
#4549
#455
#4556
#4557
#4558
#456
#4563
#4566
#4568
#4569
#4570
#4573
#4577
#4577
#4578
#458
#4583
#4584
#4585
#4586
#4587
#4588
#4590
#4591
#4592
#4594
#4596
#4598
#460
#4601
#4603
#4604
#4605
#4606
#4607
#4608
#4609
#4610
#4611
#4612
#4613
#4615
#4617
#4619
#462
#4620
#4624
#4625
#4626
#463
#4631
#4632
#4633
#4634
#4635
#4636
#4637
#4639
#464
#4640
#4641
#4642
#4643
#4647
#4650
#4651
#4652
#4653
#4654
#4656
#4657
#4659
#4660
#4663
#4664
#4665
#4665
#4666
#4668
#4670
#4673
#4675
#468
#4681
#4683
#4685
#4688
#469
#4690
#4692
#4693
#4694
#4695
#4697
#4699
#47
#470
#4702
#4705
#4706
#4706
#4707
#4709
#4711
#4711
#4712
#4713
#4714
#4721
#4722
#4724
#4727
#4728
#4732
#4733
#4734
#4735
#4735
#4739
#4740
#4746
#4747
#4748
#4749
#475
#4750
#4750
#4752
#4755
#476
#4766
#4767
#4769
#4769
#4770
#4771
#4771
#4773
#4778
#4779
#4780
#4782
#4783
#4787
#4789
#4790
#4792
#4796
#4797
#4798
#4799
#48
#4800
#4803
#4804
#4805
#4806
#4809
#481
#4812
#4814
#4816
#4817
#4818
#4819
#482
#4822
#4823
#4824
#4826
#4828
#4830
#4831
#4832
#4833
#4835
#4836
#4837
#4838
#484
#4842
#4843
#4844
#4847
#4847
#4848
#4849
#4849
#4850
#4854
#4858
#4859
#4861
#4862
#4865
#4868
#4878
#4882
#4883
#4887
#4895
#4896
#4897
#4898
#49
#4902
#4906
#4912
#4913
#4915
#4916
#4918
#4919
#4920
#4924
#4926
#4927
#4928
#4929
#4934
#4935
#4936
#4937
#4937
#4938
#4939
#494
#4940
#4942
#4946
#4947
#4947
#4949
#495
#4950
#4951
#4952
#4955
#4957
#4958
#496
#4960
#4961
#4961
#4962
#4963
#4964
#4965
#4966
#497
#4974
#4975
#4979
#4980
#4981
#4982
#4983
#4985
#4986
#4986
#4988
#499
#4991
#4992
#4995
#4996
#4999
#5
#50
#500
#5000
#5001
#5002
#5004
#5007
#5008
#501
#5010
#5011
#5013
#5014
#5015
#5015
#5016
#5018
#5021
#5025
#5026
#5028
#5029
#503
#5034
#5035
#5036
#5037
#5038
#5039
#5040
#5042
#5043
#5045
#5048
#5051
#5053
#5056
#5060
#5061
#5065
#5072
#5073
#5074
#5075
#5077
#508
#5082
#5082
#5083
#5084
#5085
#5086
#5088
#5089
#5090
#5094
#5095
#5096
#5099
#51
#5101
#5103
#5104
#5105
#5106
#5107
#5108
#5110
#5111
#5112
#5113
#5115
#5117
#5118
#5119
#512
#5120
#5120
#5121
#5122
#5125
#5126
#5126
#5127
#5128
#5129
#513
#5130
#5131
#5133
#5134
#5135
#5137
#5137
#5138
#5139
#514
#5141
#5141
#5142
#5144
#5147
#5148
#5149
#515
#5150
#5154
#5156
#5157
#5159
#516
#5160
#5161
#5162
#5163
#5164
#5165
#5167
#5168
#5169
#517
#5170
#5172
#5176
#5181
#5182
#5183
#5184
#5185
#5187
#5191
#5193
#5194
#5196
#5197
#52
#5204
#5206
#5208
#5211
#5215
#5216
#5217
#5219
#5220
#5224
#5224
#5225
#5226
#5229
#523
#5230
#5233
#5234
#5235
#5237
#5237
#5238
#5239
#524
#5240
#5243
#5244
#5245
#5245
#5249
#525
#5252
#5252
#5253
#5254
#5255
#5256
#5257
#5258
#5258
#5259
#526
#5260
#5263
#5264
#5268
#5269
#527
#5270
#5271
#5272
#5275
#528
#5281
#5286
#5287
#5287
#5289
#529
#5291
#5292
#5293
#5296
#5297
#5298
#5299
#53
#5300
#5301
#5303
#5306
#531
#5314
#5317
#5318
#532
#5320
#5322
#5323
#5324
#5325
#5325
#5328
#5329
#5330
#5333
#5336
#5338
#534
#5342
#5343
#5345
#5346
#5350
#5351
#5352
#5353
#5354
#5355
#5358
#5359
#5360
#5361
#5363
#5364
#5366
#5366
#5368
#5369
#5370
#5372
#5373
#5375
#5376
#538
#5382
#5382
#5385
#5386
#5387
#5389
#539
#5390
#5391
#5395
#5396
#54
#540
#5401
#5402
#5403
#5406
#5408
#5409
#5411
#5412
#5413
#5414
#5415
#542
#5420
#5423
#5423
#5424
#5424
#5425
#5427
#5428
#543
#5434
#5436
#544
#5445
#5445
#545
#5453
#5454
#5455
#5456
#5457
#5458
#5459
#546
#5461
#5462
#5463
#5464
#5465
#5466
#5467
#5468
#5473
#5475
#5477
#548
#5481
#5483
#5483
#5490
#5491
#5493
#55
#5500
#5501
#5504
#5505
#5505
#5506
#551
#5516
#5518
#5518
#5519
#552
#5522
#5525
#5526
#5528
#5529
#553
#5530
#5531
#5532
#5533
#5540
#5546
#5547
#5549
#5552
#5555
#5557
#5559
#556
#5562
#5565
#5566
#5567
#5569
#557
#5571
#5572
#5574
#5576
#5577
#5578
#558
#5581
#5584
#5586
#5586
#5588
#559
#5590
#5591
#5594
#5596
#5598
#56
#560
#5600
#5601
#5601
#5604
#5605
#5606
#5608
#5609
#561
#5610
#5611
#5612
#5613
#5614
#5614
#5621
#5622
#5624
#5625
#5625
#5626
#5628
#5629
#563
#5632
#5633
#564
#5643
#565
#5650
#5651
#5652
#5654
#5658
#566
#5664
#5666
#5668
#5669
#567
#5670
#5672
#5673
#5675
#5676
#5680
#5681
#5683
#5684
#5686
#5687
#5688
#569
#5691
#5694
#5697
#5699
#57
#570
#5700
#5702
#5703
#5705
#5707
#571
#5711
#5712
#5713
#5714
#5715
#572
#5720
#5722
#5725
#5727
#5728
#5730
#5755
#5756
#5757
#5759
#576
#5761
#5763
#5763
#5764
#5765
#5767
#5769
#577
#5771
#5773
#5774
#5775
#5777
#578
#5780
#5781
#5782
#5783
#5785
#5786
#5789
#5790
#5791
#5796
#5797
#5798
#58
#5800
#5802
#5804
#5804
#5806
#5807
#5811
#5815
#5816
#5817
#5820
#5821
#5823
#5824
#5825
#5826
#5827
#5839
#584
#5840
#5845
#5846
#585
#5852
#586
#5868
#587
#5877
#5878
#5879
#5879
#588
#5881
#5901
#5902
#591
#5917
#592
#5921
#5929
#593
#5936
#5937
#594
#595
#596
#597
#5982
#6
#60
#6002
#601
#6011
#602
#6028
#604
#606
#608
#6093
#6094
#6094
#623
#630
#631
#632
#6360
#6364
#637
#6378
#638
#6382
#6386
#6387
#6387
#6388
#6390
#6392
#6393
#6394
#6395
#6397
#6398
#640
#6402
#6403
#641
#6410
#642
#644
#6443
#6445
#6446
#6447
#6449
#645
#6450
#6452
#6453
#6455
#6456
#6458
#6459
#646
#6462
#6462
#6472
#6478
#6478
#6484
#6485
#6487
#6488
#6489
#649
#6490
#6491
#6493
#6494
#6495
#6496
#6498
#6500
#6502
#6504
#6508
#651
#6517
#652
#6520
#6527
#6528
#6530
#6531
#6531
#6532
#6541
#6543
#6544
#6546
#6547
#6550
#6551
#6553
#6553
#6554
#6554
#6557
#656
#6560
#6562
#6564
#6570
#6573
#6574
#6575
#6577
#6578
#6579
#6580
#6583
#6584
#6586
#6587
#6588
#659
#6590
#6592
#6597
#660
#6601
#6602
#6603
#6604
#6606
#6607
#6609
#661
#6610
#6611
#6613
#6614
#6615
#6621
#6622
#6623
#6626
#6626
#6627
#6627
#6628
#6630
#6631
#6632
#6633
#664
#6641
#6641
#6645
#6646
#6648
#6649
#6649
#6650
#6652
#6655
#6655
#6658
#6658
#6661
#6662
#6663
#6665
#6668
#6669
#667
#6670
#6674
#6674
#6675
#6675
#6677
#6681
#6682
#6686
#6686
#6688
#669
#6693
#6694
#6694
#6696
#6697
#6698
#6698
#67
#670
#6706
#6710
#6711
#6711
#6717
#6717
#672
#6721
#6722
#676
#677
#678
#680
#681
#682
#683
#687
#689
#69
#692
#695
#696
#699
#7
#70
#701
#708
#709
#71
#711
#712
#714
#719
#72
#720
#723
#727
#728
#732
#734
#735
#737
#740
#741
#742
#746
#747
#749
#75
#751
#752
#755
#760
#761
#762
#763
#764
#765
#766
#767
#77
#772
#773
#775
#779
#78
#786
#79
#791
#796
#798
#799
#801
#802
#804
#809
#812
#817
#819
#820
#822
#824
#825
#827
#83
#832
#833
#834
#835
#836
#839
#843
#844
#847
#848
#849
#851
#854
#855
#856
#857
#858
#861
#862
#865
#867
#868
#870
#871
#873
#878
#880
#881
#882
#884
#888
#890
#891
#892
#893
#895
#896
#898
#9
#901
#902
#903
#905
#909
#910
#911
#913
#915
#916
#917
#918
#919
#92
#920
#921
#922
#923
#926
#93
#933
#934
#941
#945
#954
#955
#958
#959
#96
#960
#963
#964
#965
#968
#970
#971
#972
#976
#977
#978
#979
#980
#981
#983
#984
#985
#986
#990
#993
#994
#995
#996
#997
#999
grad-norm-test
v0.1.0
v0.10.0
v0.10.1
v0.10.2
v0.10.3
v0.11.0
v0.11.1
v0.11.2
v0.12.0
v0.12.1
v0.12.2
v0.12.3
v0.12.4
v0.12.5
v0.12.6
v0.13.0
v0.13.1
v0.13.2
v0.13.3
v0.13.4
v0.13.5
v0.14.0
v0.14.1
v0.14.2
v0.14.3
v0.14.4
v0.14.5
v0.15.0
v0.15.1
v0.15.2
v0.15.3
v0.2.0
v0.3.0
v0.3.1
v0.3.10
v0.3.11
v0.3.12
v0.3.13
v0.3.14
v0.3.15
v0.3.16
v0.3.2
v0.3.3
v0.3.4
v0.3.5
v0.3.6
v0.3.7
v0.3.8
v0.3.9
v0.4.0
v0.4.1
v0.4.2
v0.4.3
v0.4.4
v0.4.5
v0.5.0
v0.5.1
v0.5.10
v0.5.2
v0.5.3
v0.5.4
v0.5.5
v0.5.6
v0.5.7
v0.5.8
v0.5.9
v0.6.0
v0.6.1
v0.6.2
v0.6.3
v0.6.4
v0.6.5
v0.6.6
v0.6.7
v0.7.0
v0.7.1
v0.7.2
v0.7.3
v0.7.4
v0.7.5
v0.7.6
v0.7.7
v0.8.0
v0.8.1
v0.8.2
v0.8.3
v0.9.0
v0.9.1
v0.9.2
v0.9.3
v0.9.4
v0.9.5
Выбрать ветку
Скрыть запросы на слияние
AutoPR/0.12.2
AutoPR/0.14.0
AutoPR/0.14.5
CUDA-Graph-support
HeyangQin/deepspeed-ulysses-chinese-blog
HeyangQin/enable_hpz_nograd
HeyangQin/fastgen_moe_h100
HeyangQin/fix_hpz_nograd
HeyangQin/fix_issue_3062
HeyangQin/fix_issue_3068
HeyangQin/fix_issue_3156
HeyangQin/fix_issue_5205
HeyangQin/fix_pr_3462_standalone
HeyangQin/hpz_convergence
HeyangQin/inference_t5_phase1
HeyangQin/mixed_precision_lora_sam
HeyangQin/mixz_tutorial
HeyangQin/skip_bias_quant
HeyangQin/staging-zero-pp-v1
HeyangQin/ucp_blog_chinese
HeyangQin/ulysses_fp8
Megtron-Kernel-Integration
SA_feature_tag
SA_tutorial_update
SA_update_tutorial_link
add-bfp16-support
add-comm-layout
add-inference-comm
add-llama2-support
add-quantizer
add-shared-lib
adk9/phi3-inference
adk9/phi3-small
adk9/update-minor-cuda
amawa/1-bit-alltoall
amawa/1bit-adam-nccl
amawa/add-moe-container
amawa/aml-get-hosts
amawa/auto-save-ckpt
amawa/config-pass-down
amawa/debug
amawa/fix-amd-rocm
amawa/fix-auto-tp-load-ckpt
amawa/fix-tracer-zero3
amawa/fix-z3-for-hf-accelerate
amawa/fix-z3-warn-print-v2
amawa/inference-fix
amawa/remove-deepcopy
amawa/split-a2a
amawa/zero-inf-refactor
amd-jiting
aml-autotuner
arashb-patch-1
arashb/fix-phi-2
arpan/auto-check
autocast-fix
awan-10-patch-1
awan-10-patch-2
awan-10-patch-3
azure
big-science
big-science-v2
bing/debugging
bing/ds-adam
bing/formatting-correction
bing/io-tutorial
bing/modify-ds-optimizer
bing/optimizer-naming
bloom-debug
chatgpt-chinese-blog
check-linear-sizes
cholmes/activation-utils
cholmes/checkpoints-inference-v2-2
cholmes/comm-group-cache
cholmes/fix-asym-quant
cholmes/fix_reduction_utils_amd
cholmes/isolate-src-code
cholmes/kv-cache-flexibility
cholmes/mem-access-predicated-load
cholmes/migrate-to-dequant-lib
cholmes/pipelined-quant
cholmes/reduce-quantized-gpus
cholmes/sd-extension
cholmes/ts-builder
cholmes/unique-cuda-graphs
ckpt-fix-unfused
clean-llama
clean-llama-v2
clean-opt
clean-opt-base
clean-opt-v2
clean-opt-v2-base
codegen-inference
comm-opt2
costineseanu/windows_inference_build
cpu-adam/optional_CUDA-copy
debug-base-attn
debug-ds-inf
debug-ds-inf-torch-matmul
ds-chat-blog-8-31
ds-chat-clean-opt
ds-chat-news
ds-chat-release
ds-inference/add-falcon-support
ds-inference/bloom-support-meta
ds-inference/fix-generation
ds-inference/fix-mp
ds-inference/remove-randgen
ds-inference/simplify
ds-inference/support-large-token-length
ds-seq-tutorial
ds-vchat-blog-v1
ds-vchat-blog-v2
duli/capability
duli/cuda_op_builder
duli/op_builder
duli/pre_post
duli/zero_debugging
elastic-ckpt-refresh
elasticity-v2
eltonz/copy_grad_stream
enable-neox
encoded-ds-config
fairseq-moe
fairseq-moe-debug
falcon-180b
fastgen-blog
fastgen-blog-2
features/rebase-quant-fp6
fix-MoQ
fix-autotuning-docs
fix-autotuning-exit
fix-autotuning-reqs
fix-flops-profiler
fix-fp16-test
fix-injection
fix-max_train_batch_size
fix-misaligned-grad
fix-moe-top1gating
fix-sp-dense
fix-sparse-attn
fix-tuner-prescale_gradients
fix-tuner-scheduler-bug
fix-twitter
fix-typos
fix_mpu_ckpt
flash-attention
flops-profiler-skip-unused-args
fp6-blog
fs-82
fs-soft-kernel
fs-z2-fix
fs/soft-kernel
gcooper/make_optimizer_optional
generic-ckpt-loading
gh-pages
gh-readonly-queue/master/pr-3852-3491e32d72746ec3d990108a23e67b2666b3e0e0
gh-readonly-queue/master/pr-3852-adb9bc14b780115fd54f3f1234abcb7ab52fa975
gh-readonly-queue/master/pr-3854-85503dab878875175b6d5eb6a39125878c172273
gh-readonly-queue/master/pr-3892-548451ba4e8ea71029d738c33f639e0439aad1dd
gh-readonly-queue/master/pr-3892-9f8817b2425bb82d9b6355caa6d2d0ebd036885d
gh-readonly-queue/master/pr-3893-cc71eec8c85c4437d8139e53372da7f22224fed5
gh-readonly-queue/master/pr-3928-82115d9059ce8271229c8f63153a02f2d323cfc1
gh-readonly-queue/master/pr-4163-5e16eb2c939707d0d0062a458d77998fccb3afad
gma/xpu_compile_analysis
good-moe
gpt2-debug
guanhua/adam-timer
guanhua/adam-timer2
guanhua/check-bf16
guanhua/fix-cutlass-ver
guanhua/h2d-offload
guanhua/kernel-test
guanhua/mics-fix
guanhua/overflow-check
guanhua/quant-dequant-test
guanhua/quant-test
guanhua/rocm-cpu-adam
guanhua/v14.0-bf16-check
hf-workaround
hp-sam
hpzero-preview
inference-api/tutorial
inference-read-checkpoint
inference-refactor-v1-mro-test
inference/ElutherAI-GPTJ
inference/TP-general-support
inference/add-bf16-support
inference/engine-api
inference/fix-masking
inference/fix-mp-init
inference/support-encoder-decoder
injection-fixes
jeff-test
jeffra-patch-2
jeffra/1node-launcher-fix
jeffra/2904
jeffra/auto-bucket
jeffra/available_memory
jeffra/bf16-updates
jeffra/bf16-updates-v2
jeffra/ci-updates
jeffra/ckpt-barrier
jeffra/docker-update
jeffra/engine-xthru
jeffra/engine-xthru-v2
jeffra/engine-xthru-v2-no-padding
jeffra/external-skip
jeffra/fix-1416
jeffra/fs-diverge
jeffra/fs-gas-fix
jeffra/fs-gas-fix-v2
jeffra/fs-support
jeffra/fs-z3
jeffra/fs-z3-v0510
jeffra/gptj-fixes
jeffra/inf-engine-refactor
jeffra/inf-tests
jeffra/jit-fix
jeffra/latest-hf
jeffra/op-build-api
jeffra/prepost_fwd_and_generate
jeffra/saksham-zero1-fixes
jeffra/savepid2
jeffra/shm-report
jeffra/staging-comms-logging-v1
jeffra/turn-on-opt-test
jeffra/update-z3-check
jeffra/z1-refresh
jeffra/z1-refresh-2
jeffra/z1-refresh-3
jeffra/z3-fix
jeffra/z3-new-param
jeffra/zero-1-fix
jeffra/zero-1-fix-test
jeffra/zero-ckpt-fixes
jeffra/zero-moe-noCG
jeffra/zero1-grad-norm
jerasley/mac
jomayeri/aio-file-offset
jomayeri/aio-locked-tensor
jomayeri/aio-mem-fix
jomayeri/aio-type-mismatch
jomayeri/bf16-zero-check
jomayeri/bug-5880
jomayeri/debug-2361
jomayeri/deepnvme-perf-debug
jomayeri/destroy-zero
jomayeri/fp8-init
jomayeri/gds-swapper-fix
jomayeri/h100-unittest
jomayeri/he-mp-assert
jomayeri/issue-3367
jomayeri/issue-3560
jomayeri/issue-3598
jomayeri/issue-3769
jomayeri/issue-4083
jomayeri/issue-4095
jomayeri/issue-4183
jomayeri/issue-5087
jomayeri/lr-step-init
jomayeri/lr-step-move
jomayeri/model-param-list
jomayeri/new-zero-accum
jomayeri/swap-with-locked
jomayeri/zero-grad-accum
jomayeri/zero3-hooks
kv-cache-reset
landing-training
landing-updates
lekurile/add_ds_chat_workflow
lekurile/add_hip_abstraction
lekurile/clean_up_params
lekurile/container_param_cleanup
lekurile/ds_chat_attn_mlp_base
lekurile/ds_chat_fix_test
lekurile/ds_chat_gh_wf
lekurile/ds_chat_mlp_debug
lekurile/ds_chat_revert_54c06872
lekurile/ds_chat_test_54c06872
lekurile/ds_chat_test_7b5b0660
lekurile/ds_chat_test_exit_first
lekurile/ds_chat_test_f69f8840
lekurile/fix_ds_chat_bloom
lekurile/fix_formatting
lekurile/fix_he_print
lekurile/fix_issue_2330
lekurile/fix_opt_meta_tensor
lekurile/fix_phi_2
lekurile/fix_sd
lekurile/fix_sd_ci
lekurile/fix_unet_vae
lekurile/general_local_cg
lekurile/infv2_lm_eval
lekurile/kernel_hip_amd
lekurile/load_ckpt_inf_eng
lekurile/mlp_functions
lekurile/offload_fix_test
lekurile/sd_min_ver
lekurile/test_rearrange_ops
lekurile/update_ds_chat_ci
lekurile/update_ds_chat_ci_2
lekurile/update_ds_chat_ci_test
lekurile/update_dschat_wf
lekurile/update_inf_ckpt_load
lf-test
loadams/adam-params
loadams/add-contributing-release-md-files
loadams/add-gaudi-badge-readme
loadams/add-scheduled-open-issue-check-ds-chat
loadams/add-torch-2-support
loadams/amd-57
loadams/amd-mi200-tests
loadams/amd-pre-compile
loadams/amd-updates
loadams/auto-stage3-prefetch-bucket-size
loadams/auto-task-open-failure
loadams/build-for-cpu
loadams/changes-to-op-builder
loadams/check-ds-chat-transformers-debug
loadams/check-pydantic-v2-support
loadams/clear-cache
loadams/cpu-inf
loadams/cpu-inf-triggers
loadams/cpu-inf-v0-docker
loadams/cpu-inference-shorten
loadams/cpu-torch
loadams/cu118
loadams/debug-torch
loadams/disable-h100-ci
loadams/disable-windows-ops-build-script
loadams/dot-deepspeed_env-test
loadams/dpkg-libaio
loadams/empty-env-var-setup
loadams/enable-amdmi200
loadams/enable-workflow-dispatch-nv-torch-nightly-v100
loadams/engine-pos-args
loadams/fix-check-valid-version
loadams/fix-cpu-inf-test-time
loadams/fix-cuda-build-ops
loadams/fix-ds-chat-transformers
loadams/fix-fp16-bf16-logging-issue
loadams/fix-hpu
loadams/fix-lightning-pytorch2
loadams/fix-mpi4py
loadams/fix-nccl-comm-torch-check
loadams/fix-no-torch-failure-mlu
loadams/fix-nv-inference
loadams/fix-nv-inference-hang
loadams/fix-nv-torch-latest-v100
loadams/fix-onebit-skip
loadams/fix-torch-2
loadams/fix-torch-compiler-hasattr
loadams/fix-triggers-no-torch-workflow
loadams/flops-profiler-scaled-dor-attn-torch-2
loadams/get-amd-team-ci
loadams/gh-cpu-inf
loadams/gh-release-version-update
loadams/hf-transformers-ci-fix
loadams/hpu-uts
loadams/ignore-unused-params-default
loadams/lamb-bf16
loadams/libaio
loadams/low-cpu-mem-ut
loadams/lsb-release
loadams/megatron
loadams/megatron-lm-112
loadams/megatron-new-pypi
loadams/megatron-version
loadams/mii-transformers-debug
loadams/more-torch-2-support
loadams/nv-inf-jobs-test
loadams/nv-inf-test
loadams/nv-inference-revert
loadams/nv-nightly
loadams/nv-nightly-fix-transformers
loadams/nv-sd-badge
loadams/openmpi-eth0
loadams/pin-torch-latest-ver
loadams/py36
loadams/pynvml
loadams/recurse-flops-profiler
loadams/reenable-cpu-inference
loadams/remove-dead-code
loadams/remove-modeling
loadams/remove-python-36-check
loadams/rename-fp-quantize-cu
loadams/rename-nv-torch-latest-cpu-workflow
loadams/revert-4660
loadams/revert-5608
loadams/revert-cpu-inf
loadams/revert-loss
loadams/revert-nv-inference-changes
loadams/revert-pr-5608
loadams/revert-userwarning
loadams/rocm-fixes
loadams/rocm57
loadams/rocm6
loadams/sd-paths
loadams/setup-h100-triggers
loadams/shuffle-data-sampler
loadams/sigterm
loadams/skip-nv-inference
loadams/sparse-attn-fix
loadams/sparse-attn-torch-2
loadams/stablediffusion-test-triton2
loadams/switch-modeling-compression
loadams/tar-vuln
loadams/test-0.15.0
loadams/test-amp-futurewarning
loadams/test-b421e8c8f31af254b63ad6e9839f617ab6d9c060
loadams/test-ccl-fixes
loadams/test-compile
loadams/test-cpu
loadams/test-cpu-inf-fix
loadams/test-f0e3f01d7c7a3d8748212e61eaf487fab41168a7
loadams/test-fix-nv-inference
loadams/test-glibc228
loadams/test-merged-changes
loadams/test-model-task
loadams/test-nv-ds-chat-failure-mode
loadams/test-nv-latest-cpu
loadams/test-nv-torch-latest-v100
loadams/test-pytest-ordering
loadams/test-runsc
loadams/test-torch-2.3.0
loadams/torch-cpu-mismatch-cudaopbuilder
loadams/torch-nightly-debug
loadams/transformers-fixes
loadams/transformers-torch
loadams/transformers-torch-update
loadams/transformers-workflow-dispatch
loadams/triton-22-update
loadams/try-bump-pydantic
loadams/unpin-hf-transformers-nv-workflows
loadams/unpin-nv-torch-latest
loadams/unpin-transformers
loadams/update-2004-checkout-actions
loadams/update-accelerate
loadams/update-amd-required-paths
loadams/update-conda-pydantic
loadams/update-container-a6000
loadams/update-docker
loadams/update-dockerfile
loadams/update-hostname-I
loadams/update-hpu-1-18
loadams/update-hpu-docker-container
loadams/update-hpu-docker-image
loadams/update-hpu-gaudi-flow-more
loadams/update-just-nv-a6000-container
loadams/update-mii-transformers
loadams/update-nodejs-reate-pr-action
loadams/update-nv-accelerate
loadams/update-nv-inference-torch-ver
loadams/update-nv-lightning-test-cu-ver
loadams/update-nv-torch-latest-cpu-torch-ver
loadams/update-nv-torch-latest-cpu-version
loadams/update-pre-compile-ops-docker
loadams/update-pydantic
loadams/update-pytest
loadams/update-pytest-error-codes
loadams/update-real-latest
loadams/update-sd-triton
loadams/update-torch-113
loadams/update-transformers
loadams/update-transformers-cu116
loadams/update-ubuntu24.04
loadams/update-version-txt-post-release
loadams/update-website-sidebar
loadams/x86-accelerator
loadams/xpu-readme
loadams/xpu-test
loadams/xpu-yml
lokoppak/ln_schedule_update
lokoppak/low_cpu_mem_usage_ut
lokoppak/new_pt_binding
lokoppak/quantization_3d
lokoppak/ref_ln
lsh
master
master-test
megatron2.4-3d
minjiaz/ds-seq-tutorial
minjiaz/moe-comm
minjiaz/moe-sharing
moe-full-tp
moe-inference-tutorial
moe-inference-tutorial1
moe-inference/add-tutorial
moe-pipelining
moe-timing
mosm/autotp-he
mosm/autotp_llama
mosm/bloom_dev
mosm/codegen
mosm/debug-ds-attn
mosm/debugger
mosm/dschat-news
mosm/inf-refactor
mosm/llama2
mosm/matmul_test
mosm/module_parser
mosm/mp_tutorial
mosm/opt-kernel
mosm/softmax
mosm/softmax-longseq
mosm/t5
mosm/test
mosm/tp_dev
mosm/wb-param
mrwyattii/expand-fp16-tests
mrwyattii/fix-accelerate-tests
mrwyattii/fix-for-mii-UT
mrwyattii/fix-inference-skipped-tests
mrwyattii/fix-launcher-user-args
mrwyattii/fix-multi-node-checks
mrwyattii/pin-datasets
mrwyattii/pydantic-2-support
mrwyattii/remove-symlinks
mrwyattii/rename-cpu-accelerator
mrwyattii/safetensor
mrwyattii/silence-backend-warning
mrwyattii/update-GH-permission
mrwyattii/update-MII-tests-infV2
multi-z3-prs
multi-z3-prs-r2
mz/llama-support
neox-q-int8
niumanar/gan_optimizer
offloadpp-news
olruwase/accelerator_abstraction
olruwase/adam_types
olruwase/align_rrg_rs_param_order
olruwase/all_gather_profiling
olruwase/amd_configurable_pp_rtol
olruwase/assert_unused_parameters
olruwase/b16-debugging
olruwase/bf16-updates-2
olruwase/bf16_tied_weights_reduce
olruwase/bf16_update_hp_params
olruwase/bloom-support
olruwase/bloom_176b_checkpoint_bc
olruwase/build_compat_ops
olruwase/ci_pytorch_1x
olruwase/deepnvme_abstract_class
olruwase/deepnvme_docs
olruwase/disable_prefetch_profiler
olruwase/disable_z3_prefetcher
olruwase/dnvme_docs
olruwase/ds_2449
olruwase/ds_2921
olruwase/ds_3481
olruwase/ds_3680_2
olruwase/ds_3948
olruwase/dynamic_graph_activation_checkpoint
olruwase/elastic-ckpt-refresh
olruwase/engine_destroy
olruwase/fix_kernel_memory_bloat
olruwase/frozen_weights_unit_test
olruwase/fs-zero3_trace_fix
olruwase/fs_z3_trace_error_disable
olruwase/fs_z3_trace_log
olruwase/fuse_torch_adam_w
olruwase/gpt3-finetuning
olruwase/grad_accum_loss
olruwase/issue_3062
olruwase/llama2_empty_group
olruwase/local_storage_checkpoint
olruwase/lr_warmup_decay
olruwase/no_grad_sync_ctxt
olruwase/non_tensor_activation_checkpoint
olruwase/nvme_finetune
olruwase/nvme_offload_bug
olruwase/nvme_perf_sweep
olruwase/nvme_testsuite
olruwase/override_module_apply
olruwase/refactor_universal_checkpoint
olruwase/restore_from_bit16_weights
olruwase/round_robin_gradient_option
olruwase/safe_pkg_check
olruwase/safe_py_subprocess
olruwase/save_checkpoint_latest_false
olruwase/save_zero3_fp16_weights
olruwase/set_zero_opt_grad
olruwase/setup_env_libaio
olruwase/trainable_parameters
olruwase/windows_blog
olruwase/z3_perf_tune
olruwase/z3_suppress_warning
olruwase/zcode_model_expert
olruwase/zero1_non_tensor_checkpoint
olruwase/zero2_grad_accum_bug
olruwase/zero2_offload_keyerror
olruwase/zero2_offload_rrb_divergence
olruwase/zero2_offload_slowdown
olruwase/zero2_trainable_parameters
olruwase/zero2_trainable_parameters_v0.5.7
olruwase/zero2_unbalanced_grad_reduction
olruwase/zero3_amp_autocast
olruwase/zero3_broken_tracing
olruwase/zero3_dp_norm_allreduce
olruwase/zero3_profile_fetch
olruwase/zero3_unboundlocal_bug
olruwase/zero_inference_tokgen
olruwase/zero_inference_torch_version
olruwase/zero_multi_models
olruwase/zero_offload_e2e
olruwase/zero_offload_fix_corner_case
olruwase/zero_offload_v3
olruwase/zero_optional_reduce_scatter
olruwase/zero_stage1_checkpoint_layout
olruwase/zero_stage1_elastic_checkpoint
olruwase/zinf_none_swapper
paper
patch-z1-cont-grad
pr_moe_tutorial
preserve-CVDs
profiler-add-shape
qanthony/bigbird
qanthony/comms-bench
qanthony/nccl-backend
quantization-refresh
quantize-inference
refine-quantizer
remotes/origin/dev/tput
remove-tbx
remove-unused-quantize-settings
reyazda/adam-scalar-fix
reyazda/cpu_adam_jit_v2
reyazda/fix-inference-api
reyazda/pytorch-workspace-allocate
reyazda/remove_bertid
reyazda/support_AVX2_by_default
reyazda/test-hidden-dimension
reyazda/test-sparse
reyazda/test-sparse-v2
reyazda/test-transformer
reyazda/testing_embedding
reyazda/triton-new-sparse
reza/deepspeed_adam_merge_v3
reza/fix-adam-copyfp16
reza/fix_adam_corner_case
reza/fix_adam_perf
reza/megatron_kernel_integration
rtd-staging
saksham-zero1-fixes
samyam-overlap-comm
samyamr/elasticity
samyamr/fix-for-fragmented-linear-inputs
samyamr/gpt3-finetuning
samyamr/gpt3-finetuning-mixed-precision
samyamr/stage3-alignment-fix
samyamr/zero-2-debug
security-patch
shaden/textgen
smartreply_hotfix
sp/comm-opt
sparse-attn-cuda11
sparse-attn/support-latest-triton
staging-amd
staging-amd-port
staging-amd-v2
staging-amd-v3
staging-comms-next-v2
staging-comms-v1
staging-deepnvme-gds-v1
staging-demo-feature-v0
staging-ds-chat-blog-v1
staging-ds-seq-v1
staging-inference-v2-5
staging-mii-update
staging-moe-next-v1
staging-oaas
staging-pld-v1
staging-pp
staging-test
staging-zero-dual-v2
staging-zero-dual-v3
staging-zero-dual-v5
staging-zero-inference-v1
stale-issues
styoun/triton-flash2
styoun/triton2.1
styoun/triton2.1-autotune
styoun/zero-inf-8bit-q
subprocess-test
test-ac
test-cuda-11.7
tmp
tmp-old
tohtana/add_slides_meetup_japan
tohtana/allocate_test_port
tohtana/autocast_only_floating_values
tohtana/bcast_warning_z3
tohtana/blog_win_jp
tohtana/cache_kv_requirements
tohtana/clean_after_test
tohtana/clean_all_param_coordinators
tohtana/clean_up_prefetch_param
tohtana/compile-zero
tohtana/compile_no_grad
tohtana/consistent_zero_grad
tohtana/debug_compile_backends
tohtana/debug_semaphore_leak
tohtana/file_store_for_tests
tohtana/fix-save-checkpoint-step
tohtana/fix_bf16_opt_update_hp
tohtana/fix_chkpt_alignment
tohtana/fix_sort_dp_univ_ckpt
tohtana/fix_univ_chkpt_load
tohtana/fix_zero_init_patch
tohtana/get_offload_state_api
tohtana/lock_hf_cache_update
tohtana/log_run_tests
tohtana/merge_FPDT
tohtana/model_declaration_in_init_context
tohtana/offload_zero_buffers
tohtana/pipeline_with_compiled_module
tohtana/remove_step_on_init
tohtana/simplify_param_coordinator
tohtana/test_with_pt25
tohtana/univ_ckpt_custom_shape
tohtana/z3_multi_dtypes
tohtana/z3_no_mixed_precision
token-drop
transformer-injection
transformer-kernel/support-arbitrary-hidden
transformer/fix-layer-norm
transformer/injection
transformer/large-seq-support
transformer/triangular-mask
triton-fix
ucp_blog
umchand/test_compiler
umchand/triton/bias_act
unify-benchmark-knowledge
update-flops-profiler-doc
update-flops-profiler-pool-compute
workaround-zero3
z1-offload-multigpu
z3-mem-leak
zero-ckpt-cpu-issue-v2
zhenyzhang-data
zheweiyao/quantize_update
#1
#10
#100
#1000
#1001
#1004
#1008
#1012
#1013
#1014
#1014
#1015
#1017
#1021
#1023
#1024
#1025
#1026
#1027
#103
#1032
#1036
#1038
#1039
#104
#1040
#1042
#1044
#105
#1052
#1053
#1058
#1059
#106
#1060
#1065
#1066
#1067
#1068
#107
#1071
#1072
#1076
#1078
#108
#1085
#1086
#1090
#1091
#1092
#1093
#1094
#1095
#1096
#1097
#1099
#110
#1100
#1102
#1103
#1104
#111
#1113
#1114
#112
#1128
#1129
#113
#1134
#1135
#1136
#1139
#1140
#1146
#1148
#1149
#1150
#1151
#1154
#1157
#1160
#1160
#1163
#1164
#1166
#1167
#1168
#1169
#117
#1170
#1178
#1181
#1185
#1188
#1190
#1191
#1195
#1198
#1199
#12
#1202
#1204
#1210
#1212
#1213
#1214
#1215
#1219
#1220
#1221
#1223
#1224
#1225
#1227
#123
#1234
#1239
#124
#1240
#1244
#1246
#1247
#1249
#125
#1250
#1251
#1252
#1254
#1256
#1258
#1259
#126
#1261
#1263
#1264
#1271
#1273
#1274
#1278
#128
#1280
#1284
#1286
#1287
#1290
#1292
#1293
#1294
#13
#1305
#1307
#1309
#1310
#1311
#1312
#1314
#1316
#1318
#1318
#132
#1321
#1322
#1324
#1325
#1326
#1328
#1329
#133
#1330
#1333
#1337
#1338
#1339
#1344
#1349
#135
#1350
#1352
#1353
#1354
#1358
#1359
#136
#1360
#1361
#1362
#1366
#1368
#1370
#1372
#1373
#1374
#1376
#1377
#1380
#1382
#1383
#1387
#1388
#1389
#139
#1391
#1393
#1396
#1397
#1398
#1399
#1400
#1404
#1405
#1406
#1407
#1408
#1409
#141
#1411
#1417
#1418
#1419
#142
#1420
#1421
#1422
#1423
#1424
#1425
#1427
#1428
#1429
#143
#1430
#1433
#1434
#1438
#1439
#144
#1440
#1443
#1446
#1447
#1448
#145
#1450
#1453
#1455
#1456
#1457
#146
#1461
#1462
#1463
#147
#1473
#1474
#1476
#148
#1484
#1486
#1487
#1489
#149
#1490
#1491
#1492
#1494
#1498
#15
#1500
#1501
#1503
#1504
#1505
#1506
#1509
#151
#1510
#1511
#1512
#1514
#1516
#1518
#1519
#1520
#1521
#1524
#1525
#1527
#1528
#1529
#1530
#1531
#1532
#1536
#1537
#1540
#1542
#1544
#1545
#1548
#1549
#1550
#1552
#1553
#1554
#1555
#1556
#1557
#1558
#1560
#1562
#1564
#1565
#1567
#1568
#1569
#1571
#1573
#1577
#1578
#1579
#1582
#1582
#1583
#1585
#1587
#1588
#1589
#159
#1591
#1592
#1593
#1596
#1597
#1598
#1601
#1602
#1605
#1606
#1606
#1607
#1608
#161
#1615
#1615
#1616
#162
#1622
#1623
#1626
#1628
#1632
#1633
#1634
#1636
#1637
#164
#1641
#1642
#1646
#165
#1651
#1652
#1655
#1657
#1659
#166
#1660
#1663
#1664
#1665
#1670
#1673
#1675
#1676
#1679
#168
#1681
#1683
#1688
#1689
#1690
#1698
#170
#1700
#1704
#1705
#1706
#1707
#1708
#1709
#171
#1711
#1712
#1714
#1715
#1717
#1718
#1724
#1725
#1726
#1727
#1728
#173
#1732
#1733
#1734
#1736
#1737
#1741
#1745
#1747
#1750
#1754
#1755
#1758
#1759
#1760
#1764
#1765
#1768
#177
#1774
#1775
#1775
#1778
#1779
#178
#1780
#1790
#1794
#1798
#1799
#1801
#1802
#1803
#1805
#1807
#181
#1811
#1812
#1815
#1817
#1818
#1819
#1821
#1822
#1823
#1826
#1827
#1828
#1829
#1832
#1836
#184
#1841
#1842
#1844
#1845
#1848
#1849
#185
#1850
#1851
#1853
#1854
#1855
#1857
#186
#1866
#1868
#1869
#187
#1873
#1874
#1875
#1877
#1879
#188
#1880
#1881
#1882
#1882
#1884
#1885
#1887
#1889
#1892
#1894
#1899
#190
#1900
#1901
#1906
#1907
#1908
#1913
#1914
#1915
#1916
#1917
#1920
#1921
#1922
#1929
#1930
#1932
#1933
#1934
#194
#1941
#1942
#1943
#1944
#1947
#1951
#1952
#1953
#1954
#1957
#1958
#1959
#1962
#1963
#1964
#1965
#1966
#1968
#197
#1970
#1972
#1974
#1977
#1979
#198
#1981
#1984
#1985
#1988
#1989
#1990
#1992
#1994
#1996
#1998
#2
#2000
#2004
#2007
#2008
#2009
#201
#2011
#2012
#2013
#2014
#2015
#2016
#2017
#2018
#202
#2021
#2024
#2026
#2027
#2028
#203
#2032
#2035
#2038
#204
#2040
#2041
#2042
#2043
#2044
#2045
#2047
#2049
#205
#2050
#2051
#2053
#2058
#2059
#206
#2064
#2065
#2068
#2072
#2074
#2075
#2076
#2079
#208
#2083
#2085
#2087
#2088
#2089
#209
#2091
#2093
#2095
#2098
#2104
#2105
#2106
#2107
#2108
#2110
#2111
#2114
#2118
#212
#2120
#2121
#2122
#2123
#2124
#2126
#2127
#213
#2130
#2132
#2133
#2134
#2135
#2136
#2138
#214
#2140
#2141
#2142
#2143
#2144
#2145
#2146
#2147
#2148
#215
#2150
#2152
#2153
#2155
#2156
#2157
#2158
#216
#2160
#2162
#2164
#2165
#2167
#217
#2170
#2171
#2172
#2173
#2175
#2177
#2178
#2179
#218
#2180
#2181
#2182
#2188
#2189
#219
#2190
#2192
#2196
#2197
#2198
#220
#2201
#2202
#2204
#2205
#2208
#221
#2210
#2210
#2211
#2212
#2213
#2214
#2215
#2216
#2217
#2218
#222
#2220
#2221
#2224
#2225
#2228
#223
#2232
#2235
#2236
#2237
#2238
#224
#2241
#2245
#2247
#2249
#225
#2250
#2253
#2254
#2256
#2257
#2258
#2259
#2260
#2261
#2267
#2269
#2270
#2271
#2274
#2276
#2278
#2279
#228
#2280
#2282
#2284
#2285
#2286
#2289
#2291
#2296
#2297
#2298
#2299
#230
#2303
#2306
#2307
#231
#2310
#2311
#2312
#2313
#2314
#2315
#2316
#2317
#2318
#232
#2320
#2321
#2322
#2323
#2325
#2327
#2328
#233
#2331
#2332
#2333
#2336
#2338
#234
#2340
#2342
#2344
#2345
#2346
#2347
#2348
#2349
#235
#2350
#2351
#2353
#2354
#2356
#2358
#2359
#236
#2362
#2363
#2364
#2369
#2370
#2371
#2373
#2374
#2374
#238
#2380
#2381
#2383
#2384
#2387
#239
#2390
#2391
#2393
#2395
#2397
#24
#240
#2401
#2402
#2403
#2404
#2405
#2409
#2410
#2411
#2415
#2418
#2419
#242
#2420
#2422
#2423
#2425
#2426
#2428
#2429
#243
#2430
#2431
#2432
#2433
#2436
#2437
#2437
#2438
#244
#2440
#2443
#2445
#2446
#2447
#2448
#245
#2450
#2451
#2454
#2455
#2457
#2458
#2459
#246
#2460
#2460
#2464
#247
#2470
#2471
#2472
#2474
#2476
#2477
#2479
#248
#2481
#2483
#2486
#2489
#249
#2491
#2493
#2494
#2495
#2496
#2499
#250
#2500
#2504
#2505
#2507
#2508
#2509
#2511
#2512
#2515
#2516
#2518
#2519
#252
#2521
#2522
#2523
#2524
#2525
#2526
#2526
#2528
#2529
#2530
#2533
#2534
#2535
#2536
#2537
#2538
#2539
#254
#2540
#2541
#2542
#2544
#2545
#2547
#2548
#2550
#2551
#2553
#2554
#2555
#2555
#2556
#2559
#2560
#2561
#2562
#2564
#2566
#2567
#257
#2570
#2571
#2573
#2574
#2575
#2579
#258
#2580
#2580
#2581
#2585
#2586
#2587
#2589
#2590
#2591
#2592
#2599
#26
#260
#2600
#2603
#2604
#2605
#261
#2611
#2613
#2614
#262
#2620
#2621
#2623
#2625
#2626
#2627
#2628
#263
#2630
#2630
#2631
#2633
#2633
#2634
#2635
#2635
#2639
#2640
#2641
#2641
#2642
#2643
#2643
#2645
#2646
#2647
#2649
#265
#2653
#2655
#2657
#266
#2660
#2661
#2662
#2663
#2664
#2665
#2668
#2669
#267
#2670
#2671
#2677
#268
#2683
#2685
#2687
#2688
#269
#2695
#2698
#2699
#27
#270
#2703
#2704
#2705
#2705
#2706
#2709
#271
#2711
#2712
#2713
#2714
#2718
#2725
#2726
#2727
#273
#2732
#2738
#2741
#2742
#2743
#2744
#2745
#2748
#2748
#2749
#2749
#275
#2750
#2753
#2754
#2756
#2757
#2757
#2758
#2759
#276
#2761
#2763
#2764
#2766
#2769
#2769
#277
#2771
#2773
#2774
#2775
#2776
#2779
#278
#2780
#2781
#2782
#2783
#2784
#2786
#2791
#2792
#2795
#2796
#2799
#28
#2803
#2804
#2805
#2806
#2807
#2808
#2810
#2814
#2815
#282
#2822
#2823
#2824
#2825
#2826
#2828
#2829
#2831
#2832
#2832
#2833
#2834
#2836
#2839
#2843
#2844
#2847
#2849
#2850
#2851
#2854
#286
#2862
#2863
#2866
#287
#2875
#2877
#2881
#2883
#2884
#2888
#2889
#289
#2891
#2896
#29
#290
#2905
#2907
#2909
#291
#2916
#2916
#2919
#2922
#293
#2932
#2939
#2940
#2941
#2943
#2944
#2948
#2950
#2953
#296
#2962
#2963
#2964
#297
#2970
#2971
#2972
#2972
#2975
#298
#2981
#2987
#2988
#2989
#299
#2990
#2995
#2999
#3
#30
#300
#3005
#3007
#3008
#3009
#3009
#301
#3010
#3013
#3015
#3017
#3018
#3019
#302
#3020
#3021
#3022
#3023
#303
#3030
#3031
#3033
#3034
#3035
#3036
#3037
#3039
#304
#3040
#3041
#3042
#3046
#3047
#3048
#3049
#305
#3051
#3052
#306
#3060
#3064
#3066
#307
#3072
#3074
#3078
#3082
#3083
#3085
#309
#3092
#3095
#3096
#3097
#3098
#310
#3101
#3102
#3109
#311
#3110
#3110
#3111
#3112
#3115
#3116
#3119
#312
#3120
#3127
#3129
#313
#3133
#3135
#3136
#3137
#3138
#314
#3140
#3141
#3142
#3147
#3148
#3149
#315
#3152
#3157
#3159
#316
#3162
#3162
#3164
#3165
#3165
#3166
#3169
#317
#3170
#3179
#318
#3180
#3183
#3184
#3185
#3186
#3187
#3188
#3189
#3190
#3191
#3193
#3194
#3198
#3199
#32
#320
#3200
#3201
#3203
#3204
#3205
#321
#3212
#3216
#3218
#3219
#322
#323
#3236
#3237
#3243
#3245
#3245
#3256
#3265
#3266
#3266
#3269
#3270
#3275
#3276
#3277
#3278
#3282
#3289
#3290
#3294
#3295
#3298
#33
#330
#3300
#3306
#3311
#3315
#3316
#3323
#3324
#3325
#3327
#333
#334
#3343
#3344
#3345
#3346
#3347
#3348
#335
#3354
#3354
#336
#3362
#3368
#3369
#337
#3370
#3371
#3372
#338
#3380
#3388
#3388
#3389
#3390
#3397
#3398
#3399
#34
#340
#3400
#3401
#3407
#3409
#341
#3413
#3415
#3417
#3417
#342
#3420
#3421
#3422
#3424
#3425
#3426
#3427
#3427
#3428
#343
#3432
#3433
#3434
#3435
#3436
#344
#3440
#3441
#3443
#3449
#345
#3451
#3457
#346
#3462
#3469
#347
#3470
#3473
#348
#3482
#3484
#3486
#349
#3494
#3497
#3498
#35
#350
#3501
#3504
#3505
#3509
#351
#3514
#3514
#3519
#3519
#352
#3520
#3522
#3523
#3526
#3527
#353
#3532
#3533
#3534
#3537
#354
#3545
#3545
#3547
#355
#3551
#3551
#3553
#3555
#3555
#3556
#3559
#356
#3563
#3565
#3569
#357
#3571
#3572
#3573
#3575
#3576
#3577
#3578
#3579
#358
#3580
#3585
#3586
#3587
#359
#3592
#3595
#3596
#3597
#36
#360
#3600
#3602
#3608
#3609
#361
#3611
#3616
#3617
#3618
#362
#3621
#3622
#3629
#363
#3630
#3633
#3636
#3637
#3638
#3639
#364
#3640
#3641
#3642
#3643
#365
#3651
#3656
#366
#3663
#3664
#3667
#3668
#367
#3670
#3675
#368
#3682
#3683
#3684
#3685
#3687
#3689
#369
#3694
#3695
#3696
#3696
#3697
#3698
#37
#370
#3700
#3702
#3703
#3704
#3705
#3706
#3707
#3708
#3709
#371
#3713
#3714
#3716
#372
#3720
#3726
#3727
#3727
#3728
#3730
#3731
#3736
#3739
#374
#3740
#3740
#3741
#3745
#3747
#3748
#3749
#375
#3754
#3755
#3756
#3759
#3759
#376
#3761
#3761
#3763
#3765
#3768
#377
#3773
#3774
#3774
#3778
#378
#3782
#3783
#3784
#3786
#3787
#3788
#3789
#3790
#3792
#3793
#3796
#3797
#3798
#3799
#38
#380
#3800
#3801
#3802
#3805
#3806
#381
#3817
#3819
#382
#3821
#3825
#3829
#383
#3831
#3832
#3833
#3834
#3838
#384
#3842
#3843
#3844
#3846
#3847
#3848
#3849
#385
#3850
#3852
#3854
#3861
#3865
#387
#3879
#388
#3881
#3882
#3883
#3884
#3885
#3886
#389
#3892
#3893
#3894
#3899
#39
#390
#3902
#3903
#3907
#391
#3912
#3913
#3914
#3915
#3917
#3918
#3919
#392
#3920
#3921
#3923
#3927
#3928
#393
#3930
#3931
#3933
#3936
#3939
#394
#3940
#3943
#395
#3950
#3951
#3952
#3953
#3954
#3955
#3956
#3957
#3957
#3962
#3971
#3972
#3972
#3973
#3973
#3974
#3975
#3976
#398
#3981
#3984
#3991
#3994
#3996
#3997
#40
#400
#4006
#4007
#4008
#4009
#401
#4010
#4011
#4015
#4019
#402
#4020
#4022
#4025
#4026
#4028
#403
#4030
#4031
#4033
#404
#4040
#4041
#4043
#4044
#4048
#4049
#405
#4051
#4053
#4057
#4061
#4062
#4069
#4070
#4071
#4071
#4077
#4077
#4078
#4079
#408
#4084
#4085
#4087
#4087
#4088
#4088
#4089
#409
#4090
#41
#410
#4101
#4102
#4106
#4107
#411
#4110
#4111
#4114
#4115
#4117
#4118
#4119
#4120
#4126
#4127
#4128
#413
#4130
#4131
#4137
#4138
#4139
#414
#4140
#4141
#4144
#4146
#4147
#415
#4150
#4152
#4157
#416
#4160
#4161
#4162
#4163
#4167
#417
#4171
#4172
#4173
#4174
#418
#4184
#4185
#4186
#419
#4192
#4193
#4197
#4198
#4199
#42
#420
#4200
#4201
#4202
#4203
#4204
#4205
#4206
#4207
#4209
#421
#4210
#4211
#4213
#4214
#4215
#4216
#4216
#422
#4223
#4224
#4228
#4228
#423
#4230
#4232
#4235
#4236
#4238
#424
#4240
#4241
#4242
#4243
#4244
#4251
#4252
#4258
#4259
#4262
#4263
#4265
#4266
#4267
#4267
#4268
#4269
#427
#4270
#4277
#4278
#4279
#4280
#4282
#4284
#4286
#4288
#4289
#429
#4291
#4297
#43
#4300
#4300
#4303
#4308
#4310
#4312
#4313
#4316
#4317
#4317
#4318
#4319
#4320
#4321
#4322
#4323
#4323
#4324
#4325
#4326
#4327
#4328
#4329
#4329
#433
#4331
#4336
#4337
#4338
#4339
#4340
#4343
#4347
#4348
#4349
#4351
#4351
#4353
#4357
#4358
#436
#4360
#4361
#4362
#4363
#4364
#4366
#4368
#4369
#437
#4373
#4374
#4375
#4378
#4383
#4383
#4384
#4388
#4389
#439
#4390
#4391
#4396
#4398
#4399
#44
#440
#4401
#4404
#4405
#4407
#4408
#441
#4411
#4412
#4413
#4416
#4418
#4419
#442
#4420
#4424
#4425
#4427
#4430
#4431
#4432
#4434
#4436
#4438
#4439
#4444
#4445
#4446
#4449
#4450
#4451
#4451
#4452
#4454
#4456
#4457
#4458
#446
#4461
#4466
#4467
#4468
#4480
#4481
#4483
#4484
#4485
#4486
#4487
#449
#4493
#4493
#4494
#4496
#4499
#45
#450
#4500
#4501
#4502
#4508
#451
#4512
#4516
#4517
#4518
#4519
#4520
#4521
#4522
#4524
#4525
#453
#4530
#4531
#4536
#4537
#4538
#4539
#4540
#4541
#4542
#4543
#4547
#4549
#4549
#455
#4556
#4557
#4558
#456
#4563
#4566
#4568
#4569
#4570
#4573
#4577
#4577
#4578
#458
#4583
#4584
#4585
#4586
#4587
#4588
#4590
#4591
#4592
#4594
#4596
#4598
#460
#4601
#4603
#4604
#4605
#4606
#4607
#4608
#4609
#4610
#4611
#4612
#4613
#4615
#4617
#4619
#462
#4620
#4624
#4625
#4626
#463
#4631
#4632
#4633
#4634
#4635
#4636
#4637
#4639
#464
#4640
#4641
#4642
#4643
#4647
#4650
#4651
#4652
#4653
#4654
#4656
#4657
#4659
#4660
#4663
#4664
#4665
#4665
#4666
#4668
#4670
#4673
#4675
#468
#4681
#4683
#4685
#4688
#469
#4690
#4692
#4693
#4694
#4695
#4697
#4699
#47
#470
#4702
#4705
#4706
#4706
#4707
#4709
#4711
#4711
#4712
#4713
#4714
#4721
#4722
#4724
#4727
#4728
#4732
#4733
#4734
#4735
#4735
#4739
#4740
#4746
#4747
#4748
#4749
#475
#4750
#4750
#4752
#4755
#476
#4766
#4767
#4769
#4769
#4770
#4771
#4771
#4773
#4778
#4779
#4780
#4782
#4783
#4787
#4789
#4790
#4792
#4796
#4797
#4798
#4799
#48
#4800
#4803
#4804
#4805
#4806
#4809
#481
#4812
#4814
#4816
#4817
#4818
#4819
#482
#4822
#4823
#4824
#4826
#4828
#4830
#4831
#4832
#4833
#4835
#4836
#4837
#4838
#484
#4842
#4843
#4844
#4847
#4847
#4848
#4849
#4849
#4850
#4854
#4858
#4859
#4861
#4862
#4865
#4868
#4878
#4882
#4883
#4887
#4895
#4896
#4897
#4898
#49
#4902
#4906
#4912
#4913
#4915
#4916
#4918
#4919
#4920
#4924
#4926
#4927
#4928
#4929
#4934
#4935
#4936
#4937
#4937
#4938
#4939
#494
#4940
#4942
#4946
#4947
#4947
#4949
#495
#4950
#4951
#4952
#4955
#4957
#4958
#496
#4960
#4961
#4961
#4962
#4963
#4964
#4965
#4966
#497
#4974
#4975
#4979
#4980
#4981
#4982
#4983
#4985
#4986
#4986
#4988
#499
#4991
#4992
#4995
#4996
#4999
#5
#50
#500
#5000
#5001
#5002
#5004
#5007
#5008
#501
#5010
#5011
#5013
#5014
#5015
#5015
#5016
#5018
#5021
#5025
#5026
#5028
#5029
#503
#5034
#5035
#5036
#5037
#5038
#5039
#5040
#5042
#5043
#5045
#5048
#5051
#5053
#5056
#5060
#5061
#5065
#5072
#5073
#5074
#5075
#5077
#508
#5082
#5082
#5083
#5084
#5085
#5086
#5088
#5089
#5090
#5094
#5095
#5096
#5099
#51
#5101
#5103
#5104
#5105
#5106
#5107
#5108
#5110
#5111
#5112
#5113
#5115
#5117
#5118
#5119
#512
#5120
#5120
#5121
#5122
#5125
#5126
#5126
#5127
#5128
#5129
#513
#5130
#5131
#5133
#5134
#5135
#5137
#5137
#5138
#5139
#514
#5141
#5141
#5142
#5144
#5147
#5148
#5149
#515
#5150
#5154
#5156
#5157
#5159
#516
#5160
#5161
#5162
#5163
#5164
#5165
#5167
#5168
#5169
#517
#5170
#5172
#5176
#5181
#5182
#5183
#5184
#5185
#5187
#5191
#5193
#5194
#5196
#5197
#52
#5204
#5206
#5208
#5211
#5215
#5216
#5217
#5219
#5220
#5224
#5224
#5225
#5226
#5229
#523
#5230
#5233
#5234
#5235
#5237
#5237
#5238
#5239
#524
#5240
#5243
#5244
#5245
#5245
#5249
#525
#5252
#5252
#5253
#5254
#5255
#5256
#5257
#5258
#5258
#5259
#526
#5260
#5263
#5264
#5268
#5269
#527
#5270
#5271
#5272
#5275
#528
#5281
#5286
#5287
#5287
#5289
#529
#5291
#5292
#5293
#5296
#5297
#5298
#5299
#53
#5300
#5301
#5303
#5306
#531
#5314
#5317
#5318
#532
#5320
#5322
#5323
#5324
#5325
#5325
#5328
#5329
#5330
#5333
#5336
#5338
#534
#5342
#5343
#5345
#5346
#5350
#5351
#5352
#5353
#5354
#5355
#5358
#5359
#5360
#5361
#5363
#5364
#5366
#5366
#5368
#5369
#5370
#5372
#5373
#5375
#5376
#538
#5382
#5382
#5385
#5386
#5387
#5389
#539
#5390
#5391
#5395
#5396
#54
#540
#5401
#5402
#5403
#5406
#5408
#5409
#5411
#5412
#5413
#5414
#5415
#542
#5420
#5423
#5423
#5424
#5424
#5425
#5427
#5428
#543
#5434
#5436
#544
#5445
#5445
#545
#5453
#5454
#5455
#5456
#5457
#5458
#5459
#546
#5461
#5462
#5463
#5464
#5465
#5466
#5467
#5468
#5473
#5475
#5477
#548
#5481
#5483
#5483
#5490
#5491
#5493
#55
#5500
#5501
#5504
#5505
#5505
#5506
#551
#5516
#5518
#5518
#5519
#552
#5522
#5525
#5526
#5528
#5529
#553
#5530
#5531
#5532
#5533
#5540
#5546
#5547
#5549
#5552
#5555
#5557
#5559
#556
#5562
#5565
#5566
#5567
#5569
#557
#5571
#5572
#5574
#5576
#5577
#5578
#558
#5581
#5584
#5586
#5586
#5588
#559
#5590
#5591
#5594
#5596
#5598
#56
#560
#5600
#5601
#5601
#5604
#5605
#5606
#5608
#5609
#561
#5610
#5611
#5612
#5613
#5614
#5614
#5621
#5622
#5624
#5625
#5625
#5626
#5628
#5629
#563
#5632
#5633
#564
#5643
#565
#5650
#5651
#5652
#5654
#5658
#566
#5664
#5666
#5668
#5669
#567
#5670
#5672
#5673
#5675
#5676
#5680
#5681
#5683
#5684
#5686
#5687
#5688
#569
#5691
#5694
#5697
#5699
#57
#570
#5700
#5702
#5703
#5705
#5707
#571
#5711
#5712
#5713
#5714
#5715
#572
#5720
#5722
#5725
#5727
#5728
#5730
#5755
#5756
#5757
#5759
#576
#5761
#5763
#5763
#5764
#5765
#5767
#5769
#577
#5771
#5773
#5774
#5775
#5777
#578
#5780
#5781
#5782
#5783
#5785
#5786
#5789
#5790
#5791
#5796
#5797
#5798
#58
#5800
#5802
#5804
#5804
#5806
#5807
#5811
#5815
#5816
#5817
#5820
#5821
#5823
#5824
#5825
#5826
#5827
#5839
#584
#5840
#5845
#5846
#585
#5852
#586
#5868
#587
#5877
#5878
#5879
#5879
#588
#5881
#5901
#5902
#591
#5917
#592
#5921
#5929
#593
#5936
#5937
#594
#595
#596
#597
#5982
#6
#60
#6002
#601
#6011
#602
#6028
#604
#606
#608
#6093
#6094
#6094
#623
#630
#631
#632
#6360
#6364
#637
#6378
#638
#6382
#6386
#6387
#6387
#6388
#6390
#6392
#6393
#6394
#6395
#6397
#6398
#640
#6402
#6403
#641
#6410
#642
#644
#6443
#6445
#6446
#6447
#6449
#645
#6450
#6452
#6453
#6455
#6456
#6458
#6459
#646
#6462
#6462
#6472
#6478
#6478
#6484
#6485
#6487
#6488
#6489
#649
#6490
#6491
#6493
#6494
#6495
#6496
#6498
#6500
#6502
#6504
#6508
#651
#6517
#652
#6520
#6527
#6528
#6530
#6531
#6531
#6532
#6541
#6543
#6544
#6546
#6547
#6550
#6551
#6553
#6553
#6554
#6554
#6557
#656
#6560
#6562
#6564
#6570
#6573
#6574
#6575
#6577
#6578
#6579
#6580
#6583
#6584
#6586
#6587
#6588
#659
#6590
#6592
#6597
#660
#6601
#6602
#6603
#6604
#6606
#6607
#6609
#661
#6610
#6611
#6613
#6614
#6615
#6621
#6622
#6623
#6626
#6626
#6627
#6627
#6628
#6630
#6631
#6632
#6633
#664
#6641
#6641
#6645
#6646
#6648
#6649
#6649
#6650
#6652
#6655
#6655
#6658
#6658
#6661
#6662
#6663
#6665
#6668
#6669
#667
#6670
#6674
#6674
#6675
#6675
#6677
#6681
#6682
#6686
#6686
#6688
#669
#6693
#6694
#6694
#6696
#6697
#6698
#6698
#67
#670
#6706
#6710
#6711
#6711
#6717
#6717
#672
#6721
#6722
#676
#677
#678
#680
#681
#682
#683
#687
#689
#69
#692
#695
#696
#699
#7
#70
#701
#708
#709
#71
#711
#712
#714
#719
#72
#720
#723
#727
#728
#732
#734
#735
#737
#740
#741
#742
#746
#747
#749
#75
#751
#752
#755
#760
#761
#762
#763
#764
#765
#766
#767
#77
#772
#773
#775
#779
#78
#786
#79
#791
#796
#798
#799
#801
#802
#804
#809
#812
#817
#819
#820
#822
#824
#825
#827
#83
#832
#833
#834
#835
#836
#839
#843
#844
#847
#848
#849
#851
#854
#855
#856
#857
#858
#861
#862
#865
#867
#868
#870
#871
#873
#878
#880
#881
#882
#884
#888
#890
#891
#892
#893
#895
#896
#898
#9
#901
#902
#903
#905
#909
#910
#911
#913
#915
#916
#917
#918
#919
#92
#920
#921
#922
#923
#926
#93
#933
#934
#941
#945
#954
#955
#958
#959
#96
#960
#963
#964
#965
#968
#970
#971
#972
#976
#977
#978
#979
#980
#981
#983
#984
#985
#986
#990
#993
#994
#995
#996
#997
#999
grad-norm-test
v0.1.0
v0.10.0
v0.10.1
v0.10.2
v0.10.3
v0.11.0
v0.11.1
v0.11.2
v0.12.0
v0.12.1
v0.12.2
v0.12.3
v0.12.4
v0.12.5
v0.12.6
v0.13.0
v0.13.1
v0.13.2
v0.13.3
v0.13.4
v0.13.5
v0.14.0
v0.14.1
v0.14.2
v0.14.3
v0.14.4
v0.14.5
v0.15.0
v0.15.1
v0.15.2
v0.15.3
v0.2.0
v0.3.0
v0.3.1
v0.3.10
v0.3.11
v0.3.12
v0.3.13
v0.3.14
v0.3.15
v0.3.16
v0.3.2
v0.3.3
v0.3.4
v0.3.5
v0.3.6
v0.3.7
v0.3.8
v0.3.9
v0.4.0
v0.4.1
v0.4.2
v0.4.3
v0.4.4
v0.4.5
v0.5.0
v0.5.1
v0.5.10
v0.5.2
v0.5.3
v0.5.4
v0.5.5
v0.5.6
v0.5.7
v0.5.8
v0.5.9
v0.6.0
v0.6.1
v0.6.2
v0.6.3
v0.6.4
v0.6.5
v0.6.6
v0.6.7
v0.7.0
v0.7.1
v0.7.2
v0.7.3
v0.7.4
v0.7.5
v0.7.6
v0.7.7
v0.8.0
v0.8.1
v0.8.2
v0.8.3
v0.9.0
v0.9.1
v0.9.2
v0.9.3
v0.9.4
v0.9.5
-
2eb945953bMerge
ed91abcf21intoa1b0c35a1dinkcherry
2024-11-07 13:54:37 +0800 -
b4c7fde0dfMerge
e7e5cdf386intoa1b0c35a1d2024-11-07 13:54:17 +0800 -
0bbe4271cfMerge
5d02982fc5intoa1b0c35a1dXuehai Pan
2024-11-07 13:02:57 +0800 -
f03d848849Merge
bf8054c42cintoa1b0c35a1dOlatunji Ruwase
2024-11-06 20:50:25 -0800 -
20792286afMerge
d2b98b034cintoa1b0c35a1dXu Song
2024-11-07 12:48:17 +0800 -
7e1c4c639eMerge
5d2e0c26a7intoa1b0c35a1dstephen zhu
2024-11-07 12:42:43 +0800 -
dbe2019123Merge
155fcc9979intoa1b0c35a1dLogan Adams
2024-11-06 20:38:24 -0800 -
155fcc9979Merge branch 'master' into loadams/update-ubuntu24.04 loadams/update-ubuntu24.04
2024-11-06 20:38:21 -0800 -
43cbb7ae25Merge
54d9f1fe17intoa1b0c35a1dNadav Elyahu
2024-11-06 20:38:08 -0800 -
54d9f1fe17Merge branch 'master' into compile_collectives
2024-11-06 20:38:06 -0800 -
a1b0c35a1dSwitch what versions of python are supported (#5676) master
2024-11-06 20:37:52 -0800 -
e7e5cdf386
Merge branch 'z3_coalesced_fetch' of https://github.com/inkcherry/DeepSpeed into z3_coalesced_fetch
2024-11-07 12:21:31 +0800 -
a6e5a399d6
update
2024-11-07 04:10:23 +0000 -
3c0a18303dMerge branch 'master' into z3_coalesced_fetch
2024-11-07 10:59:15 +0800 -
619cbe6879
always print info if the config is enabled
2024-11-07 02:57:34 +0000 -
d10e0978e4Merge
d8fd142ec9into3beda32e94Xinyu Lian
2024-11-07 10:39:22 +0800 -
d2b98b034c
rename lazy_mege to lazy_mode; fix Trailing Whitespace
2024-11-07 10:33:14 +0800 -
72d7b61df1Merge
ecfba271e1into3beda32e942024-11-06 15:38:19 -0800 -
d0eb766c8aMerge
885283a5aainto3beda32e942024-11-06 15:38:18 -0800 -
20811c8eefMerge
6f5b51f003into3beda32e94ranzhejiang
2024-11-06 23:38:17 +0000 -
149a909633Merge
f123691732into3beda32e942024-11-06 15:38:17 -0800 -
6f5b51f003Merge branch 'master' into zhejiang/fix_runtime_dataloader_shuffle
2024-11-06 15:38:14 -0800 -
bc0a2fec21Merge
58bc018bebinto3beda32e94Joe Mayer
2024-11-06 15:27:45 -0800 -
ca60c5ef29Merge branch 'master' into loadams/update-ubuntu24.04
2024-11-06 15:18:18 -0800 -
326e975195Merge branch 'master' into loadams/switch-python-versions
2024-11-06 15:17:59 -0800 -
3beda32e94Update flake8 version (#6722)
2024-11-06 15:17:48 -0800 -
058f8a2670Update docker/gh-builder/Dockerfile.py312
2024-11-06 13:53:11 -0800 -
16bbccd125
Fix EOF
Logan Adams
2024-11-06 13:40:31 -0800 -
67fb8feefd
Refactor docker folder
2024-11-06 13:33:18 -0800 -
6979649466
Update dockerfile with python version 3.11
2024-11-06 13:31:22 -0800 -
766ef82c3aMerge
9e811b8da7intod2a4718946Jinghan Yao
2024-11-06 16:29:36 -0500 -
c666d39593
Update Ubuntu version
2024-11-06 13:22:22 -0800 -
5614327e28Merge branch 'master' into loadams/switch-python-versions
2024-11-06 13:21:36 -0800 -
9352f15951Merge branch 'master' into zhejiang/fix_runtime_dataloader_shuffle
2024-11-06 13:20:05 -0800 -
4d38dc56c1Merge
45e46816b7intod2a4718946richardodliu
2024-11-06 21:46:09 +0100 -
6e70bd0930Merge
e2be709422intod2a47189462024-11-06 12:43:07 -0800 -
b8c9a5e474Merge branch 'master' into patch-4
2024-11-06 12:40:03 -0800 -
1be09b70a9Merge branch 'master' into loadams/update-ubuntu24.04
2024-11-06 12:37:12 -0800 -
10fec67c20Merge
7f4d8c5047intod2a4718946YiSheng5
2024-11-07 04:35:27 +0800 -
a91f78ad7aMerge branch 'master' into compile_collectives
2024-11-06 12:32:18 -0800 -
704271b3a7Merge branch 'master' into loadams/update-flake8-version
2024-11-06 12:25:28 -0800 -
8334ec084e
Merge branch 'loadams/update-flake8-version' into loadams/update-ubuntu24.04
2024-11-06 11:11:51 -0800 -
2c5740a03e
Revert "Update for failing test"
2024-11-06 11:05:31 -0800 -
b8287fa6d5
Update pre-commit version of flake8
2024-11-06 11:03:58 -0800 -
d2a4718946Update yapf version (#6721)
2024-11-06 10:57:12 -0800 -
2f5c51e1f8Merge branch 'master' into loadams/switch-python-versions
2024-11-06 10:36:06 -0800 -
58bc018bebMerge branch 'master' into jomayeri/aio-file-offset jomayeri/aio-file-offset
2024-11-06 09:49:32 -0800 -
9e811b8da7
add cron for test and reporting for nightly CI failures
Masahiro Tanaka
2024-11-06 17:42:36 +0000 -
f3f8b2717dMerge branch 'master' into patch-4
2024-11-06 09:40:46 -0800 -
de61c1d640
Update for failing test
2024-11-06 09:35:51 -0800 -
ebaf56c9f5
add unit test directory as test trigger
2024-11-06 17:34:51 +0000 -
98cf543af8
Actually update the flake8 version
2024-11-06 09:22:32 -0800 -
2d5e4ebfe0
Update flake8 version
2024-11-06 09:19:55 -0800 -
c5820b0c01
Merge branch 'loadams/update-yapf-version' into loadams/update-ubuntu24.04
2024-11-06 09:05:28 -0800 -
74a9ed9131
Formatting fix
2024-11-06 09:04:45 -0800 -
f93a3e8419
Update corresponding changes to yapf
2024-11-06 09:02:38 -0800 -
a3e6b27b5c
Update yapf version
2024-11-06 09:01:13 -0800 -
727129a1bc
Update setuptools and yapf version
2024-11-06 09:00:28 -0800 -
af24777af1Merge branch 'master' into master
Masahiro Tanaka
2024-11-06 08:45:45 -0800 -
a623b61cb5Merge
f6641078f5into351569dd4a2024-11-06 20:26:30 +0800 -
c31c8d218a
format
2024-11-06 18:36:59 +0800 -
73e5bd54ae
fix merge
2024-11-06 10:36:07 +0000 -
40ceeac45c
fix rjust size
2024-11-06 10:27:41 +0000 -
c31ad0233f
change config name, refine doc
2024-11-06 10:13:38 +0000 -
ad614c5b65Merge
67ce7444ddinto351569dd4amelvin
2024-11-06 10:03:54 +0100 -
f77325802b
udpate
2024-11-06 09:01:29 +0000 -
22c0f81c61
update ut
2024-11-06 08:28:28 +0000 -
5684be04a2
fix yapf formatting issue
2024-11-06 14:50:53 +0800 -
4d005b8aec
add comments
2024-11-06 14:35:46 +0800 -
e0f1d53f07
add unit test
2024-11-06 14:15:45 +0800 -
376a563dceMerge branch 'master' into zhejiang/fix_runtime_dataloader_shuffle
2024-11-05 16:41:54 -0800 -
17c608b0d1
Update GH hosted workflows to 24.04
2024-11-05 16:35:04 -0800 -
615dc47dbdMerge branch 'master' into compile_collectives
2024-11-05 16:32:09 -0800 -
a51340c463Merge
f45a7a9763into2b41d6212cgyou2021
2024-11-05 14:59:06 -0800 -
351569dd4aUse one param coordinator for both train/inference scenarios (#6662)
2024-11-05 14:53:01 -0800 -
2f5446a584Merge branch 'master' into jomayeri/aio-file-offset
2024-11-05 14:25:14 -0800 -
5d2e0c26a7Merge branch 'master' into master
2024-11-05 14:12:30 -0800 -
e48e85baea
add flash-attn version check
Jinghan Yao
2024-11-05 16:11:08 -0500 -
bd090c84a0
add condition for using fpdt offloading
2024-11-05 16:00:10 -0500 -
5b8c419f63
add condition for using fpdt offloading
2024-11-05 15:59:20 -0500 -
f570213ccd
modify unit test for fpdt
2024-11-05 15:49:42 -0500 -
02c2fbf6a5
modify unit test for fpdt
2024-11-05 15:42:00 -0500 -
8f5d039721
modify unit test for fpdt
2024-11-05 15:36:42 -0500 -
907c79d055
modify unit test for fpdt
2024-11-05 15:32:04 -0500 -
d637d604cc
modify unit test for fpdt
2024-11-05 15:24:57 -0500 -
42461d27a1
modify unit test for fpdt
2024-11-05 15:21:29 -0500 -
67aa3dfbfd
modify unit test for fpdt
2024-11-05 15:13:02 -0500 -
b1b2688073
modify unit test for fpdt
2024-11-05 15:11:36 -0500 -
2ae68dc1f8
modify unit test for fpdt
2024-11-05 15:08:34 -0500 -
3eb816dbb5
modify unit test for fpdt
2024-11-05 15:01:24 -0500 -
164f459ec5
modify unit test for fpdt
2024-11-05 14:58:42 -0500 -
057812224aMerge
9fba8e1e76into2b41d6212c2024-11-05 11:49:34 -0800 -
56cb64761f
fix pip command
2024-11-05 19:33:51 +0000 -
5f859be985
remove flash-attn requirements from setup.py
2024-11-05 19:31:38 +0000 -
7389f66357
remove requirements file for flash-attn
2024-11-05 19:28:49 +0000 -
464d117fe9
remove --no-build-isolation
2024-11-05 19:23:14 +0000 -
edd2e0514e
update image version
2024-11-05 19:22:18 +0000 -
893552945f
update workflow
2024-11-05 18:49:02 +0000 -
0d2b624733Merge pull request #1 from YJHMITWEB/tohtana/merge_FPDT
2024-11-05 10:08:19 -0800 -
ac7baf6768
revert world sizes for tests
2024-11-05 18:07:30 +0000