DeepSpeed/tests
Arash Bakhtiari 834272531a
Add support of Microsoft Phi-2 model to DeepSpeed-FastGen (#4812)
This PR adds support for Microsoft Phi-2 model.

HF output with prompt "DeepSpeed is":
```
a company that helps make videos and movies look really good. They have a special way of making videos that makes them look like they were made in a movie theater. This is called "4K Ultra HD" and it makes the videos look very clear and detailed. DeepSpeed also has a special way of making videos that makes them look like they were made in a movie theater. This is called "4K Ultra HD" and it makes the videos look very clear and detailed. DeepSpeed also has a special way of making videos that makes them look like they were made in a movie theater. This is called "4K Ultra HD"
```

DeepSpeed-FastGen output with prompt "DeepSpeed is":
```
a company that helps make videos and movies look really good. They have a special way of making videos that makes them look like they were made in a movie theater. This is called "4K Ultra HD" and it makes the videos look very clear and detailed. DeepSpeed also has a special way of making videos that makes them look like they were made in a movie theater. This is called "4K Ultra HD" and it makes the videos look very clear and detailed. DeepSpeed also has a special way of making videos that makes them look like they were made in a movie theater. This is called "4K Ultra HD"
```

---------

Co-authored-by: Connor Holmes <connorholmes@microsoft.com>
Co-authored-by: Michael Wyatt <michaelwyatt@microsoft.com>
2024-01-03 13:27:06 -08:00
..
accelerator Update DeepSpeed copyright license to Apache 2.0 (#3111) 2023-03-30 17:14:38 -07:00
benchmarks Fix the openfold training. (#4657) 2023-11-09 02:04:12 +00:00
hybrid_engine DeepSpeed Chat (#3186) 2023-04-11 11:53:38 -07:00
lightning Update DeepSpeed copyright license to Apache 2.0 (#3111) 2023-03-30 17:14:38 -07:00
model Revert "Update megatron GPT2Model" 2023-04-05 15:12:01 -07:00
onebit Update DeepSpeed copyright license to Apache 2.0 (#3111) 2023-03-30 17:14:38 -07:00
perf Update DeepSpeed copyright license to Apache 2.0 (#3111) 2023-03-30 17:14:38 -07:00
small_model_debugging Guanhua/partial offload rebase v2 (#590) (#4636) 2023-11-06 14:15:16 -08:00
unit Add support of Microsoft Phi-2 model to DeepSpeed-FastGen (#4812) 2024-01-03 13:27:06 -08:00
.coveragerc Reduce Unit Test Times (Part 3) (#3850) 2023-07-12 00:35:49 +00:00
conftest.py Reduce Unit Test Times (Part 3) (#3850) 2023-07-12 00:35:49 +00:00
pytest.ini Add stable diffusion unit test (#2496) 2023-11-13 22:47:09 +00:00