CNTK/README.md

94 строки
7.0 KiB
Markdown
Исходник Обычный вид История

2016-10-25 18:49:39 +03:00
# Latest news
2016-11-22 04:38:19 +03:00
*2016-11-21.* V 2.0 Beta 4 Release
Highlights of this Release:
* New ASGD/Hogwild! training using Microsofts Parameter Server ([Project Multiverso](https://github.com/Microsoft/multiverso))
* Distributed Scenarios now supported in CNTK Python API
2016-11-22 23:07:36 +03:00
* New [Memory Compression](https://github.com/Microsoft/CNTK/wiki/Top-level-configurations#hypercompressmemory) mode to reduce memory usage on GPU
2016-11-22 04:38:19 +03:00
* CNTK Docker image with 1bit-SGD support
* Stability Improvements and bug fixes
See more in the [Release Notes](https://github.com/Microsoft/CNTK/wiki/CNTK_2_0_beta_4_Release_Notes)
Get the Release from the [CNTK Releases page](https://github.com/Microsoft/CNTK/releases)
2016-11-11 16:46:42 +03:00
*2016-11-11.* V 2.0 Beta 3 Release
Highlights of this Release:
2016-11-11 18:56:05 +03:00
* Integration with [NVIDIA NCCL](https://github.com/NVIDIA/nccl). Works with Linux when building CNTK from sources. See here [how to enable](https://github.com/Microsoft/CNTK/wiki/Setup-CNTK-on-Linux#optional-nccl)
2016-11-11 16:46:42 +03:00
* The first V.2.0 Prerelease Nuget Package for CNTK Evaluation library
* Stability Improvements and bug fixes
See more in the [Release Notes](https://github.com/Microsoft/CNTK/wiki/CNTK_2_0_beta_3_Release_Notes)
Get the Release from the [CNTK Releases page](https://github.com/Microsoft/CNTK/releases)
2016-11-03 23:34:21 +03:00
*2016-11-03.* V 2.0 Beta 2 Release
Highlights of this Release:
* Feature tuning and bug fixing based on the feedback on Beta 1
* Changes in the Examples and Tutorials based on the same feedback
2016-11-11 16:46:42 +03:00
* New [Tutorial on Reinforcement Learning](https://github.com/Microsoft/CNTK/blob/v2.0.beta2.0/bindings/python/tutorials/CNTK_203_Reinforcement_Learning_Basics.ipynb)
2016-11-03 23:34:21 +03:00
See more in the [Release Notes](https://github.com/Microsoft/CNTK/wiki/CNTK_2_0_beta_2_Release_Notes)
Get the Release from the [CNTK Releases page](https://github.com/Microsoft/CNTK/releases)
2016-10-26 18:36:19 +03:00
*2016-10-25.* New CNTK Name, new Web Site and V 2.0 Beta 1 Release
2016-10-25 18:44:02 +03:00
CNTK becomes **The Microsoft Cognitive Toolkit**. See more at our [new Web Site](https://www.microsoft.com/en-us/research/product/cognitive-toolkit/).
2016-10-26 18:36:19 +03:00
With the today's Release we start delivering CNTK V2 - a major upgrade of Microsoft Cognitive Toolkit.
Expect a set of Beta Releases in the Coming Weeks.
2016-10-25 18:44:02 +03:00
Highlights of this Release:
* CNTK can now be used as a library with [brand new C++ and Python APIs](https://github.com/microsoft/cntk/wiki/CNTK-Library-API)
* New Python Examples and Tutorials
2016-10-26 18:36:19 +03:00
* Support of Protocol Buffers serialization
2016-10-25 18:44:02 +03:00
* Support of Fast R-CNN algorithm
2016-10-26 18:36:19 +03:00
* New automated installation procedures
2016-10-25 18:44:02 +03:00
* Improvements in CNTK Evaluation library including support of CNTK APIs
See more in the [Release Notes](https://github.com/Microsoft/CNTK/wiki/CNTK_2_0_beta_1_Release_Notes). You will find there links to the materials about the new features.
2016-10-26 18:36:19 +03:00
Get the Release from the [CNTK Releases page](https://github.com/Microsoft/CNTK/releases)
2016-10-25 18:44:02 +03:00
2016-10-26 18:36:19 +03:00
*2016-10-03.* V 1.7.2 Binary release
2016-10-03 23:07:20 +03:00
**This is a Hot Fix Release. It affects all users of Model Evaluation Library**
If you are NOT using Model Evaluation Library you may skip this release.
If you ARE using Model Evaluation Library we **strongly recommend** installing version 1.7.2 instead of **any** previous version you might be using.
See [Release Notes](https://github.com/Microsoft/CNTk/wiki/CNTK_1_7_2_Release_Notes) for details.
2016-02-22 13:47:14 +03:00
See [all news](https://github.com/Microsoft/CNTK/wiki/News).
2016-10-25 18:49:39 +03:00
# What is CNTK
2016-01-29 22:27:17 +03:00
CNTK (http://www.cntk.ai/), the Computational Network Toolkit by Microsoft Research, is a unified deep-learning toolkit that describes neural networks as a series of computational steps via a directed graph. In this directed graph, leaf nodes represent input values or network parameters, while other nodes represent matrix operations upon their inputs. CNTK allows to easily realize and combine popular model types such as feed-forward DNNs, convolutional nets (CNNs), and recurrent networks (RNNs/LSTMs). It implements stochastic gradient descent (SGD, error backpropagation) learning with automatic differentiation and parallelization across multiple GPUs and servers. CNTK has been available under an open-source license since April 2015. It is our hope that the community will take advantage of CNTK to share ideas more quickly through the exchange of open source working code.
Wiki: Go to the [CNTK Wiki](https://github.com/Microsoft/CNTK/wiki) for all information on CNTK including [setup](https://github.com/Microsoft/CNTK/wiki/Setup-CNTK-on-your-machine ), [examples](https://github.com/Microsoft/CNTK/wiki/Examples ), etc.
2016-01-20 11:59:19 +03:00
2016-01-20 12:34:03 +03:00
License: See [LICENSE.md](./LICENSE.md) in the root of this repository for the full license information.
2016-01-20 11:59:19 +03:00
Tutorial: [Microsoft Computational Network Toolkit (CNTK) @ NIPS 2015 Workshops](http://research.microsoft.com/en-us/um/people/dongyu/CNTK-Tutorial-NIPS2015.pdf)
2016-01-20 12:42:17 +03:00
Blogs:
* [Microsoft Computational Network Toolkit offers most efficient distributed deep learning computational performance](http://blogs.technet.com/b/inside_microsoft_research/archive/2015/12/07/microsoft-computational-network-toolkit-offers-most-efficient-distributed-deep-learning-computational-performance.aspx)
* [Microsoft researchers win ImageNet computer vision challenge (December 2015)](http://blogs.microsoft.com/next/2015/12/10/microsoft-researchers-win-imagenet-computer-vision-challenge/)
2016-01-20 11:59:19 +03:00
## Performance
The figure below compares processing speed (frames processed per second) of CNTK to that of four other well-known toolkits. The configuration uses a fully connected 4-layer neural network (see our benchmark [scripts](https://github.com/Alexey-Kamenev/Benchmarks)) and an effective mini batch size (8192). All results were obtained on the same hardware with the respective latest public software versions as of Dec 3, 2015.
2016-01-20 12:18:30 +03:00
![Performance chart](Documentation/Documents/PerformanceChart.png)
2016-01-20 11:59:19 +03:00
## Citation
If you used this toolkit or part of it to do your research, please cite the work as:
2016-01-26 07:53:43 +03:00
Amit Agarwal, Eldar Akchurin, Chris Basoglu, Guoguo Chen, Scott Cyphers, Jasha Droppo, Adam Eversole, Brian Guenter, Mark Hillebrand, T. Ryan Hoens, Xuedong Huang, Zhiheng Huang, Vladimir Ivanov, Alexey Kamenev, Philipp Kranen, Oleksii Kuchaiev, Wolfgang Manousek, Avner May, Bhaskar Mitra, Olivier Nano, Gaizka Navarro, Alexey Orlov, Hari Parthasarathi, Baolin Peng, Marko Radmilac, Alexey Reznichenko, Frank Seide, Michael L. Seltzer, Malcolm Slaney, Andreas Stolcke, Huaming Wang, Yongqiang Wang, Kaisheng Yao, Dong Yu, Yu Zhang, Geoffrey Zweig (in alphabetical order), ["An Introduction to Computational Networks and the Computational Network Toolkit"](http://research.microsoft.com/apps/pubs/?id=226641), Microsoft Technical Report MSR-TR-2014-112, 2014.
2016-01-20 11:59:19 +03:00
## Disclaimer
2016-01-25 21:43:45 +03:00
CNTK is in active use at Microsoft and constantly evolving. There will be bugs.
## Microsoft Open Source Code of Conduct
2016-10-25 18:44:02 +03:00
This project has adopted the [Microsoft Open Source Code of Conduct](https://opensource.microsoft.com/codeofconduct/). For more information see the [Code of Conduct FAQ](https://opensource.microsoft.com/codeofconduct/faq/) or contact [opencode@microsoft.com](mailto:opencode@microsoft.com) with any additional questions or comments.