Amit Agarwal
e875771784
Merge branch 'master' of https://github.com/Microsoft/CNTK into amitaga/cntkv2Library
...
Conflicts:
CNTK.sln
2016-06-12 09:14:03 -07:00
Amit
26c2006541
CNTKv2Library: Linux port
2016-06-11 16:50:26 -07:00
Eldar Akchurin
5d474c4d57
Renaming to HTKDeserializers
2016-06-06 15:23:39 +02:00
Eldar Akchurin
5d5d29ac6c
Fixing file type
2016-06-06 14:02:25 +02:00
Eldar Akchurin
3d5bfcab27
Fixing forgoten rename
2016-06-06 14:02:25 +02:00
Eldar Akchurin
290139c4d7
Renaming ExperimentalHTKMLFReader into HTKMLFDeserializer
2016-06-06 14:02:25 +02:00
Jasha Droppo
5558144363
Merge remote-tracking branch 'origin/master' into jdroppo/cudnn-rnn-lstm
...
Conflicts:
Source/Math/Math.vcxproj
Source/Math/Math.vcxproj.filters
Source/Math/MathCUDA.vcxproj.filters
2016-05-20 11:20:07 -07:00
Alexey Reznichenko
d3130e721a
Add a few improvements to CNTKTextFormatReader.
...
* Move caching into a stand-alone ChunkCache class.
Add a config flag 'keepDataInMemory' to cache the whole dataset.
* Allow both tabs and spaces as separators.
* Couple loading/indexing retries with file re-opening (if there was a
file error and the file handle is stale).
* Break 'randomize' config parameter into boolean 'randomize' and
integer 'randomizationWindow'.
* Add 'frameMode' config flag.
* Add an extra check and verify that the expected sequence length
(calculated during indexing) matches the actual length (maximum
number of samples in an input).
2016-05-18 15:50:04 +02:00
Qiwei Ye
6b47558bfa
Merge branch 'master' into qiwye/asgd-dev
...
Conflicts:
Source/SGDLib/SGD.cpp
Source/SGDLib/SGD.h
2016-05-09 12:15:34 +08:00
Amit Agarwal
f4204ce1cd
Change in dropout randomization implementation to ensure reproducability across checkpoints
2016-05-05 12:17:10 -07:00
Qiwei Ye
16e890ea75
Merge branch 'master' into qiwye/asgd-dev
...
Conflicts:
Source/SGDLib/SGD.cpp
Source/SGDLib/SGD.h
configure
2016-05-03 10:58:07 +08:00
Yongqiang Wang
29e464a96e
Merge branch 'master' of https://github.com/Microsoft/CNTK into erw/bm_rc
2016-05-02 11:57:31 -07:00
Yongqiang Wang
d87b1d4f3d
(Address CR feedback)
2016-05-02 11:51:25 -07:00
Yongqiang Wang
aadeb32304
Changes to enable Block Momentum release
...
(Adding an initial test case for Block Momentum)
2016-05-02 11:51:13 -07:00
Marko Radmilac
63c7fad4c8
Add support for gcov code coverage builds
2016-05-02 09:48:46 -07:00
Eldar Akchurin
4cca2126a1
Fixing wrong reference file
2016-05-02 09:55:11 +02:00
Eldar Akchurin
61f2cc120a
Adapting the makefile
2016-05-02 09:55:11 +02:00
Marko Radmilac
0b35c4646c
Add support for new CU
2016-04-28 12:06:34 -07:00
Qiwei Ye
679b55df50
Merge branch 'master' into qiwye/asgd-dev
...
Conflicts:
Source/ActionsLib/ActionsLib.vcxproj
Source/Readers/HTKMLFReader/utterancesourcemulti.h
Source/SGDLib/SGDLib.vcxproj
2016-04-28 13:56:19 +08:00
Alexey Reznichenko
0651892cc7
Do not create a new packer for each epoch
2016-04-22 11:33:31 +02:00
Qiwei Ye
9760990506
Merge branch 'master' into qiwye/asgd-dev
...
Conflicts:
Source/ActionsLib/ActionsLib.vcxproj
Source/CNTK/CNTK.cpp
Source/CNTK/CNTK.vcxproj
Source/SGDLib/SGD.cpp
Source/SGDLib/SGD.h
Source/SGDLib/SGDLib.vcxproj
Source/SGDLib/SGDLib.vcxproj.filters
Tools/generate_build_info
configure
2016-04-16 10:41:47 +08:00
Clemens Marschner
ca4afe5c67
Address review comments
2016-04-13 14:30:06 +02:00
Mark Hillebrand
d184028dbd
Address CR comment
2016-04-11 20:24:24 +01:00
Mark Hillebrand
2138dfc2f7
Makefile: Add Config.make to object dependencies
2016-04-11 09:19:45 +01:00
Alexey Reznichenko
14de27d114
Enable sequences for sparse input.
...
Extend sequence and frame packers to support sparse input.
Create a tightly filled layout and base packing off of it.
Add a number of unit test for sequence packing (both sparse and
dense, no randomization, using CNTK text format for input).
2016-04-07 14:34:42 +02:00
Frank Seide
e080d2c561
moved LearnableParameterNode implementation to a CPP file
2016-04-03 17:03:35 -07:00
Frank Seide
7784350f29
merged with master
2016-04-03 00:59:10 -07:00
Frank Seide
531f5538b6
updated seq-2-seq decoder to match updated training;
...
new operation Trace() (TraceNode) as a debugging aid;
WriteMinibatchWithFormatting() can now log by FrameRange;
WriteFormattingOptions now in ComputationNode.h
2016-04-02 23:29:40 -07:00
Eldar Akchurin
694a259991
Refactoring of bptt packer
2016-04-01 09:43:24 +02:00
Alexey Kamenev
0d23b5308d
Fixed merge issue in Makefile.
2016-03-30 10:00:49 -07:00
Alexey Kamenev
da0ef59e56
Updated Makefile and samples.
2016-03-30 10:00:36 -07:00
Alexey Kamenev
4faeca8c6f
Fixed gcc build issues.
2016-03-30 09:58:04 -07:00
Mark Hillebrand
4f38bb48eb
Linux: buildinfo.h-related fixes
...
Only update buildinfo.h if changed. Fix parameter passing in
Tools/generate_build_info.
2016-03-29 21:04:11 +02:00
Eldar Akchurin
c22f6cc950
Initial implementation for full utterance packer
2016-03-29 13:51:20 +02:00
Mark Hillebrand
f4432575ae
Makefile: fix dependency for buildinfo.h
...
* Use .d files for CNTK binary
* Pre-declare dependency for CNTK.o on buildinfo.h
2016-03-29 08:19:00 +01:00
Amit
e65ec4a1f5
Fixed LUSequenceReader build on linux: Added missing LUSequenceWriter.cpp file to the list of sources for the reader
2016-03-24 11:33:14 -07:00
U-FAREAST\fseide
f188493589
Merge branch 'master' of https://github.com/Microsoft/CNTK into fseide/pack
2016-03-22 09:00:59 -07:00
Frank Seide
76543e8708
bug fix: InferMBLayoutFromInputsForStandardCase() must test isFinalValidationPass
2016-03-21 21:34:41 -07:00
Eldar Akchurin
0cdc149a2c
Updating makefile
2016-03-21 09:51:03 +01:00
Eldar Akchurin
40ea419e49
Refactoring of the randomizer into sequence and chunk ones
2016-03-21 09:51:03 +01:00
Mark Hillebrand
18fad62e74
Fix Linux
2016-03-21 09:51:03 +01:00
Frank Seide
34531d8920
merged from master
2016-03-17 13:06:32 -07:00
Alexey Reznichenko
23839659b8
Fix makefile (re-add lost changes)
2016-03-17 15:11:44 +01:00
Frank Seide
527c61ba95
merged from master
2016-03-15 18:48:29 -07:00
Gaizka Navarro
f8be2e4eec
Renames SynchronouseExecutionEngine to NDLBuilderImpl
...
Renames SynchronousNodeEvaluator to NDLNodeEvaluatorImpl
Merges SynchronousExecutionEngine.h into NDLNetworkBuilder.h
Renames SynchronousExecutionEngine.cpp into NDLNetworkBuilder.cpp
2016-03-14 09:55:05 +01:00
Gaizka Navarro
576eeb5f87
Moves SynchronouseExecutionEngine to ActionsLib
2016-03-14 09:55:00 +01:00
Gaizka Navarro
75364c8936
Relocates Network building files from ComputationNetworkLib to ActionsLib.
2016-03-14 09:54:58 +01:00
Gaizka Navarro
e2f31ff658
Addresses CR : Rename NetworkCreator to NetworkFactory
2016-03-14 09:54:57 +01:00
Gaizka Navarro
27667a13d2
Make gcc happy
2016-03-14 09:54:33 +01:00
Frank Seide
63c50f6364
added new node Where (only BS)
2016-03-11 16:57:14 -08:00
Frank Seide
8a517d0c6d
added an experimental seq-2-seq auto-encoder
2016-03-06 17:40:58 -08:00
Frank Seide
2ae9eea1a7
added first batch of BS standard operations
2016-03-06 00:25:39 -08:00
Frank Seide
ecc8deb5b5
implemented include-path traversal for BrainScript and turned CNTK standard BS into an include file CNTK.core.bs;
...
bug fix for Issue #210 : PreComputeNodeBase must infer layout from input after loading;
ImageReader post-build events now consistently use xcopy
2016-03-05 21:27:04 -08:00
U-FAREAST\fseide
f7865837e3
Merge branch 'master' of https://github.com/Microsoft/CNTK into fseide/s2s
2016-03-01 13:32:44 -08:00
Yongqiang Wang
7ce997c726
Per Amit's suggestion, add NO_SYNC to debug build as well. Now it is consistent
...
with Windows build.
2016-03-01 11:29:10 -08:00
Yongqiang Wang
8bb5aa89e2
Turn NO_SYNC on in the release build.
2016-03-01 11:29:09 -08:00
Frank Seide
5304784b6c
fixed NoGPU build re do_sync;
...
updated ExperimentalHTKMLFReader w.r.t. file naming
2016-02-29 21:27:49 -08:00
Frank Seide
7d3e84e773
merged from master
2016-02-29 19:17:35 -08:00
Frank Seide
67f12739bc
Fixed Issue #176 : random number used for random_shuffle() had an int overflow on gcc, which caused uncaught out-of-bounds accesses.
2016-02-29 11:58:13 -08:00
Mark Hillebrand
4d5566d5ac
Experimental HTKMLF Reader (currently only supports frame mode)
2016-02-29 15:54:39 +01:00
Frank Seide
e54b352822
removed template parameter ElemType from (I)DataReader and (I)DataWriter
2016-02-28 19:01:07 -08:00
Alexey Kamenev
246907dbb6
Addressed code review comments.
2016-02-25 10:56:42 -08:00
Alexey Kamenev
5d6a468278
Fixed ImageReader Linux build.
2016-02-25 09:47:15 -08:00
Alexey Kamenev
bbf67cf03b
Added libzip support on Linux.
2016-02-25 09:47:14 -08:00
Gaizka Navarro
09dea188f5
Adds ExceptionWithCallStack class to wrap native exceptions (runtime_error, logic_error, invalid_arguent), so that the call stack can be provided to the managed layer.
...
Moves DebugUtil functions (PrintCallStack, GetCallStack) to ExceptionWithCallStack
Refactors the PrintCallStack and GetCallStack functions in ExceptionWithCallBack to re-use the common functionality.
Make gcc happy
2016-02-23 09:11:12 +01:00
Qiwei Ye
1b9a83617f
Merge branch 'master' into qiwye/asgd-dev
2016-02-17 13:37:16 +08:00
Alexey Kamenev
c0a20b379d
Added SM3.0 to Linux Debug build. Added serialization of new fields to BN node.
2016-02-16 12:31:28 -08:00
Qiwei Ye
b14d6576a2
make gcc happy for the multiverso lib
2016-02-15 21:01:04 +09:00
Qiwei Ye
492e2735de
Merge branch 'master' into qiwye/asgd-dev
...
Conflicts:
Source/ActionsLib/ActionsLib.vcxproj
Source/CNTK/CNTK.cpp
Source/CNTK/CNTK.vcxproj
Source/SGDLib/SGD.cpp
Source/SGDLib/SGDLib.vcxproj
2016-02-14 11:56:26 +08:00
Project Philly
e1093b9537
Integrate f0d8a23b26
into master
2016-02-13 07:28:20 -08:00
Alexey Kamenev
e8ab337235
Refactored Makefile to include defines both to NVCC and g++.
2016-02-12 09:33:47 -08:00
Ross Wightman
f0d8a23b26
Add experimental support for OpenBLAS library
...
* Add 'openblas' as mathlib option in configure. Not added to auto-search so
must be specified using --with-openblas
* configure script searches empty tail so that libraries located at default_path_list
roots (ie /usr/local/ + include/openblas_config.h) are found
* Treat ACML as the odd library out in ifdefs since it doesn't conform to typical
BLAS standard. Other libraries like ATLAS should be able to share
OpenBLAS/MKL variants. Add default USE_ACML define in VS projects to match
* Fix 'max' macro define colliding with C++ std::max once openblas headers are included
Usage Notes:
* For best performance, build OpenBLAS with USE_OPENMP=1. When running CNTK, set
OPENBLAS_NUM_THREADS environment var or set numCPUThreads CNTK config variable to the
physical core count or performance will suffer
* OpenBLAS 2.16 (git HEAD) tested in Linux with GCC 4.8.4 and in Windows with
OpenBLAS 2.15 (pre-built binary release + MingGW 64-bit support dlls)
* For Windows, in Math.vcxproj, replace libacml_mp_dll.lib with libopenblas.dll.a and change
USE_ACML define to USE_OPENBLAS. Change ACML_PATH environment variable to your OpenBLAS path.
Modify openblas_config.h as per https://github.com/xianyi/OpenBLAS/issues/708
* On current generation Intel processors, OpenBLAS measures a little faster than
AMD ACML and slower than Intel MKL on MNIST and other examples
2016-02-11 13:40:18 -08:00
Qiwei Ye
6fe2f8e464
Merge branch 'master' into qiwye/multiverso
2016-02-03 19:31:38 +08:00
Clemens Marschner
0e5ad89a15
Reapply fix in Makefile for SparsePCReader
...
Reapply name changes in Makefile that had been resolved but
got lost during excessive rebasing.
2016-02-03 01:15:34 -08:00
Mark Hillebrand
2251188bef
Fix ReaderLib.lib (and references)
2016-02-02 13:31:59 +01:00
Mark Hillebrand
93fb8d8283
Rename Source/Readers/{{New -> }ImageReader,Reader{ -> Lib}}
2016-02-02 13:24:37 +01:00
Qiwei Ye
397614801c
Adding macros for the multiverso submodule
2016-02-02 19:11:02 +08:00
Mark Hillebrand
52d6444920
Add new image reader under new reader architecture
2016-02-02 11:30:15 +01:00
Qiwei Ye
c69c2d50f2
Merge branch 'master' into qiwye/multiverso
2016-02-02 12:04:35 +08:00
Chris Basoglu
69112d13c8
Simplified clean
2016-02-01 12:56:54 -08:00
Chris Basoglu
31a212579e
Fix progress when epochsize is 0 and fix the git hash built into the exe
2016-02-01 12:56:47 -08:00
Clemens Marschner
a8e807658f
Fix Merge Problem
2016-02-01 17:42:44 +01:00
Clemens Marschner
3b3d8998a5
Fix reader on Linux
2016-02-01 17:42:43 +01:00
Clemens Marschner
734baf94c7
Fix #define
...
Activate LibSparsePCReader on Linux build
Make file name consistent with Windows
Activate LibSparsePCReader on Linux build
Make file name consistent with Windows
Activate LibSparsePCReader on Linux build
Make file name consistent with Windows
Fix reader on Linux
Activate LibSparsePCReader on Linux build
Make file name consistent with Windows
Activate LibSparsePCReader on Linux build
Make file name consistent with Windows
Activate LibSparsePCReader on Linux build
Make file name consistent with Windows
Activate LibSparsePCReader on Linux build
Make file name consistent with Windows
2016-02-01 17:42:42 +01:00
Clemens Marschner
0bbf3c4901
Fix reader on Linux
2016-02-01 17:42:38 +01:00
Clemens Marschner
46ce1e55d3
Make file name consistent with Windows
2016-02-01 17:42:35 +01:00
Clemens Marschner
bd0b68d11b
Activate LibSparsePCReader on Linux build
2016-02-01 17:42:34 +01:00
Eldar Akchurin
e514d1fb0c
Fixing linking against open cv 3.0
2016-02-01 13:47:59 +01:00
Qiwei Ye
99cf8cbbbb
Merge branch 'master' into qiwye/multiverso
...
Conflicts:
Source/SGDLib/SGD.cpp
2016-02-01 11:14:55 +08:00
Mark Hillebrand
263a3176a0
Makefile: exit early if 1Bit-SGD headers not found in 1Bit-SGD build
2016-01-29 12:07:22 +00:00
Qiwei Ye
c7bfebe740
Merge branch 'master' into qiwye/multiverso
2016-01-29 14:23:04 +08:00
Qiwei Ye
7b495bdf9c
change makefile for Linux work with multiverso
2016-01-29 14:20:21 +08:00
Alexey Orlov
cd1bb59125
Fixed wrong ld OpenCV path in Linux Makefile
2016-01-28 16:32:23 +01:00
Qiwei ye
f8d0d4b182
Merge branch 'master' into qiwye/multiverso
...
Conflicts:
Source/ActionsLib/ActionsLib.vcxproj
Source/CNTK/CNTK.vcxproj
Source/ComputationNetworkLib/ComputationNetworkLib.vcxproj
Source/EvalDll/EvalDll.vcxproj
Source/SGDLib/SGDLib.vcxproj
2016-01-28 22:41:07 +08:00
Amit
621637e5b3
Merge branch 'master' of https://github.com/Microsoft/CNTK into amitaga/releaseModeCallStacks
2016-01-25 22:07:12 -08:00
Amit
aace504d8c
Added -g and -rdynamic compiler/linker options for release mode builds on linux to enable call stack generation in release builds
2016-01-25 21:55:48 -08:00
Qiwei ye
6446a2fa79
Merge branch 'master' into qiwye/multiverso
...
Conflicts:
.gitignore
CNTK.sln
Source/CNTK/CNTK.cpp
Source/CNTK/CNTK.vcxproj
Source/ComputationNetworkLib/ComputationNetworkLib.vcxproj
Source/EvalDll/EvalDll.vcxproj
Source/SGDLib/SGD.cpp
Source/SGDLib/SGD.h
Source/SGDLib/SGDLib.vcxproj
Source/SGDLib/SGDLib.vcxproj.filters
2016-01-25 16:56:12 +08:00
Frank Seide
6d31cda88a
removed two more Multinetworks configs from SimpleNetworkBuilder
2016-01-22 09:42:57 -08:00
Alexey Orlov
89a2b0dac0
Fixed Linux Makefile error message
2016-01-22 16:27:50 +01:00
Amit Agarwal
e32329a85c
Merge branch 'master' of https://git01.codeplex.com/cntk into amitaga/separate1bitDataParallelSGD
2016-01-15 00:08:17 -08:00
Philipp Kranen
135b992df9
fixed Linux Makefile wrt deleted files
2016-01-14 09:06:40 +01:00
Amit Agarwal
18528f15b4
Merge branch 'master' of https://git01.codeplex.com/cntk into amitaga/separate1bitDataParallelSGD
2016-01-13 22:43:27 -08:00
Amit
9cf113de6f
Made 1bit support an optionally configurable build option for CNTK which is off by default
2016-01-13 14:29:19 -08:00
Marko Radmilac
ba61abd79e
Disable popups on Windows
2016-01-13 10:11:28 -08:00
Qiwei Ye
6c2ee1aa51
Merge branch 'master' into qiwye/multiverso
...
Conflicts:
Source/ComputationNetworkLib/ComputationNetworkLib.vcxproj
Source/SGDLib/SGDLib.vcxproj
Source/SGDLib/SGDLib.vcxproj.filters
2016-01-07 16:57:09 +08:00
Amit
21fceca779
Fixed linux build
2016-01-06 19:00:13 -08:00
Amit
96e03050a6
Fixed linux build error
2016-01-05 10:42:38 -08:00
Frank Seide
da8f560043
made gcc happy
2015-12-28 20:03:50 -08:00
Qiwei Ye
9664daccb0
Merge branch 'master' into qiwye/multiverso
2015-12-19 12:43:46 +08:00
Mark Hillebrand
679c3c5298
Source/Readers/LMSequenceReader/: also build SequenceWriter on Linux
2015-12-18 11:59:40 +00:00
Qiwei Ye
254b45e680
Merge branch 'master' into qiwye/multiverso
...
Conflicts:
Source/CNTK/CNTK.vcxproj
Source/ComputationNetworkLib/ComputationNetworkLib.vcxproj
Source/EvalDll/EvalDll.vcxproj
Source/SGDLib/SGDLib.vcxproj
Source/SGDLib/SGDLib.vcxproj.filters
2015-12-17 10:35:08 +08:00
thhoens
3ab0ddace2
Fix for LibSVMBinaryReader to add prefetching, microbatches, and Linux support.
2015-12-16 12:13:38 -08:00
Mark Hillebrand
a9c4922a5e
Makefile: adapt to new location of generate_build_infop script
2015-12-16 14:24:49 +00:00
Mark Hillebrand
caf67c74fc
Adapt Linux build
2015-12-16 08:05:32 +00:00
Frank Seide
aec884a4d3
started the TensorView class by adding header and CPP to math lib
2015-12-15 15:02:43 -08:00
Qiwei Ye
1d12689b58
Merge branch 'qiwye/dev' into qiwye/multiverso
2015-12-15 14:31:49 +08:00
yzhang87
b8eb51d4a3
Fix kaldi Reader. 1) Using the new MBLayout interface. 2) Modify the configParameter to configRecordType to consistent with HTKMLFReader. 3) Clean the warning message. Next: refactor to make it consistent with HTKMLFReader.
2015-12-14 11:00:20 -05:00
Alexey Kamenev
254b04c9b5
cudnn: added OpenCV libs to Linux build.
2015-12-12 10:00:01 -08:00
Alexey Kamenev
3023f11e6e
cudnn: enabled build on Linux with cuDNN.
2015-12-12 09:59:09 -08:00
Qiwei Ye
07e48cd667
adding runtime libraries
2015-12-12 18:27:55 +09:00
Frank Seide
896b0476a0
renamed commandArgUtil.h to Config.h and ConfigFile.cpp to Config.cpp;
...
bug fix in previous refactoring of sub-minibatching
2015-12-04 22:31:47 -08:00
Frank Seide
0eb77f8e2f
Step 2 of moving LSTMNode to EsotericNodes.h: deleted it from RecurrentNodes.h;
...
made gcc happy
2015-12-04 20:56:33 -08:00
Alexey Kamenev
93a0872069
Added NDEBUG to Linux Release build.
2015-12-03 11:20:50 -08:00
Qiwei Ye
e3a8caca88
add NVMLPATH to the linking target cntk for the libnvidia-ml.so
2015-11-26 07:34:37 -05:00
Amit
77da34e8d5
Added call stack printing functionality for Linux
2015-11-25 17:20:56 -08:00
Yongqiang Wang
377c8223d4
Fix a bug in Scripts/genrate_build_info
2015-11-24 21:34:30 -08:00
Yongqiang Wang
33cf6a013f
Enable PrintBuildInfo for both Windows and Linux
2015-11-24 16:38:37 -08:00
Frank Seide
ab0dcf3434
simplified DeviceFromConfig() by removing PTasks-specific configuration options. Also added an overload for BrainScript;
...
added a dummy DataReader constructor from BrainScript (currently not implemented);
had to disable DelayLoadNofify() as that suddenly caused link errors (seems because DeviceFromConfig() is now called from a different place?);
further unified DoTrain() w.r.t. old CNTK config and BrainScript. Added a new BrainScriptBuilder (but the builders will go away next and get replaced by a lambda). DoTrain now accessible from BS (but not functional yet, too many pieces missing);
all builders now can be constructed from both old ConfigParameters and BrainScript IConfigRecord;
suddenly gcc got very picky, had to fix several places
2015-11-21 00:16:36 -08:00
Frank Seide
ae778f6be4
added more scaffolding (empty CPP files) for moving actions to CNTKActionsLib. Updated Linux Makefile
2015-11-17 23:22:33 -08:00
Frank Seide
1a754b968c
Eliminated NetworkBuilderFromConfig.cpp. Instead, the few surviving lines--the lines registering ComputationNode as a scriptable object--are now in ComputationNode.cpp;
...
fixed Linux Makefile after change of GPUMatrixCUDAKernels.cu to GPUMatrixCUDAKernels.cuh. It used to explicitly compile this in the GCC build, although it was included
2015-11-17 22:37:43 -08:00
Frank Seide
4036a52f63
BrainScript: ComputationNetwork can now construct itself from BS (the special MakeRuntimeObject() function is gone);
...
new source file ComputationNetworkScripting.cpp;
changed ComputationNetwork::SetDeviceId(). Now just takes the input and sets that as the device. Before it did somethinf funky with m_deviceId, which looks like a bug;
in LSTM test config, removed remnants of old NDL, now completely based on BS
2015-11-16 09:57:01 -08:00
Frank Seide
3b2068ead6
added CNTKActionsLib to Linux include path;
...
moved DisableLegacyTruncationSettings() away from being the very first piece of code in CNTK.cpp, hiding it close to where it is used. Also fixed its spelling and made it 'static'
2015-11-12 13:23:54 -08:00
Mark Hillebrand
88026d547c
Fix two perf problems
...
1. On Linux, use ACML MP as default ACML library.
2. For the parallel end-to-end tests, limit concurrency based on
available hardware threads.
2015-11-05 22:15:51 +01:00
Vladimir Ivanov
f2db77795e
Applying workaround for race condition in OpenMPI on non-0 exit code from CNTK
2015-10-30 16:16:09 -07:00
Frank Seide
525f9be994
moved memshare functions from header to ComputationNetworkEvaluation.cpp;
...
created new ComputationNetworkEditing.cpp
2015-10-30 10:35:12 -07:00
Frank Seide
c3328c00fa
moved sets of functions from ComputationNetwork.cpp to ComputationNetworkEvaluation.cpp and ComputationNetworkAnalysis.cpp
2015-10-30 10:05:12 -07:00
Yu
9d26bfdcd9
Fix build for NoGPU.
2015-10-28 20:59:52 -04:00
Amit
69ccd3f64c
Remove debug info generation option for CUDA compilation in debug flavor builds and also enable fast-math optimizations . These changes have been done to eliminate differences in GPU results for the E2E tests between debug and release flavors. Setting environment variable CNTK_CUDA_DEVICE_DEBUGINFO=1 will enable debug info generation. The baselines for all E2E tests have also been updated in accordance with this change
2015-10-24 14:34:01 -07:00
Amit Agarwal
4777f5f7d3
Rename SequenceTraining project to CNTKSequenceTrainingLib to be consistent with other libs
2015-10-18 12:40:43 -07:00
Alexey Kamenev
bb62af7d13
ImageReader fixes for Linux build.
2015-10-14 12:30:11 -07:00
Alexey
78d2e0ba68
Add CUB path.
2015-10-14 12:29:51 -07:00
Amit
9a4c84beb4
Fixed Linux build
2015-10-09 23:54:37 -07:00
Guoguo Chen
d6ae0b0adc
Merge remote-tracking branch 'remotes/origin/master' into guoguo/linuxBuildFix
2015-10-07 18:19:11 -04:00
Alexey Kamenev
b7d9ab9737
Refactor SequenceTraining to support CPUONLY.
2015-10-07 10:35:31 -07:00
Frank Seide
1b01fd6965
more cleanup on when Resize() ops are done;
...
renamed SimpleEvaluator::PreCompute() to EvaluateBatchModeNodes() because the original name was misleading;
Linux Makefile now defines _DEBUG in debug builds
2015-10-06 14:02:45 -07:00
Guoguo Chen
ac70bfe47c
fixing linux build for master branch; removed duplicated files in KaldiReader and Kaldi2Reader
2015-09-30 18:02:05 -04:00
Amit
e736be8b6e
Port the Sequence trainign code to Linux
2015-09-25 17:22:58 -07:00
Amit Agarwal
3212a55b35
Merge branch 'master' of https://git01.codeplex.com/forks/srehpycs/mitsls into srehpycs/mitsls
2015-09-24 10:50:00 -07:00
Alexey Kamenev
f6acb1033e
Add env vars to control CUDA codegen.
2015-09-17 16:57:26 -07:00
Alexey Kamenev
c5c1537bd4
Change CUDA settings for Debug builds.
2015-09-17 16:37:00 -07:00
Scott Cyphers
a654b6e3d5
Eradicate all possible warnings from g++
...
Replace hash_map with unordered_map
Fix size_t formatting (%zd)
Add some missing sprintf_s args
Some methods defined in base class need the base mentioned in templates
Don't use classname::methodname in class definitions
2015-09-17 16:00:48 -04:00
Scott Cyphers
9878959e3d
Merge remote-tracking branch 'cntk/master' into merge
2015-09-17 09:32:17 -04:00
Amit Agarwal
1a9908bc8e
Moved the parallel trainign guard when writing model/checkpoint files to the actual save functions instead of guarding at the call sites
2015-09-15 21:04:09 -07:00
Frank Seide
54a6b1d2ec
made gcc happy again (mostly missing headers or wrong declaration orders);
...
Makefile adapted to new paths, but not yet building Network and SGD as separate libs
2015-09-06 09:20:28 -07:00
Frank Seide
a4c32ac19f
CNTKEval now builds (missed the new .cpp files)
2015-09-03 19:15:00 -07:00
Frank Seide
3066a16fe9
moved most <ElemType>-dependent functions out of ComputationNetwork into a ComputationNetworkBuilder class (added two files);
...
fixed the slew of dependencies, mostly SimpleNetworkBuilder.cpp;
ComputationNetwork no longer has to include all headers for all vairants of ComputationNodes;
a few ComputationNode derivates missed #includes
2015-09-03 18:41:59 -07:00
U-FAREAST\fseide
1219c24f60
Merge branch 'master' into fseide/bs
2015-09-03 15:05:46 -07:00
Frank Seide
a4c480fd92
Merge branch 'master' into fseide/bs
...
Conflicts:
Math/Math/NoGPU.cpp
2015-09-03 13:50:03 -07:00
Marko Radmilac
4bbcca453e
NVCC warnings as errors
2015-09-03 13:30:30 -07:00
Marko Radmilac
fe3346b0bf
Cleanup warnings in Linux
2015-09-03 09:24:03 -07:00
Frank Seide
8705dd0f02
Merge remote-tracking branch 'origin' into fseide/bs
...
Conflicts:
DataReader/HTKMLFReader/ssematrix.h
Math/Math/CUDAPageLockedMemAllocator.cpp
Math/Math/Matrix.cpp
Math/Math/NoGPU.cpp
Math/Math/ValueQuantizer.h
2015-09-02 10:12:15 -07:00
Frank Seide
67464d22e0
some fixes to make gcc happy (one still missing);
...
somehow git lost 'Makefile'--readding, hoping it won't confuse the merge process
2015-09-02 08:43:31 -07:00
Frank Seide
d4c3e4afb0
added BS to Linux Makefile--with lots of fallout that needs to be fixed
2015-09-01 13:44:20 -07:00
Amit Agarwal
8e85f07de3
Merge branch 'master' of https://git01.codeplex.com/cntk into amitaga/mergeHTKMLFReaders
2015-09-01 13:27:19 -07:00
Amit Agarwal
1df4e8e5e1
Merge the linux and windows forks of the HTKMLFReader fork into one.
2015-09-01 13:09:57 -07:00
Scott Cyphers
19506bc123
Merge remote-tracking branch 'cntk/master'
2015-09-01 13:57:24 -04:00
Amit Agarwal
7915fef15d
Fixed CPUONLY build
2015-09-01 00:06:38 -07:00
Frank Seide
025e1323cd
added BrainScript to Linux Makefile INCLUDEPATH
2015-08-31 21:06:28 -07:00
Scott Cyphers
7697c39294
Merge remote-tracking branch 'cntk/master'
2015-08-28 13:36:11 -04:00
Amit Agarwal
acd24c738e
Addressed code review feedback
2015-08-17 14:48:06 -07:00
Scott Cyphers
ec14fd97b8
Cleanups, README improvements, missing Makefile dependency
...
Remove the no longer needed kaldi Makefiles.
Fix some pre-configure references in the README that were missed, add
a missing step to the build instructions, remove some obsolete
information, be more specific about the acml library that works, and
reword a few sentences.
Add math library dependencies to the kaldi plugins so that make -j
doesn't try to build them before the math library is finished.
2015-08-11 16:58:18 -04:00
Amit Agarwal
1b025bc529
Merge branch 'master' of https://git01.codeplex.com/cntk into amitaga/parallelTraining
...
Conflicts:
MachineLearning/CNTK/SGD.h
Makefile
2015-08-11 10:36:15 -07:00
Scott Cyphers
0ebdaedb35
Add a configure script for setting build parameters
...
Add a configure script for initializing build parameters, either
for in or out of source builds. The script generates a Config.make
in the build directory, and, for out of source builds, a trampoline
Makefile.
Make the build-and-test script to do an out of source build.
Add Config.make to .gitignore, as well as emacs temporary file patterns.
2015-08-07 13:03:27 -04:00
Scott Cyphers
404f167938
Use original build targets when PREFIX is not supplied.
2015-08-06 15:28:56 -04:00
Scott Cyphers
c54a045de2
Remove site-specific paths from Makefile.
...
Change configuration to build to a specific PREFIX directory, where
a Config.make is located that contains build and site-specific information.
This also makes it easy to check just how an earlier build was configured.
Update the instructions in README.
2015-08-06 12:41:57 -04:00
Scott Cyphers
25f8594d6e
Simplified unified CPU/GPU/Kaldi Makefile
...
Modularize build specifications for each target, where each target
adds what it needs to paths.
Add rpath to cntkmath and plugins so they do not need LD_LIBRARY_PATH.
Remove object files from cntk that were already in cntkmath.
Organize build targets into UNIX-like bin and lib directories under a
configuration-specific directory. Have .gitignore ignore these
directories.
Make it easy to keep sources in alphabetic order for easier comparison
with the Windows project definition.
2015-08-05 18:46:31 -04:00
Amit Agarwal
64fae7a0bc
Implementation of data-parallel SGD with 1bit quantization of gradients for reduced communication costs
2015-08-05 09:23:33 -07:00
Scott Cyphers
f5634aff70
Add the appropriate math -rpath to shared libraries link.
2015-07-30 13:35:50 -04:00
Marko Radmilac
1fb5918b13
Implement minibatch prefetching
...
This change implements a read-ahead (prefetch) of one minibatch on a separate thread to ensure that main thread always has enough work. This is done through coarse-level parallelism, where GetMinibatch is called from a separate thread and result is cached for main thread to consume. The synchronization is a simple producer/consumer model with a single mutex and a conditional variable.
This change also modifies how we measure time it takes to read and compute a minibatch worth of data.
2015-07-15 11:57:06 -07:00
Alexey Kamenev
db64969c51
Add lib path for NVML, remove redundant lib references
2015-07-02 10:53:26 -07:00
Marko Radmilac
c20ee5b882
Create common makefile, and remove cpu and gpu specific makefiles. Also do some cleanup.
2015-06-24 13:59:05 -07:00