43ae65d67f
sandbox/dan2: Fix out-of-bounds bug in cuda kernels that was causing occasional crashes in DNN training with GPUs. +minor code cleanup.
...
git-svn-id: https://svn.code.sf.net/p/kaldi/code/sandbox/dan2@3147 5e6a8d80-dfce-4ca6-a32a-6e07a63d50c8
2013-11-09 16:19:20 +00:00
aa28559cc3
sandbox/dan2: Extensions to scripts; add am-info program which is more generic version of gmm-info.
...
git-svn-id: https://svn.code.sf.net/p/kaldi/code/sandbox/dan2@3146 5e6a8d80-dfce-4ca6-a32a-6e07a63d50c8
2013-11-08 22:52:15 +00:00
0728f99072
trunk: add dependency on patch
...
git-svn-id: https://svn.code.sf.net/p/kaldi/code/trunk@3145 5e6a8d80-dfce-4ca6-a32a-6e07a63d50c8
2013-11-08 17:28:09 +00:00
7a36a93830
Reverting previous change, which did not compile
...
git-svn-id: https://svn.code.sf.net/p/kaldi/code/sandbox/dan2@3143 5e6a8d80-dfce-4ca6-a32a-6e07a63d50c8
2013-11-07 22:49:56 +00:00
08cfd143d8
added cuda fuctions related to the pnorm nnet
...
git-svn-id: https://svn.code.sf.net/p/kaldi/code/sandbox/dan2@3142 5e6a8d80-dfce-4ca6-a32a-6e07a63d50c8
2013-11-07 22:47:29 +00:00
5ce3721700
git-svn-id: https://svn.code.sf.net/p/kaldi/code/sandbox/dan2@3141 5e6a8d80-dfce-4ca6-a32a-6e07a63d50c8
2013-11-07 22:44:13 +00:00
020dbb314b
trunk: add binary to compute lattice depth per frame; some cosmetic script fixes; add script to compute oracle WER and depth
...
git-svn-id: https://svn.code.sf.net/p/kaldi/code/trunk@3140 5e6a8d80-dfce-4ca6-a32a-6e07a63d50c8
2013-11-07 21:03:03 +00:00
3ce8283a72
sandbox/dan2: modify nnet-combine-fast to support regularization; update to WSJ results.
...
git-svn-id: https://svn.code.sf.net/p/kaldi/code/sandbox/dan2@3139 5e6a8d80-dfce-4ca6-a32a-6e07a63d50c8
2013-11-07 21:01:06 +00:00
393fd3e00d
sandbox/dan2: Various minor example script updates/fixes for GPU nnet training. Example setup still not really finished.
...
git-svn-id: https://svn.code.sf.net/p/kaldi/code/sandbox/dan2@3138 5e6a8d80-dfce-4ca6-a32a-6e07a63d50c8
2013-11-07 17:18:34 +00:00
6c7805a9cc
sandbox/dan2: Swbd script changes, still a mess.
...
git-svn-id: https://svn.code.sf.net/p/kaldi/code/sandbox/dan2@3137 5e6a8d80-dfce-4ca6-a32a-6e07a63d50c8
2013-11-06 23:00:20 +00:00
a9b955bc8b
sandbox/dan2: extra scripts, script fix, more results; merge trunk
...
git-svn-id: https://svn.code.sf.net/p/kaldi/code/sandbox/dan2@3136 5e6a8d80-dfce-4ca6-a32a-6e07a63d50c8
2013-11-06 19:11:44 +00:00
05335f81fc
sandbox/dan2: some extra scripts for RM setup
...
git-svn-id: https://svn.code.sf.net/p/kaldi/code/sandbox/dan2@3134 5e6a8d80-dfce-4ca6-a32a-6e07a63d50c8
2013-11-05 21:10:12 +00:00
bdb5cdc170
trunk: Fix to fgmmbin/Makefile
...
git-svn-id: https://svn.code.sf.net/p/kaldi/code/trunk@3133 5e6a8d80-dfce-4ca6-a32a-6e07a63d50c8
2013-11-05 02:58:14 +00:00
3e67d2f319
sandbox/dan2: merging trunk changes, a couple of bug-fixes for new neural-net training setup (RE grabbing GPUs), and adding a new example script in RM setup
...
git-svn-id: https://svn.code.sf.net/p/kaldi/code/sandbox/dan2@3132 5e6a8d80-dfce-4ca6-a32a-6e07a63d50c8
2013-11-05 00:49:05 +00:00
3097648a31
trunk:egs/hkust add merge multiple words to phrase options in output format for hkust_extract_subdict.pl
...
git-svn-id: https://svn.code.sf.net/p/kaldi/code/trunk@3131 5e6a8d80-dfce-4ca6-a32a-6e07a63d50c8
2013-11-04 09:57:50 +00:00
0e952376c8
trunk:tools/Makefile minor changes for symbolic link handling for openfst
...
git-svn-id: https://svn.code.sf.net/p/kaldi/code/trunk@3130 5e6a8d80-dfce-4ca6-a32a-6e07a63d50c8
2013-11-02 20:04:50 +00:00
ab84a95dc8
trunk:src openfst-1.3.2 patch for compatibility of c++11 flag compilation; disambiguate variables (begin and end) in interval-set.h which somehow confuse g++ with c++11 compilation flag
...
git-svn-id: https://svn.code.sf.net/p/kaldi/code/trunk@3129 5e6a8d80-dfce-4ca6-a32a-6e07a63d50c8
2013-11-02 17:44:53 +00:00
813aceb2d9
fixed to num of decoding jobs
...
git-svn-id: https://svn.code.sf.net/p/kaldi/code/trunk@3128 5e6a8d80-dfce-4ca6-a32a-6e07a63d50c8
2013-11-02 07:00:53 +00:00
5162d7c660
trunk:src code modifications for compatibility of C++11 flag (i.e. g++ -std=c++11 for gcc compiler 4.7 or up)
...
git-svn-id: https://svn.code.sf.net/p/kaldi/code/trunk@3127 5e6a8d80-dfce-4ca6-a32a-6e07a63d50c8
2013-11-01 11:24:36 +00:00
342c55cb2f
Creating sandbox for pitch algorithm
...
git-svn-id: https://svn.code.sf.net/p/kaldi/code/sandbox/pitch@3126 5e6a8d80-dfce-4ca6-a32a-6e07a63d50c8
2013-10-30 19:17:07 +00:00
d0b696982c
sandbox/dan2: Adding some nnet results to egs/swbd/s5b/RESULTS, and putting back some results from the trunk RESULTS file, from Karel's setup.
...
git-svn-id: https://svn.code.sf.net/p/kaldi/code/sandbox/dan2@3125 5e6a8d80-dfce-4ca6-a32a-6e07a63d50c8
2013-10-29 16:43:09 +00:00
57a1bde716
sandbox/dan2: Committing some script changes for switchboard recipe (example scripts are still a bit of a mess)
...
git-svn-id: https://svn.code.sf.net/p/kaldi/code/sandbox/dan2@3124 5e6a8d80-dfce-4ca6-a32a-6e07a63d50c8
2013-10-29 16:34:34 +00:00
66867bfd1e
trunk: Changes to pruned lattice-determinization code to make it work with very long utterances (e.g. many minutes), and moving it from fstext/ to lat/ (since the modified code had a dependency on lat/, and the fstext/ directory has no dependency on lat/). Change command-line options of lattice-oracle to be more up-to-date in their style.
...
git-svn-id: https://svn.code.sf.net/p/kaldi/code/trunk@3123 5e6a8d80-dfce-4ca6-a32a-6e07a63d50c8
2013-10-29 02:37:00 +00:00
92a6c1b10c
trunk: Commit script bug-fix to egs/wsj/s5/local/run_sgmm.sh
...
git-svn-id: https://svn.code.sf.net/p/kaldi/code/trunk@3122 5e6a8d80-dfce-4ca6-a32a-6e07a63d50c8
2013-10-27 19:40:31 +00:00
f714c32774
Adding lattice recall computation
...
git-svn-id: https://svn.code.sf.net/p/kaldi/code/trunk@3121 5e6a8d80-dfce-4ca6-a32a-6e07a63d50c8
2013-10-27 17:03:34 +00:00
5264ce98ca
sandbox/dan2: changes to nnet-combine-fast and associated functions, to improve speed when using multiple threads.
...
git-svn-id: https://svn.code.sf.net/p/kaldi/code/sandbox/dan2@3120 5e6a8d80-dfce-4ca6-a32a-6e07a63d50c8
2013-10-26 03:47:23 +00:00
66d7e6d946
sandbox/dan2: Fix typo in some options-registering strings, optionaly->optional
...
git-svn-id: https://svn.code.sf.net/p/kaldi/code/sandbox/dan2@3119 5e6a8d80-dfce-4ca6-a32a-6e07a63d50c8
2013-10-26 01:25:08 +00:00
43ed3d9229
dan2,cudamatrix: removing redundant message CUDA not used in ~CuDevice, bugfix to RBM training script
...
git-svn-id: https://svn.code.sf.net/p/kaldi/code/sandbox/dan2@3118 5e6a8d80-dfce-4ca6-a32a-6e07a63d50c8
2013-10-25 23:28:43 +00:00
2be9da4cbb
dan2,cudamatrix: GPU selection logic is simplified; --use-gpu-id=N option is now replaced by --use-gpu=yes|no|optionaly,
...
"yes" -- Select GPU automatically (or get one by exclusive mode) and die if this fails.
"optionaly" -- Do as above, but if it fails, back off to CPU
"no" -- Run on CPU.
The recommended GPU setup is to use compute-exclusive mode, otherwise GPU gets selected automatically.
git-svn-id: https://svn.code.sf.net/p/kaldi/code/sandbox/dan2@3117 5e6a8d80-dfce-4ca6-a32a-6e07a63d50c8
2013-10-25 23:09:58 +00:00
3cd038e166
trunk:egs/hkust/s5b minor update on results, 2048 neurons DNN
...
git-svn-id: https://svn.code.sf.net/p/kaldi/code/trunk@3114 5e6a8d80-dfce-4ca6-a32a-6e07a63d50c8
2013-10-25 17:09:30 +00:00
b2ab82374b
sandbox/dan2: fix memory leak in CuDevice; more parameter checking in CompObjfAndDeriv.
...
git-svn-id: https://svn.code.sf.net/p/kaldi/code/sandbox/dan2@3113 5e6a8d80-dfce-4ca6-a32a-6e07a63d50c8
2013-10-25 16:20:30 +00:00
745d53d6d4
trunk:src/doc minor updates on documentation
...
git-svn-id: https://svn.code.sf.net/p/kaldi/code/trunk@3112 5e6a8d80-dfce-4ca6-a32a-6e07a63d50c8
2013-10-25 02:41:23 +00:00
7563614ff3
dan2,utils/nnet : merging a bugfix to RBM-initialization script
...
git-svn-id: https://svn.code.sf.net/p/kaldi/code/sandbox/dan2@3111 5e6a8d80-dfce-4ca6-a32a-6e07a63d50c8
2013-10-24 17:51:11 +00:00
92b7f9c348
Added KWS files refs for Zulu and Haitian
...
git-svn-id: https://svn.code.sf.net/p/kaldi/code/trunk@3110 5e6a8d80-dfce-4ca6-a32a-6e07a63d50c8
2013-10-23 21:53:33 +00:00
44b11a1ceb
bug fixed in copy_data_dir.sh
...
git-svn-id: https://svn.code.sf.net/p/kaldi/code/trunk@3109 5e6a8d80-dfce-4ca6-a32a-6e07a63d50c8
2013-10-23 18:54:17 +00:00
0b13df94de
sandbox/dan2: merge various changes from trunk, plus some changes to enable efficient GPU-based training after 'mix-up'.
...
git-svn-id: https://svn.code.sf.net/p/kaldi/code/sandbox/dan2@3108 5e6a8d80-dfce-4ca6-a32a-6e07a63d50c8
2013-10-23 04:35:25 +00:00
82d68036c0
trunk:src/doc minor build setup descriptions for recent change
...
git-svn-id: https://svn.code.sf.net/p/kaldi/code/trunk@3107 5e6a8d80-dfce-4ca6-a32a-6e07a63d50c8
2013-10-22 16:59:35 +00:00
befa6bd2b1
trunk,nnet1: bugfix (add skipping of optional token <Nnet> at the beginning of file with means, neuron priors)
...
git-svn-id: https://svn.code.sf.net/p/kaldi/code/trunk@3106 5e6a8d80-dfce-4ca6-a32a-6e07a63d50c8
2013-10-22 12:35:18 +00:00
2545c1576e
sandbox/dan2: various modifications and bug fixed to support CUDA training in Dan's recipe. Modify CUDA device selection code (cleanup, and make error-status controllable).
...
git-svn-id: https://svn.code.sf.net/p/kaldi/code/sandbox/dan2@3105 5e6a8d80-dfce-4ca6-a32a-6e07a63d50c8
2013-10-21 20:33:50 +00:00
38ea57048a
sandbox/dan2: Modify CUDA matrix allocation so that it caches freed memory and returns cached answers if they are of the size required... this is to work around the extremee slowness of cudaMalloc and cudaMallocPitch on some platforms.
...
git-svn-id: https://svn.code.sf.net/p/kaldi/code/sandbox/dan2@3104 5e6a8d80-dfce-4ca6-a32a-6e07a63d50c8
2013-10-20 20:05:51 +00:00
2dba958093
trunk:src/Makefile: cudamatrix memory test is now isolated from other directories, since we found that there are OS platforms/hardwares dependent issues related to it. test of memory for cudamatrix is now called 'make cudavalgrind'
...
git-svn-id: https://svn.code.sf.net/p/kaldi/code/trunk@3103 5e6a8d80-dfce-4ca6-a32a-6e07a63d50c8
2013-10-19 02:16:40 +00:00
f5e6285e68
trunk,nnet1: warning! changes to Component/Nnet interaface to be closer to Dan's, you may need to fix your extensions to nnet1 code, main changes are:
...
- nnet files now have optional begin/end tokens <Nnet></Nnet> (backward compatibility)
- in the Nnet API, "*Layer" was replaced by "*Component", which better corresponds to code
- removed *Nnet pointer from Component and constructors, it was unused
- addded Component::Copy() method, simplified nnet consistency checks Nnet::Check()
- fixed "Copyright" notices
git-svn-id: https://svn.code.sf.net/p/kaldi/code/trunk@3102 5e6a8d80-dfce-4ca6-a32a-6e07a63d50c8
2013-10-18 13:34:07 +00:00
9e164941a5
Modify determinize-lattice-inl.h so RebuildHelper does not call itself (can cause program to run out of stack space on long utterances)
...
git-svn-id: https://svn.code.sf.net/p/kaldi/code/trunk@3101 5e6a8d80-dfce-4ca6-a32a-6e07a63d50c8
2013-10-18 00:40:19 +00:00
55b1759573
sandbox/dan2: Merging changes from trunk; change nnet2 code to use compressed examples.
...
git-svn-id: https://svn.code.sf.net/p/kaldi/code/sandbox/dan2@3100 5e6a8d80-dfce-4ca6-a32a-6e07a63d50c8
2013-10-17 03:57:53 +00:00
660b1293cf
fixed the bug caused by make_ffv.sh and make_pitch.sh when the directory name contains .ffv or .pitch
...
git-svn-id: https://svn.code.sf.net/p/kaldi/code/trunk@3099 5e6a8d80-dfce-4ca6-a32a-6e07a63d50c8
2013-10-16 20:37:14 +00:00
3e033f610a
trunk: Adding code and binary to limit lattice depth (in arcs per frame); fix to diagnostic info in LatticeForwardBackward; modify CompressedMatrix::Read() so it can read in a Matrix (for back-compatibility any time we change Matrix to CompressedMatrix)
...
git-svn-id: https://svn.code.sf.net/p/kaldi/code/trunk@3098 5e6a8d80-dfce-4ca6-a32a-6e07a63d50c8
2013-10-16 20:21:28 +00:00
037b95fd38
trunk:egs/hkust some run time performances & tidy up
...
git-svn-id: https://svn.code.sf.net/p/kaldi/code/trunk@3097 5e6a8d80-dfce-4ca6-a32a-6e07a63d50c8
2013-10-16 14:35:36 +00:00
53676ecb48
removing matthew's changes to nbest-to-ctm.cc in sandbox/idlak and putting it in trunk
...
git-svn-id: https://svn.code.sf.net/p/kaldi/code/trunk@3095 5e6a8d80-dfce-4ca6-a32a-6e07a63d50c8
2013-10-16 14:28:31 +00:00
a216937e07
trunk:egs/hkust some run time performances
...
git-svn-id: https://svn.code.sf.net/p/kaldi/code/trunk@3093 5e6a8d80-dfce-4ca6-a32a-6e07a63d50c8
2013-10-15 10:34:15 +00:00
3ff81b7df3
trunk:src/lat: fix for compilation errors (ambiguous int32)
...
git-svn-id: https://svn.code.sf.net/p/kaldi/code/trunk@3092 5e6a8d80-dfce-4ca6-a32a-6e07a63d50c8
2013-10-15 06:11:18 +00:00
Dan Povey
Eric Riebling
Xiaohui Zhang
Ho Yin Chan
Bagher BabaAli
Guoguo Chen
Karel Vesely
Jan Trmal
Haihua Xu
Arnab Ghoshal