microsoft
/
CNTK
зеркало из
1
0
Форкнуть 0
Код Задачи Пакеты Проекты Релизы Вики Активность

update results with NCE and class LM on news. update class lm setup.

This commit is contained in:
kaisheny 2015-05-28 10:17:05 -07:00
Родитель d3b2007147
Коммит 89909cd8a3
3 изменённых файлов: 16 добавлений и 8 удалений
Показать статистику Скачать Patch файл Скачать Diff файл Показать все файлы Свернуть все файлы

12
ExampleSetups/News/setups/lstmlm.gpu.classlm.config.txt
Просмотреть файл

@ -8,8 +8,8 @@ numCPUThreads=4
# command=dumpNodeInfo
#command=train
#command=test
command=writeWordAndClassInfo
#command=writeWordAndClassInfo:train:test
#command=writeWordAndClassInfo
command=writeWordAndClassInfo:train:test
#command=train:test
type=double
@ -30,7 +30,7 @@ nthreads=4
writeWordAndClassInfo=[
action=writeWordAndClass
inputFile=$DataFolder$\$TRAINFILE$
outputVocabFile=$DataFolder$\vocab.txt
outputVocabFile=$ExpFolder$\vocab.txt
outputWord2Cls=$ExpFolder$\word2cls.txt
outputCls2Index=$ExpFolder$\cls2idx.txt
vocabSize=$VOCABSIZE$
@ -117,7 +117,7 @@ train=[
nbruttsineachrecurrentiter=10
# word class info
wordclass=$DataFolder$\vocab.txt
wordclass=$ExpFolder$\vocab.txt
#### write definition
wfile=$ExpFolder$\sequenceSentence.bin
@ -212,7 +212,7 @@ train=[
readerType=LMSequenceReader
randomize=None
# word class info
wordclass=$DataFolder$\vocab.txt
wordclass=$ExpFolder$\vocab.txt
# if writerType is set, we will cache to a binary file
# if the binary file exists, we will use it instead of parsing this file
@ -331,7 +331,7 @@ test=[
readerType=LMSequenceReader
randomize=None
# word class info
wordclass=$DataFolder$\vocab.txt
wordclass=$ExpFolder$\vocab.txt
#### write definition
wfile=$ExpFolder$\sequenceSentence.bin

3
ExampleSetups/News/steps/s1.newscomments.txt
Просмотреть файл

@ -48,3 +48,6 @@ D:\dev\cntkcodeplex\x64\Release\cntk.exe configFile=..\setups\global.config+..\s
# on server
\\speechstore5\userdata\kaishengy\bin\binmay26\cntk.exe configFile=\\speechstore5\userdata\kaishengy\exp\news\setups\global.config+\\speechstore5\userdata\kaishengy\exp\news\setups\lstmlm.gpu.nce.config.txt ExpDir=\\speechstore5\transient\kaishengy\exp\news\s1.lstmlm.comments.2layers command=train train=[SimpleNetworkBuilder=[layerSizes=$VOCABSIZE$:200:200:$VOCABSIZE$]]
# test
# PPL Perplexity = 36.1999
\\speechstore5\userdata\kaishengy\bin\binmay28\cntk.exe configFile=\\speechstore5\userdata\kaishengy\exp\news\setups\global.config+\\speechstore5\userdata\kaishengy\exp\news\setups\lstmlm.gpu.nce.config.txt ExpDir=\\speechstore5\transient\kaishengy\exp\news\s1.lstmlm.comments.2layers test=[modelPath=$ExpFolder$\modelRnnCNTK] command=test

9
ExampleSetups/News/steps/s3.class.lstm.txt
Просмотреть файл

@ -6,10 +6,15 @@ D:\dev\cntkcodeplex\x64\Release\cntk.exe configFile=..\setups\global.config+..\s
# on server
\\speechstore5\userdata\kaishengy\bin\binmay27\cntk.exe configFile=\\speechstore5\userdata\kaishengy\exp\news\setups\global.config+\\speechstore5\userdata\kaishengy\exp\news\setups\lstmlm.gpu.classlm.config.txt ExpDir=\\speechstore5\transient\kaishengy\exp\news\s1.lstmclslm.comments command=train DEVICE=0
# test PPL : 169 with 1 layer of 200 hidden dimension LSTM
\\speechstore5\userdata\kaishengy\bin\binmay27\cntk.exe configFile=\\speechstore5\userdata\kaishengy\exp\news\setups\global.config+\\speechstore5\userdata\kaishengy\exp\news\setups\lstmlm.gpu.classlm.config.txt ExpDir=\\speechstore5\transient\kaishengy\exp\news\s1.lstmclslm.comments test=[modelPath=$ExpFolder$\modelRnnCNTK.0] command=test
# test PPL : Perplexity = 119 with 1 layer of 200 hidden dimension LSTM
\\speechstore5\userdata\kaishengy\bin\binmay28\cntk.exe configFile=\\speechstore5\userdata\kaishengy\exp\news\setups\global.config+\\speechstore5\userdata\kaishengy\exp\news\setups\lstmlm.gpu.classlm.config.txt ExpDir=\\speechstore5\transient\kaishengy\exp\news\s1.lstmclslm.comments test=[modelPath=$ExpFolder$\modelRnnCNTK] command=test
# ---- 2 layers of LSTM --------
# in local wit 2 layers of LSTM
\\speechstore5\userdata\kaishengy\bin\binmay28\cntk.exe configFile=\\speechstore5\userdata\kaishengy\exp\news\setups\global.config+\\speechstore5\userdata\kaishengy\exp\news\setups\lstmlm.gpu.classlm.config.txt ExpDir=\\speechstore5\transient\kaishengy\exp\news\s1.lstmclslm.2layer.comments command=train train=[SimpleNetworkBuilder=[layerSizes=$VOCABSIZE$:100:200:200:$VOCABSIZE$]] DEVICE=1
# test Perplexity = 198.
\\speechstore5\userdata\kaishengy\bin\binmay28\cntk.exe configFile=\\speechstore5\userdata\kaishengy\exp\news\setups\global.config+\\speechstore5\userdata\kaishengy\exp\news\setups\lstmlm.gpu.classlm.config.txt ExpDir=\\speechstore5\transient\kaishengy\exp\news\s1.lstmclslm.2layer.comments test=[modelPath=$ExpFolder$\modelRnnCNTK] command=test
# increase class number to 100
\\speechstore5\userdata\kaishengy\bin\binmay28\cntk.exe configFile=\\speechstore5\userdata\kaishengy\exp\news\setups\global.config+\\speechstore5\userdata\kaishengy\exp\news\setups\lstmlm.gpu.classlm.config.txt ExpDir=\\speechstore5\transient\kaishengy\exp\news\s1.lstmcls100lm DEVICE=0 CLASSSIZE=100