mozilla
/
marian
зеркало из https://github.com/mozilla/marian.git
1
0
Форкнуть 0
Код Задачи Пакеты Проекты Релизы Вики Активность
2 552 коммитов 37 Ветки 7 Теги 41 MiB
Граф коммитов

2552 Коммитов

Автор SHA1 Сообщение Дата
Cédric Rousseau 4fd2360918 Fix CUDA+MSVC incompatibility with Boost.Preprocessor 2018-09-05 15:42:16 +02:00
Cédric Rousseau 78dd2a2d59 Fix unresolved external due to a removed #include directive 2018-09-05 13:16:53 +02:00
Cédric Rousseau fbb221e995 Fix mismatched class/struct forward declarations 2018-09-05 11:58:09 +02:00
Cédric Rousseau 5d41dff700 Fix fatal error C1019: unexpected #else 2018-09-04 18:03:48 +02:00
Cédric Rousseau 112118fce3 Fix error : identifier "CUDA_FLT_MAX" is undefined in device code 2018-09-04 17:49:30 +02:00
Cédric Rousseau 6370ea27d6 Fix marian::Backendn marian::cpu::Beckend and marian::gpu::Backend conflicts 2018-09-04 17:36:30 +02:00
Cédric Rousseau 5785380fa9 Fix Warning: D9002: ignoring unknown option '-m64' 2018-09-04 17:00:44 +02:00
Cédric Rousseau 0659b2c5d5 Build in Release, with improved debug info 2018-09-04 16:58:49 +02:00
Cédric Rousseau 1ab5f0ccb7 Fix VS compiler flags 2018-09-04 16:44:04 +02:00
Cédric Rousseau 5fae8a0da7 Fix Cuda error : Unsupported Visual Studio Version Error 2018-09-04 16:38:28 +02:00
Cédric Rousseau 29dfffc93c Adding scripts and readme file 2018-09-04 16:34:21 +02:00
Marcin Junczys-Dowmunt 8856ae9c89 protect transformer.h from autoformat 2018-08-28 14:50:03 +02:00
Marcin Junczys-Dowmunt 0d1929727a fix transpose operator 2018-08-28 01:49:37 -07:00
Marcin Junczys-Dowmunt b69ad3ce39 add costType to alignment training 2018-08-27 17:55:43 +02:00
Marcin Junczys-Dowmunt c1f0297082 split guided alignment for synchronous sgd 2018-08-27 14:34:44 +02:00
marcinj aa4cbc6c71 add dims 2018-08-26 20:35:10 +02:00
marcinj 8549e55f60 fix alignment in scorer, set alignment layers 2018-08-26 20:29:31 +02:00
marcinj 5c90a1d9a8 working guided alignment and alignment computation during translation 2018-08-26 17:58:03 +02:00
marcinj 3e51daf73e Make guided alignment work again for RNN models 2018-08-26 14:12:02 +02:00
marcinj 9c21903694 remove spurious file 2018-08-26 07:57:43 +02:00
Frank Seide 3a9e586f14 Merged PR 4653: rename 'costs' to 'pathScores' and 'probs' to 'logProbs' where appropriate 
This PR is to correct certain variable names. It renames 'costs' to 'pathScores' and 'probs' to 'logProbs' where appropriate
 2018-08-23 22:32:58 +00:00
Frank Seide 9a9e7c1be9 merged from master 2018-08-23 15:18:28 -07:00
Frank Seide 9d571fb073 Merged PR 4652: add missing 'override' specifiers to virtual overrides 
This PR adds 'override' specifiers to all virtual function override.

This was done using a nearly automatic process based gcc's `-Wsuggest-override` option and some shell scripting, plus about 5 manual fixes.

Ideally we could just add `-Wsuggest-override` to `set(CMAKE_CXX_FLAGS_RELEASE...` in `CMakeList.txt `, but unfortunately that will break the build due to pervasively missing overrides in Boost.
 2018-08-23 22:08:15 +00:00
Frank Seide 566c2686b0 renamed costs to pathScores were appropriate 2018-08-23 12:53:28 -07:00
Frank Seide 690c7ab7f5 renamed 'probs' to 'logProbs' where appropriate 2018-08-23 12:07:43 -07:00
Frank Seide 4797113827 added more missing overrides, in 3rd_prty and server 2018-08-23 11:43:14 -07:00
Frank Seide 4f664d0319 added missing override specifiers 2018-08-23 11:32:49 -07:00
Martin Junczys-Dowmunt 87c98ccdb0 Merged PR 4622: Merge with public master 
This is another update to public master, changes include:

* Alignment and attention matrix output for decoder and scorer
* First steps at refactoring command line options to get rid of boost::options
* Make stand-alone decoder decode line by line.

External regressions tests all pass, there will be more refactoring once we got rid of boost::options.

Related work items: #90261, #90262
 2018-08-20 23:48:34 +00:00
Marcin Junczys-Dowmunt 64dc165586 merge with public master 2018-08-20 15:34:46 -07:00
Frank Seide bac7f6d6d8 Merged PR 4617: refactoring State::select() function to support Transformer 
This PR is mainly about merging the currently separate implementation of TransformerState::select() with the other two select() versions. The difference between Transformer (batch-major) and the other (RNN, hard-att: time-major) is now reflected in the lowest-level function, State::select().

This PR includes several steps:
 * const correctness
 * streamlining the DecoderState::select() functions
 * re-implementing the original TransformerState::select() code inside State::select(), and more efficiently using reshaping

It also includes a handful of fixes:
 * hard-att did not seem to setPosition()
 * a few warnings (size_t -> int).
 2018-08-20 22:25:01 +00:00
Frank Seide 70417fa306 fixed Visual Studio projects to actually build the EXE 2018-08-20 14:03:43 -07:00
Frank Seide dc881d824a removed old (incorrect) VS files 2018-08-20 13:22:18 -07:00
Frank Seide 6450165a7b renamed selectHyps() back to select() 2018-08-20 13:00:10 -07:00
Frank Seide 1b400c1e02 Merged PR 4609: undo auto-formatting of transformer.h; add experimental VS Project 
This undoes the auto-formatting of transformer.h, which makes it expensive to merge master into ongoing research source code.

These changes consist mostly of line breaks, spacing, and moving line-end comments back. There is no functionality change; the code should compile to the same binary,

This PR also adds an experimental Visual Studio Project, which aims at allowing to use VS for editing, which has several time-saving advanced features compared to VS Code or plain text editors.
 2018-08-20 19:53:22 +00:00
Frank Seide 666935de86 refactored State::select() to eliminate the expanded copy of selIdx[] 2018-08-20 12:36:19 -07:00
Frank Seide 7a7e5ab864 refactored batch-major select() down to State::select() where it belongs 2018-08-20 11:55:20 -07:00
Frank Seide e723425804 some const-correctness; regularized DecoderState creation; fixed a few warnings 2018-08-20 11:21:56 -07:00
Frank Seide b5d2d131d3 temporarily renamed DecoderState::select() to selectHyps and used 'override' specifier to ensure to find all instances 2018-08-20 10:45:16 -07:00
Frank Seide 1d0611d48a added comments; refactored State::select(); refactored ScorerWrappet::step(); fixed a warning 2018-08-20 10:33:41 -07:00
Frank Seide af625ca8c0 undid auto-format, which breaks merging with my ongoing research work 2018-08-19 16:53:23 -07:00
Frank Seide a8ad3a028e added VS Solution and Project 2018-08-19 16:18:32 -07:00
Roman Grundkiewicz 06e931fa53 Remove missing function declaration 2018-08-19 15:08:39 +01:00
Roman Grundkiewicz b73448aab7 Extract CLI helper functions to a separate file 2018-08-19 14:59:32 +01:00
Marcin Junczys-Dowmunt ac0cdc8502 add build type Nonative 2018-08-17 17:39:40 -07:00
Roman Grundkiewicz 12b30aaaf5 Clean option descriptions 2018-08-17 13:32:03 +01:00
Roman Grundkiewicz 200045c57a Update CHANGELOG 2018-08-17 13:16:06 +01:00
Roman Grundkiewicz 0088b984c8 Do not skip EOS in alignments 2018-08-17 12:47:37 +01:00
Roman Grundkiewicz 50f7526005 Split ScoreCollector into header and source files 2018-08-17 11:14:53 +01:00
Roman Grundkiewicz 044e755674 Remove unused parameter 2018-08-17 10:55:36 +01:00
Roman Grundkiewicz cc8cc4a31d Unify soft alignments in decoder and scorer 2018-08-17 10:49:48 +01:00