Граф коммитов

43 Коммитов

Автор SHA1 Сообщение Дата
Tien Suwandy e7d2e8f64e
beta->main merge (#1165)
* added dispatcher package

* added orchestratorlib

* added orchestrator cli package

* make orchestrator cli installed with bf cli install

* cleaned up dependency, removed extra file

* Update package.json

* Update pnpm-lock.yaml

updated reference to bf-lu in dispatcher to local reference (from "next")

* Addressed review comments

- Updated orchestrator unit test code to use test base model URL, so not to confuse our download stats for customers
- Updated dispatcher and orchestratorlib readme to include internal MS use only text
- Updated dispatcher package.json to exclude oclif
- Removed unecessary files

* fullEmbeddings parameter should be taken from env var

* Added missing scripts per Emilio's PR comment and removed unneeded dependencies from orchestratorlib

* Update package.json

fixed posttest script

* Refactored base model download for testing

* Addressed review feedback

1. Added orchestrator command documentation on main cli package
2. Removed travil.yml from orchestrator package
3. Removed .vscode from orchestrator package
4. Removed "return 0;" from the command sources

* Updated Orchestrator package README

Removed specific install instructions for Linux Ubuntu.

* fixed build errors

* new interfaces and strengthed null-exception logic

* remove composer sampler tests and reduce unnecessary "as"

* Remove functional tests

* updated orchestrator core package, added versions script to orchestrator package

* Removed debugging logs

* correct index.ts

* fixed build error

* remove no longer required tests

* README.md and command documents

* Update orchestrator bf-cli to point at release candidate

* fix eslint issues

* remove the eslint map testcase

* Update pnpm-lock.yaml

* more refactoring to interfaces

* Update pnpm-lock.yaml

* Update orchestratorhelper.ts

removed unecessary comments

* clean up comments

* refactor comments

* more comment refactoring

* removing unused imports

* more interfaces and others

Co-authored-by: Hung-chih Yang <hunyang@microsoft.com>
Co-authored-by: Dave Taniguchi <daveta@microsoft.com>
Co-authored-by: daveta <6182197+daveta@users.noreply.github.com>
2021-04-01 14:05:01 -07:00
Chris McConnell 8dc6ffe69b
Fix bug with npm scoped packages (#1170)
* Scoped packages bug
Fix bug where scoped packages in node would have all of their imported
assets removed.

* Resolve relative negative patterns.

* Add test files.

Co-authored-by: Chris McConnell <chrimc>
2021-03-31 16:17:54 -07:00
Chris McConnell b9b652d0d0
Fixes #1149 (#1162)
Adds tests to make sure that merge works properly when getting failures.

Co-authored-by: Chris McConnell <chrimc>
2021-03-29 12:51:19 -07:00
Chris McConnell 5f35a0e692
Add support for verifying $policies. (#1126)
* Add support for verifying $policies.

* Remove unneed package reference.

Co-authored-by: Chris McConnell <chrimc>
Co-authored-by: Emilio Munoz <emmunozp@microsoft.com>
2021-02-19 16:01:52 -08:00
Emilio Munoz 3b12e37f4b
Cleaning component governance alerts (#1118)
* Cleaning component governance alerts

* Increasing pnpm version

* Setting pnpm to 4.9.3

* Setting pnpm to 4.14.4
2021-02-17 09:38:24 -08:00
Chris McConnell 3725565994
Support wild cards in nuget versions for dialog:merge (#1096)
* Support wild cards in nuget versions

* Address review feedback and add some comments.

* Add const
2021-01-27 11:09:28 -08:00
Chris McConnell e06f70f77c
Lowercase package names (#1073)
* Lowercase package names
Mac/linux dotnet lowercases all package names.

* Address review feedback.

Co-authored-by: Chris McConnell <chrimc>
2020-12-10 12:22:11 -08:00
Josh Gummersall bf8d2db79f
Move to npm run test in vscode launch config (#1013)
* Move to npm run test in vscode launch config

* Fix dialog build for non-ES friendly packages

AJV v7 beta has better support for ES style import but is not a trivial
upgrade to make.

This commit also upgrades `tslib` across all packages to maintain
consistency with latest typescript version.
2020-10-12 13:48:49 -07:00
Josh Gummersall 18fba61465
Shared root tsconfig.json with overrides (#1003)
* Shared root tsconfig.json with overrides

Also move test hook to repo root and reference in mocha.opts

* Fix dialog compilation issues

* Luis compilation issue fixes

* Chatdown test fixes

* Luis test fixes

* Fix dialog verify test

* Bump ts-node and clean up test tsconfigs
2020-10-07 17:32:17 -07:00
Emilio Munoz e3d7c37c2d
Removing Dispatcher from master (#931)
* Removing dispatcher from master

* Updating rush.json

* Changes to lock.yaml
2020-08-11 15:41:05 -07:00
Axel Suárez 5a7c9736ae
updating lodash (#927)
* updating lodash

* adding rush lock
2020-08-07 12:36:18 -07:00
Emilio Munoz 52d49170b1
Removing request from cli (#913)
Co-authored-by: Vishwac Sena Kannan <vishwack@hotmail.com>
2020-07-29 10:34:41 -07:00
Chris McConnell 547c305cf8
Support merging .uischema files (#852)
* Topo sort in progress.

* Update sort.

* Working sort

* Breadth first sort.

* Move to building component tree.

* Normalize slash in tests.

* Update documentation

* Add --nugetRoot switch.

* Add $package to app.schema.

* Intermediate progress to switch machines.

* Update to move machines.

* Update to offical URLS.
Upgrade json-ptr to 1.3
Full uischema test examples.

* Oracles and working tests.

* All csproj tests working

* All tests work.

* Fix packages.config.

* Add copying C# asset files into output

* Renable test

* Order uischema keys and update oracles.

* Move write outside of loop.

* Add missing .uischema files.

* Use / in paths

* Update documentation.

* Update docs.

Co-authored-by: Tom Laird-McConnell <tomlm@microsoft.com>
2020-07-14 18:41:41 -07:00
BruceHaley 86f0302d4b
Publish cobertura code coverage to codecov.io (#850)
* Introduce jest

* Install jest

* Add jest.config.js

* Rename to jest.config.json

* Fix dir workspace

* Fix dir workspace

* Install coveralls earlier

* Add run mocha lcov reporter

* Disable jest --coverage

* Remove path "node_modules/.bin/" from jscover command

* Try rush report-coverage

* Ren script report-coverage to reportcoverage

* Try "coverage", look for .coverage files

* Fix Copy .coverage files

* Fix rush coverage

* Add rush report -v

* Add rush reportcoverage

* Separate rush coverage and rush report

* Add set COVERALLS_REPO_TOKEN

* Show env vars

* Use var TokenForCoveralls to set env var

* Send coverage to ../../coverage/commandcoverage.lcov

* Add Create coverage folder

* Mocha redirect without reporter spec

* Return to reportcoverage

* Publish coverage artifacts

* Fix copy files

* Try 2 reporters

* Add .nycrc files

* Restore report scripts

* Add dependency nock

* Dependencies tweaks

* Dummy change.

* Set up codecov reporting

* Fix codecov url

* Fix codecov target url again

* Add task to Populate Code Coverage tab

* Add coverage url build tag

* Clean up .yml

* Clean up .yml 2

* clean up scripts

* Cleanup 3

* Cleanup 4

* Set script "coverage": "nyc npm run test"

* Add html reporter back

* Remove nock from package.json files

* Revert "Remove nock from package.json files"

This reverts commit 3db34f060d.
2020-06-29 15:35:05 -07:00
Chris McConnell 9d290ea5f2
Update dialog:merge tests around projects (#784)
* Updating tests.

* Merge branch '4.9' into chrimc/test
Add nuget semver.

* Change test to avoid checking path parts.

* Follow package.json dependencies.

* Fix merge match.
2020-05-18 14:31:44 -07:00
Chris McConnell d2e756aed6
Remove $id from schema:merge and enable authoringKey in luis:build (#744)
* Remove $id from schema:merge.
Enable authoringKey config to work for luis:build.

* Fix case issue in test.
2020-05-04 14:15:48 -07:00
Chris McConnell b91b3a8d00
CLI consistency of dialog:verify with dialog:merge, luis:build with config (#741)
* Initial check-in.

* Allof Working.

* Move definitions local.

* Launch to sdk.

* Everything working for new merge.

* schema: working

* Working except that allof expansion does not expand
local references.

* Simplification and some analysis working.

* Add extends.

* Everything working.

* Update help

* Fix typo

* Expand allOf and validate final schema.

* Missing as warning and validate schema.

* Update tests.

* Update test to pass on server.

* Normalize paths.

* Check normalize for mac

* Update for mac paths and lint.

* Address review comments.

* Update documentation and fix $id bugs.

* Address review commehts

* Fix bad merge.

* Documentation and update verify to work with latest
schemas.

* Fix extra import.

* Luconfig reflects CLI args.
Added deleteOldVersion to cli.
Update config:set:luis to include authoringKey.

* Address lint issues.
2020-05-02 17:09:11 -07:00
Chris McConnell c0edcb5c58
Update merge for better composer support, error checking, compactness and correctness (#737)
* Initial check-in.

* Allof Working.

* Move definitions local.

* Launch to sdk.

* Everything working for new merge.

* schema: working

* Working except that allof expansion does not expand
local references.

* Simplification and some analysis working.

* Add extends.

* Everything working.

* Update help

* Fix typo

* Expand allOf and validate final schema.

* Missing as warning and validate schema.

* Update tests.

* Update test to pass on server.

* Normalize paths.

* Check normalize for mac

* Update for mac paths and lint.

* Address review comments.
2020-05-01 11:03:19 -07:00
Fei Chen 8518fb1a09
cross train CLI (#690)
* add qna cross training

* Revert "remove cross-train cli related changes and only keep the api"

This reverts commit ab1fb84df2.

* call qnaCrossTrain

* add qna cross traini

* expose function

* optimize and add more corner test cases

* rename crossTrainer class

* remove cli code pieces and optimize tests

* move cross-train.ts to lu folder

* optimize function headers and naming

* typo: dialogname to dialogName

* add more test cases

* remove unused '

* add cross-train.ts cli file for test convenience and will remove it once review done

* fix bugs

* trigger ci

* update qna cross train based on feedbacks

* add config path parameter to specify the config file

* fix posttest failure

* remove dup utterances in interuption intents

* remove dup 1

* optimize all de-dup logic

* resolve all feedbacks

* add test cases to test dedup functions

* fix tslint errors

* add more friendly description for config CLI parameter

* fix config full path issue and remove uncessary loop validation

* move cross train CLI to a new package named cross-train

* fix build error in CI validation

* add missing package in package.json

* remove unused file

* fix typo

* optimize dedep logic and resolve feedbacks

* adjust test cases

* support qna source, id, prompts reconstruction in cross training

* typo: interuption to interruption

* move CLI test cases from lu to cross-train

* adjust test cases of cross-train CLI to make it more readable

* update some function to support load file content

* support auto detect config based on root dialog and file system

* update some code style

* update some ref

* optimize config parameter

* add fileHelper.ts

* fix typo

* remove semicolon

* add the object

* change the value

* make all the path the same parttern

* optimize

* adjust test cases to use file name as id

* fix typo

* update fileHelper.ts

* fix config id issue

* update pnpm lock

* update pnpm

* fix test cases

* fix tslint

* optimzie cross train to care only trigger intents and allow empty trigger intent or dialog

* merge PR 706 and adjust test cases to cover more corner cases

* support multi trigger intents point to same lu file

* optimize config structure

* optimize config object parser

* fix bug

* adjust pnpm

* fix minor typo

* docs.

* remove cross-train from top level command and add it to luis command

* fix test

* add cross train in qna maker cli

* support to write corsstrained recognizer

* support crosstrained recognizer in qnamaker

* refine the write dialog logic to support crosstrained dialog

* update docs

* fix crosstrained recognizer configuration issue

* remove patterns from lu in crosstrained qna queations

* fix test case

* fix tslint

* fix comments of reviewer

Co-authored-by: leilzh <leilzh@microsoft.com>
Co-authored-by: Vishwac Sena Kannan <vishwack@hotmail.com>
Co-authored-by: Vishwac Sena Kannan <vkannan@microsoft.com>
2020-05-01 20:51:11 +08:00
Hongyang Du (hond) 0c3f1041aa
mslg CLI (#644)
* init mslg

* init

* init commands

* init

* init

* init

* init

* align with the lastest doc

* add collect api

* update

* update

* update

* update

* add doc

* stash

* update

* update

* init

* init

* update

* update

* update

* update

* add tests

* update

* update

* update

* modify path operator

* update

* add more tests and fix bugs

* fix error

* update lg package

* rename folder lg-cli to lg and revert translate key

* adjust translate test cases

* updates based on review.

* doc updates

* Adding commands to readme

* update

Co-authored-by: Fei Chen <feich@microsoft.com>
Co-authored-by: Vishwac Sena Kannan <vishwacsenakannan@ALLISONT6-PROBK.northamerica.corp.microsoft.com>
Co-authored-by: Emilio Munoz <emmunozp@microsoft.com>
Co-authored-by: Vishwac Sena Kannan <vishwack@hotmail.com>
2020-04-27 10:53:16 +08:00
Chris McConnell f65dcf426d
Fix bug in luis:build and support operations in generator (#641)
This is in preparation to move this to experimental and out of CLI.
Fix a bug in luis:build where --dialog generates $type instead of $kind.
Redo how the generator works so that less is in the code and more in the templates. In particular templates can generate the default $entities and include other templates.
Added templates to support manipulating enum arrays including add/remove/clear/show.
Added hash codes to all generated files.

Co-authored-by: Chris Anderson <chrande@microsoft.com>
Co-authored-by: Emilio Munoz <emmunozp@microsoft.com>
2020-04-03 13:47:30 -07:00
Vishwac Sena Kannan 2d2595737c
[qnamaker] Export as well as replace support for .qna format (#695)
* fix

* support stdin for .qna content

Co-authored-by: Vishwac Sena Kannan <vishwacsenakannan@MININT-KG5GAD9.fareast.corp.microsoft.com>
2020-03-31 16:14:16 -07:00
Emilio Munoz eef8841325
Emimunoz/fix composite luis (#662)
* Replace cognitive services with node-fetch on import

* Adding missing lock-yaml.file
2020-03-12 11:22:10 -07:00
Fei Chen 7270fc1cc1
update luis authoring package version in lu package (#649)
* update luis authoring package version to support new lu features

* fix json property issue when switching to new luis API version
2020-03-10 13:49:58 +08:00
Chris McConnell f5dea03898
Switch to chrimc62 packages. (#642) 2020-03-06 16:34:59 -08:00
Chris McConnell 076f470994
Switch to using ${} instead of @{} (#618)
* Switch to using ${}

* Remove unused dependency.
2020-02-28 13:47:10 -08:00
Fei Chen 49f1871797
[Lubuild] fix multiple bugs: case sensitive issue, default version issue and exception not throw out issue (#576)
* fix case issue of utterances and patterns

* remove lower function for entities

* adjust test cases

* use a better solution to compare utterances

* add tests to verify the fixes

* move new added tests to luis package from lu package

* add test cases for luConfig parameter in lubuild CLI

* fix error not throw out bug

* resolve comments of CLIError

* remove uncessary semicolon

* Updates and fixes

* Updates

* updating tests.

* Updates for PR feedback, fix settings out path

* updates

* fix build errors

* fix command parameter issue in test cases

* fix tslint errors

* remove lubuild.js which is not necessary

* fixing bad merge

* fix tslint and expose more in index.js and composerindex.js

* remove lubuild module in index.js

Co-authored-by: Emilio Munoz <munoz_emilio@hotmail.com>
Co-authored-by: Vishwac Sena Kannan <vishwack@hotmail.com>
2020-02-27 13:11:36 +08:00
Emilio Munoz 4b54b04507
Spliting commands from lu-cli to luis and qnamaker (#581)
* Spliting commands from lu-cli to luis and qnamaker

* Fix linting errors

* Delete lu-cli, move tests to corresponding packages
2020-02-18 14:50:12 -08:00
Emilio Munoz 6901a67796
LU CLI separation from lib (#568)
* LU CLI separation from lib

* Updating test with latest master
2020-02-12 16:36:04 -08:00
Emilio Munoz fe3b112de8
Silent ci install (#551)
* Fixing CI telemetry prompting

* Adding lock file changes

* Fixing tests to detect CI

* Modifying logic to favor existing config file

* Removing condition on function
2020-02-11 10:50:07 -08:00
Chris McConnell eb0a6a69c6
Update merge to include string in union and not (#522)
overwrite title.
2020-02-04 15:19:18 -08:00
vishwacsena 489e4d9c80
Add multi-turn support in qna file format (#508)
* filter position and not require markdown

* Fixing qnaSection.js

* Cross train with tests

* Import support in .qna.

* getting tests to pass

* multi-turn support in qna file format

* fixing multi-turn context-only

* Finalizing multiturn payload

* Updating multi-turn support.

* support for ID in .qna

* Support for parsing qna source via app description

* removing diskio from helper.

* doc updates

* updates for multi-turn flat

* multi-turn in JsonToQnA

* Fixing existing tests.

* fixing tests

* adding multi-turn tests

* finalizing

* more tests

* PR feedback.

* getting tests to pass
2020-01-30 14:34:46 -08:00
Hung-chih Yang aefb0e28d8
Hunyang/dispatcher (#343)
* initial dispatcher check-in

* inital dispatcher check-in

* commit before class file naming convention change

* class filename naming convention

* revise L1L2 logic, refactor UnitTest timeout logic

* refactor lu vs. columnar names, and  revise README.md

* Use formal bf-lu 4.6.0 release

* bf-lu verstion to 1.0.0 and recommended tslint

* minor README.md revision

* tslint compatibility revision

* refactor unit test flag and add lint commands

* revised based on Emilio comments .1

* index.ts, confusion matrix metrics, resources

* remove bf-lu from dev

* revise index.js location in package.json

* CrossValidator output, main entry in package.json

* Fixing build sequence to export lu before being used as dependency

* Setting build sequence

* Setting build secquence

* refactoring

* Predictor, Tester, and EntityAnnotatedCorpus data

* unit tests for EntityAnnotatedCorpus data

* Changes to match rush requirements

* Setting sequence to rush.json

* Update lock.yaml

* Delete main package.json

* Fixing versions in  package.json

* Add Reporter classes

* removed unused comments per Dave's review

Co-authored-by: Emilio Munoz <munoz_emilio@hotmail.com>
Co-authored-by: Christopher Anderson <chrande@microsoft.com>
2020-01-30 11:26:06 -08:00
JSpru 096a1fd13c
Upgrade azure auth and runtime clients (#497)
* Upgrade azure auth and runtime clients and adjust tests and src ode accordingly

* Fix lint issues

* trigger build

* Upgrade @azure/cognitiveservices-luis-authoring to v4.0.0-preview.1

Co-authored-by: Emilio Munoz <munoz_emilio@hotmail.com>
2020-01-29 02:15:37 -08:00
Christopher Anderson bf9fe9d489
build: update rush 5.19, pnpm 4.8 (#493) 2020-01-24 21:20:09 -08:00
Chris McConnell cf33b16e1b
Update documentation and switch to bf luis:build (#469)
* Updated documentation.

* Revert build.ts

* Have generator create missing directories.
Change how LUIS related files are organized and scripted to support
bf luis:build.

* Update readme.
2020-01-10 12:17:11 -08:00
Emilio Munoz 129aee47c8
Adding Plugins command group to manage plugins at runtime (#455)
* Adding Plugins command group to manage plugins at runtime

* Fixing docs

* Deleting usage from plugins readme

* Adding dialog plugin to cli
2019-12-26 13:37:53 -08:00
JSpru bef1b2f154 Call posttest script in build, fix lint issues (#451)
* Call posttest script in build, fix lint issues

* Adding custom cmd for posttest, fix lint issues
2019-12-20 14:56:43 -08:00
Chris McConnell 6c531fc13d
Switch to public versions of botframework-expressions and (#437)
botbuilder-lg.
2019-12-17 23:07:22 -08:00
Christopher Anderson 6c63b41b7e ci: publish artifacts (#396)
* build: add version script

* build: add error message to rush

* ci: add artifact publishing

* ci: ensure doesn't run version on PR

* ci: just use version to detect whether to publish

* ci: fix variable syntax

* ci: fix job name

* build: add rimraf to lu/qnamaker

* ci: change to use build number

* ci: fix syntax

* ci: typo

* ci: syntax error

* ci: fix syntax error

* ci: fix syntax error

* ci: fix syntax error

* ci: fix syntax error...

* ci: fix syntax error

* ci: fix syntax error

* ci: fix syntax error

* ci: fallback to buildVersion

* ci: fix buildId

* ci: try a different syntax

* build: remove parallelism because deadlock

* fix: do not hang on non-tty

* revert: revert the tty fix

* build: remove doc gen in CI for time being

* build: remove docs from version
2019-12-02 10:33:55 -08:00
JSpru 50358cf229
317 luis application query (#388)
* Initial commit

* Adding luis:application:query cmd

* Adding tests for query cmd

* Update example code

* Reinstalling azure-cognitiveservices-luis-runtime dependency with rush
2019-12-02 10:06:57 -08:00
Christopher Anderson ecbfe12015 chore: fix dialog debugging (#387) 2019-11-22 17:40:26 -08:00
Christopher Anderson 4c685ed3c8 chore: swap to rush/pnpm & azure-pipelines.yml (#381)
* wip: added rush to command and chatdown

* chore: remove lerna

* chore: add rush

* chore: fix build & test for rush

* chore: add azure-pipeline [WIP]

* fix: use correct rush package in ci

* chore: bump timeouts on tests

* chore: disable linting on tests where it doesn't work

* chore: implicityAny enabled on tests for config

* chore: disable flakey test

* chore: disable parallelism on coverage

* chore: use Node 12

* chore: rearrange ci steps

* chore: swap to windows

* chore: disable bad tests

* chore: allow warnings

* chore: disable reporting coverage to coveralls

* chore: address dialog changes

* chore: add pr and cron triggers

* docs: update contributing docs

* chore: fix branches in azure-pipelines.yml

* fix: types

* fix: flakey test
2019-11-22 14:38:35 -08:00