microsoft
/
BotBuilder-RealTimeMediaCalling
зеркало из
1
0
Форкнуть 0
Код Задачи Пакеты Проекты Релизы Вики Активность
BotBuilder-RealTimeMediaCalling extends the BotBuilder to enable bots to engage in Skype audio-video calling. It provides real-time, programmable access to the voice, video, and screen sharing streams of a Skype call. The bot is a direct participant in a Skype 1:1 call.
30 коммитов 34 Ветки 0 Теги 3,6 MiB
C# 99.5%
Batchfile 0.5%
Перейти к файлу
tracyboehrer 1d8596c8fe
Merge pull request #75 from microsoft/users/GitHubPolicyService/b8671532-7c1d-463e-9a39-28c99a3eece1 
Adding Microsoft SECURITY.MD
 		2022-09-08 11:35:43 -05:00
Library/Microsoft.Bot.Builder.RealTimeMediaCalling Upload Media Access API license 2018-10-01 15:24:45 -07:00
Samples Addressed comments 2018-06-28 13:12:18 -07:00
.gitattributes RealTimeMediaCalling SDK and Samples - huebot and MeetingScreenshotsBot 2017-05-10 00:09:45 -07:00
.gitignore Initial commit 2017-05-05 10:41:31 -07:00
LICENSE Initial commit 2017-05-05 10:41:34 -07:00
README.md Develop (#31) 2017-10-17 15:32:27 -07:00
SECURITY.md Microsoft mandatory file 2022-08-31 15:21:41 +00:00

README.md

Real-time media calling with Skype

The Real-Time Media Platform for Bots adds a new dimension to how bots can interact with users by enabling real-time voice, video and screen sharing modalities. This provides the capability to build compelling and interactive entertainment, educational, and assistance bots. Users communicate with real-time media bots using Skype.

This is an advanced capability which allows the bot to send and receive voice and video content frame by frame. The bot has "raw" access to the voice, video and screen-sharing real-time modalities. For example, as the user speaks, the bot will receive 50 audio frames per second, with each frame containing 20 milliseconds (ms) of audio. The bot can perform real-time speech recognition as the audio frames are received, rather than having to wait for a recording after the user has stopped speaking. The bot can also send high-definition-resolution video to the user at 30 frames per second, along with audio.

The Real-Time Media Platform for Bots works with the Skype Calling Cloud to take care of call setup and media session establishment, enabling the bot to engage in a voice and (optionally) video conversation with a Skype caller. The platform provides a simple "socket"-like API for the bot to send and receive media, and handles the real-time encoding and decoding of media, using codecs such as SILK for audio and H.264 for video.

Currently Real-Time Media Platform supports P2P bots only. Conferencing scenarios are not supported.

Developer resources

SDKs

To develop a real-time media bot, you must install these NuGet packages within your Visual Studio project:

Get started

Contributing

This project has adopted the Microsoft Open Source Code of Conduct. For more information see the Code of Conduct FAQ or contact opencode@microsoft.com with any additional questions or comments.

Release notes

  • Due to privacy concerns with bots, conferencing scenarios are currently not supported. Hence we have removed the MeetingScreenShots sample. We are working on enabling this feature again.