pai/subprojects/frameworklauncher
Yuqi Wang 8449892080
Adjust launcher pom as it is not built (#5803)
2022-09-13 11:31:22 +08:00
..
yarn Adjust launcher pom as it is not built (#5803) 2022-09-13 11:31:22 +08:00
README.md [Hived]: Move Hived from OpenPAI to dedicated repo (#4319) 2020-03-23 20:17:53 +08:00

README.md

Microsoft FrameworkLauncher

FrameworkLauncher (or Launcher for short) is an OpenPAI subproject and standalone component, that is built to orchestrate all kinds of applications on YARN and Kubernetes through the same interface without making changes to the applications themselves.

These applications include but not limited to:

  • Long-Running Services (DeepLearning Serving, HBase, Kafka, etc)
  • Batch Jobs (DeepLearning Training, KDTree Building, etc)
  • Streaming Jobs (Data Processing, etc).

YARN FrameworkLauncher

FrameworkLauncher Natively Supports YARN: YARN FrameworkLauncher.

Note, it ALSO includes scheduling features, such as Topology-Aware Gpu Scheduling.

Kubernetes FrameworkLauncher

FrameworkLauncher Natively Supports Kubernetes: Kubernetes FrameworkController.

Note, it does NOT includes scheduling features, for the scheduling counterpart, we have already splitted it to another dedicated project: HiveDScheduler, and you can directly leverage it with the Kubernetes FrameworkController.