Jun 30, 2023

Sokovan Container Orchestrator for Accelerated AI:ML Workloads and Massive scale GPU Computing

    신정규

    창업멤버 / 연구원 / CEO

    김준기

    창업멤버 / CTO

Jun 30, 2023

Sokovan Container Orchestrator for Accelerated AI:ML Workloads and Massive scale GPU Computing

    신정규

    창업멤버 / 연구원 / CEO

    김준기

    창업멤버 / CTO

Overview

Sokovan is a Python-based container orchestrator that addresses the challenges of running resource-intensive batch workloads in a containerized environment. It offers acceleration-aware, multi-tenant, batch-oriented job scheduling and fully integrates multiple hardware acceleration technologies into various system layers. It consists of two layers of schedulers. The cluster-level scheduler allows users to customize job placement strategies and control the density and priority of workloads. The node-level scheduler optimizes per-container performance by automatically detecting and mapping underlying hardware accelerators to individual containers, improving the performance of AI workloads compared to Slurm and other existing tools. Sokovan has been deployed on a large scale in various industries for a range of GPU workloads, including AI training and services. It helps container-based MLOps platforms unleash the potential of the latest hardware technologies.

Speakers:
Jeongkyu Shin
Joongi Kim

슬라이드 요청

도움이 필요하신가요?

내용을 작성해 주시면 곧 연락 드리겠습니다.

문의하기

본사 및 HPC 연구소

서울특별시 강남구 선릉로 577 CR타워 8층

© Lablup Inc. All rights reserved.