Tag : backend.ai
Backend.AI Installation Tutorial - 1
By Jongmin Kim- Backend.AI Installation Tutorial - 1
- Backend.AI Installation Tutorial - 2
25 June 2024
Backend.AI Installation Tutorial - 2
By Jongmin Kim- Backend.AI Installation Tutorial - 1
- Backend.AI Installation Tutorial - 2
25 June 2024
Slipstream: How to Win the AI Race - Jeongkyu Shin (Keynote 1)
By Jeongkyu ShinWith the proliferation of generative AI, prohibitive development and adoption costs are becoming a major barrier to AI democratization. How can we lower the cost threshold and increase efficiency and ease of use when using or developing deep learning-based solutions? We introduce Slipstreaming, an approach from Rableup and Backend.AI to achieve massive performance and efficiency while standing on the shoulders of giants and masking all complexity.
About the presenter
- CEO, Lablup
- ML/DL Google Developers Expert
- Ph.D in Statistical Physics (complex systems / neuroscience) at POSTECH
29 November 2023
Screaming AI from somewhere between hardware and software - Joongi Kim (Keynote 2)
By Joongi KimA look back at the design philosophy and evolution of Backend.AI from an idea to provide a reproducible computational environment for researchers to an AI development and services platform for large enterprises. We explore why we made different choices than other similar products in the industry, and how those choices have delivered value to Lablup's business and customers.
About the Presenter
- Ph.D., Computer Science, KAIST (High Performance Network Systems)
- Open source ecosystem contributor including Python (CPython, aiomonitor, aiohttp, aiodocker, pyzmq, DPDK, iPuTTY, etc.)
29 November 2023
[Track1_1] Backend.AI Enterprise Customer Support ABC - Jonghyun Park (Lablup)
By Jonghyun ParkBackend.AI's enterprise support services mean an ongoing partnership with you, not just a product installation. From scheduling the installation, we work closely with your sales and devops teams to provide customized installation and service optimization. After the installation is complete, we provide ongoing support that is responsive to customer feedback and needs, starting with user guide sessions. This presentation will provide an introduction to how we interact with Backend.AI enterprise customers.
About the presenter
- Director of Research, Lablup
- Ph.D., Department of Forensic Physics (Single Molecule Biophysics)
29 November 2023
[Track1-2] Changing UI/UX Design: Problem Recognition and New Directions - Sujin Kim (Lablup)
By Sujin KimWe will analyze the main problems with the existing WebUI and where the user experience needs to be improved. We'll discuss why the problems need to be solved, what needs to change and how to improve them, and how the UI/UX has changed, with a particular focus on the session launcher UI/UX. Finally, we'll make some predictions about how WebUIs will change in the future.
About the presenter
- Software Engineer, Lablup
29 November 2023
[Track1-3] GenAI on Backend.AI- Kyujin Cho (Lablup)
By Kyujin ChoBackend.AI's powerful giant AI model development technology is meeting GenAI to create the ultimate AI service capability. This session will introduce how the model serving capabilities introduced in Backend.AI 23.09 have been extended to the operational side of GenAI, in terms of technology, convenience, and fate resource savings. This will be a session that will inspire you with the many innovations that can be created by combining efficient operation of GPU resources with automation of GenAI services and fine-tuning.
About the presenter
-Software Engineer, Lablup
29 November 2023
[Track1-4_1] How developers collaborate with octocat without a planner - Jihyun Kang (Lablup)
By Jihyun KangLablup doesn't have a planner position, but we're still releasing a lot of products and new features, including Backend.AI. We'll talk about the many trials and errors that led us to use GitHub, a platform that developers are familiar with. In particular, we'll talk about how we ended up using GitHub Projects, how most of our development infrastructure is open source, when we tried to adopt Jira and why we stopped, and the underlying issues of scaling the company. We'll also talk about how we use the most important GitHub Projects, their shortcomings, and how we're using GitHub Actions and Labels to solve them.
About the presenter
- Software Engineer, Lablup
29 November 2023
[Track1-4_2]How developers collaborate with octocat without planners - Sion Kang (Lablup)
By Sion KangLablup doesn't have a planner position, but we're still releasing a lot of products and new features, including Backend.AI. We'll talk about the many trials and errors that led us to use GitHub, a platform that developers are familiar with. We'll cover how we came to use GitHub Projects, how most of our development infrastructure is open source, when we tried to adopt Jira and why we stopped, and the scaling issues of our company. We'll also talk about how we use the most important GitHub Projects, their shortcomings, and how we use GitHub Actions and Labels to solve them.
About the presenter
- Software Engineer, Lablup
- GitHub Campus Expert29 November 2023
[Track2-6] Support for high-speed NFS storage integration - Sang Hun Lee (Lablup)
By Sang Hun LeeHigh-speed storage is often used to train AI with large amounts of data or to quickly deploy AI models. Backend.AI supports a lot of high-speed storage, and I'd like to share how I worked on integrating vast data storage.
About the presenter
- Software Engineer, Lablup
29 November 2023
[Track2-7] Backend.AI and AI Semiconductors - Sanghyeon Seo (Lablup)
By Sanghyeon SeoWe'll look at the accelerator plugin structure of Backend.AI, the accelerator plugins developed to date (Mock, CUDA, CUDA Enterprise, ROCm, TPU, IPU, ATOM, Warboy), additional accelerator plugins currently in development (SAPEON, HyperAccel), and discuss what needs to be done on the AI semiconductor side.
About the presenters
- Software Engineer, Lablup
29 November 2023
Sokovan Container Orchestrator for Accelerated AI:ML Workloads and Massive scale GPU Computing
By Jeongkyu Shin, Joongi KimSokovan is a Python-based container orchestrator that addresses the challenges of running resource-intensive batch workloads in a containerized environment. It offers acceleration-aware, multi-tenant, batch-oriented job scheduling and fully integrates multiple hardware acceleration technologies into various system layers. It consists of two layers of schedulers. The cluster-level scheduler allows users to customize job placement strategies and control the density and priority of workloads. The node-level scheduler optimizes per-container performance by automatically detecting and mapping underlying hardware accelerators to individual containers, improving the performance of AI workloads compared to Slurm and other existing tools. Sokovan has been deployed on a large scale in various industries for a range of GPU workloads, including AI training and services. It helps container-based MLOps platforms unleash the potential of the latest hardware technologies.
Speakers:
Jeongkyu Shin
Joongi Kim30 June 2023
Beyond AI
By Jeongkyu ShinBeyond AI - Jeongkyu Shin
Context
- We will share with many people the perspectives of developers, researchers, and platform company representatives about the changes in the deep learning field over the past two years and the changes that will occur over the next two years.
Speaker
- CEO, Lablup
- ML/DL Google Developers Expert
- POSTECH Doctor of Physics (Complex Systems Physics/Computational Brain Science)
1 December 2022
[Naver Cloud] Hiperscale Enterprise AIOps Platform, Backend.AI
By Joongi KimBackend.AI is a deep learning platform that helps execute artificial intelligence model development and high-performance computing by efficiently utilizing cloud and data center computing resources.
It uses GPU partitioning virtualization for containers to create an orchestration layer optimized for high-density, highly integrated workloads, enabling the execution of large-scale computational workloads.
This presentation will guide you through the development background of Backend.AI, its technical features and advantages, and how you can utilize Backend.AI on the Naver Cloud Platform.
13 July 2022
[TalkIT] Why is MLOps Necessary, and What Does it Consist of? feat. 2022 MLOps Ecosystem Trends
By Joongi Kim, Jeongkyu Shin- 00:00 Participation in NVIDIA GTC2022 MLOps Panel Talk
- 01:53 Lablup's Competitiveness in MLOps
- 03:59 Why MLOps is Necessary
- 07:04 Orchestrator
- 08:43 Distributed/Parallel Processing Tools
- 09:57 MLOps Modules (General, Serving)
- 11:23 Open Source MLOps Operation Tools
- 12:14 MLOps Issues in 2022
8 April 2022
[TalkIT] MLOps Ecosystem 2022 Outlook and Practical Roadmap for Hyperscale AI Acceleration with Backend.AI
By Joongi Kim, Jeongkyu ShinThe key to accelerating AI development and deployment processes is MLOps. We invite you to explore the MLOps software platform ecosystem that manages the entire process from data collection and processing, AI model training, to AI services. Additionally, we'll introduce you to a more evolved hyperscale AI practical roadmap through the MLOps ecosystem integration of Backend.AI, the first NVIDIA DGX-Ready Software in the Asia-Pacific region.
[Session Guide]
- MLOps Ecosystem and 2022 Outlook / Jeongkyu Shin, CEO (Lablup)
- Accelerating Hyperscale AIOps with Backend.AI / Joongi Kim, CTO (Lablup)
7 April 2022
[MS Dev Korea] - Exploring GitHub Codespaces and Devcontainers | Azure One Step
By Kyujin ChoInstead of setting up and configuring a development environment for application development each time, you can use GitHub Codespaces to access the same Visual Studio Code-based development environment in your web browser. At this time, Devcontainers allow developers to easily set up the development environment as intended. We will explore GitHub Codespaces and Devcontainers with a demo from developer Kyujin Cho from the Lablup startup.
6 April 2022
[allshow TV] Backend.AI MLOps Platform for NetApp ONTAP AI, the Platform for NVIDIA DGX Foundry, and Hyperscale AI Infrastructure
By Jeongmook Kim(1) We'll examine why NetApp ONTAP AI was chosen as the foundational platform from NVIDIA DGX POD certification to DGX Foundry. We'll also take a brief look at successful cases including TOP500 #72 and public cloud services.
(2) Through Backend.AI, the only NVIDIA DGX-Ready Software in the Asia-Pacific region, we'll explore how to optimally operate hyperscale AI infrastructure that includes computational resources like GPUs, storage, and networks.
Additionally, we'll discover how to effectively build and manage AI services at the enterprise level, along with customer case studies.
17 March 2022
Exploring the Open Source Contribution Process through CPython and Backend.AI
By Joongi KimWe discuss what aspects to consider and be mindful of in the process of contributing to and managing open source projects, drawing from experiences on both sides: as a company directly creating and operating open source projects, and as an external contributor.
30 November 2021
Backend.AI Tutorial_03
By LablupBackend.AI for Beginners: Getting Started with Backend.AI_03
○ Tour the Backend.AI cloud
- Import & Run page
Import notebook panel
Create notebook launch button panel
Import GitHub repository contents panel
- Data & Folders page
Explore folder controls
- Create a folder
- Viewing folder information
- Utilizing folders
- Sharing a folder
- Renaming a folder
- Deleting a folder
Auto-Mount Folders tab
- Creating an AutoMount Folder
- Creating a session without mounting folders and viewing automount folders
- Statistics page
Daily usage statistics
Weekly usage statistics✉️ : contact@lablup.com
8 May 2021
Backend.AI Tutorial_04
By LablupBackend.AI_04 for beginners to get started
Check the Backend.AI version
Changing user information
Touching user settings
- General
Desktop notifications
Concise sidebar default usage options
Language settings
SSH key pair management (see link below)
Option to check automatic updates
Enable/disable automatic logout
Set shell script preferences
- Logs
＊ View logs
Refresh logs
Delete logs
FAQ & Troubleshooting
- Running Jupyter notebook in a session ends with a kernel error.
- I forgot my password.
- I can't log in even though I entered the password correctly.
- Other things to note✉️ : contact@lablup.com
3 May 2021
Backend.AI Tutorial_02
By LablupBackend.AI for Beginners: Getting Started with Backend.AI_02
○ Tour the Backend.AI cloud
-Summary page
Start panel
Resource Live View
System resources
Announcements
Invitations folder
-Session (Session) page
Session Status
Running sessions
- App Launcher
- Web Terminal
Ended sessions
- In-session
- Usage time✉️ : contact@lablup.com
18 March 2021
Backend.AI Tutorial_01
By LablupBackend.AI Tutorial_01
-What is Backend.AI?
-Signing up for the Backend.AI cloud
-Logging in to the Backend.AI cloudIf you have any questions or problems signing up, please send it to the email address below, including your email name and email account when signing up, and we will reply after checking.
✉️ : contact@lablup.com11 March 2021
