backend.ai

A recap of the ongoing updates to Backend.AI 23.03 and 22.09. The development team is working hard to squeeze every last bit out.

Here are the most important changes in this update:

• Expanded hardware compatibility: Expanded hardware compatibility with support for ATOM accelerator idle checking and Dell EMC storage backends from Rebeillons.
• High-speed upload enhancements: Introduced SFTP functionality to support high-speed uploads to storage.
• Development Environment Enhancements: Enhanced the development environment by allowing sessions to be accessed in remote SSH mode from local Visual Studio Code.
• Increased manageability: Improved the user interface for administrators to make it easier to set up AI accelerators and manage resource groups.

Backend.AI Core & UI

• Added support for idle state checking of ATOM accelerators.
• Introduced SFTP functionality to support high-speed uploads directly to storage.
• Added ability to force periodic password updates based on administrator settings.
• Added an upload-only session (SYSTEM) tab.
• Added Inference type to the allowed session types.
• Added the ability to connect to a session in remote SSH mode from local Visual Studio Code.
• Added support for uploading folders from Folder Explorer.
• Improved the display of the amount of shared memory allocated when creating a session.
• Added support for Dell EMC storage backend.
• Improved the accuracy of container memory usage measurement.
• Improved the ability to run multiple agents concurrently on a single compute node.
• Added project/resource group name filter for administrators.
• Added user interface for administrators to set various AI accelerators, including GPUs, in resource presets/policies.
• Added a user interface for administrators to display the allocation and current usage of various accelerators, including GPUs.
• Added a user interface for administrators to set the visibility of resource groups.
• Provided a user interface for administrators to view the idle-checks value per session.
• Added recursion option when uploading vfolders in the CLI, and improved relative path handling.
• Added a recursive option in the CLI to terminate sessions with dependencies on specific session termination at once.
• Added a new mock-accelerator plugin for developers, replacing the old cuda-mock plugin.
• Added status and statistics checking API for internal monitoring of the storage proxy for developers.

Backend.AI FastTrack

• Improved searching for vfolders by name when adding pipeline modules.
• Added an indication to easily recognize success/failure after pipeline execution.

Backend.AI Forklift

• Bug fixes and stability improvements.
• Support for deleting build job history.
• Supports pagination of the build task list.

Backend.AI is constantly evolving to support a variety of environments in the ever-changing AI ecosystem, while providing a more robust and user-friendly experience. Stay tuned to see what's next!

Make your AI accessible with Backend.AI!

This post is automatically translated from Korean