Tag : Lablup Conf 3rd
Slipstream: How to Win the AI Race - Jeongkyu Shin (Keynote 1)
By Jeongkyu ShinWith the proliferation of generative AI, prohibitive development and adoption costs are becoming a major barrier to AI democratization. How can we lower the cost threshold and increase efficiency and ease of use when using or developing deep learning-based solutions? We introduce Slipstreaming, an approach from Rableup and Backend.AI to achieve massive performance and efficiency while standing on the shoulders of giants and masking all complexity.
About the presenter
- CEO, Lablup
- ML/DL Google Developers Expert
- Ph.D in Statistical Physics (complex systems / neuroscience) at POSTECH
29 November 2023
Screaming AI from somewhere between hardware and software - Joongi Kim (Keynote 2)
By Joongi KimA look back at the design philosophy and evolution of Backend.AI from an idea to provide a reproducible computational environment for researchers to an AI development and services platform for large enterprises. We explore why we made different choices than other similar products in the industry, and how those choices have delivered value to Lablup's business and customers.
About the Presenter
- Ph.D., Computer Science, KAIST (High Performance Network Systems)
- Open source ecosystem contributor including Python (CPython, aiomonitor, aiohttp, aiodocker, pyzmq, DPDK, iPuTTY, etc.)
29 November 2023
[Track1_1] Backend.AI Enterprise Customer Support ABC - Jonghyun Park (Lablup)
By Jonghyun ParkBackend.AI's enterprise support services mean an ongoing partnership with you, not just a product installation. From scheduling the installation, we work closely with your sales and devops teams to provide customized installation and service optimization. After the installation is complete, we provide ongoing support that is responsive to customer feedback and needs, starting with user guide sessions. This presentation will provide an introduction to how we interact with Backend.AI enterprise customers.
About the presenter
- Director of Research, Lablup
- Ph.D., Department of Forensic Physics (Single Molecule Biophysics)
29 November 2023
[Track1-2] Changing UI/UX Design: Problem Recognition and New Directions - Sujin Kim (Lablup)
By Sujin KimWe will analyze the main problems with the existing WebUI and where the user experience needs to be improved. We'll discuss why the problems need to be solved, what needs to change and how to improve them, and how the UI/UX has changed, with a particular focus on the session launcher UI/UX. Finally, we'll make some predictions about how WebUIs will change in the future.
About the presenter
- Software Engineer, Lablup
29 November 2023
[Track1-3] GenAI on Backend.AI- Kyujin Cho (Lablup)
By Kyujin ChoBackend.AI's powerful giant AI model development technology is meeting GenAI to create the ultimate AI service capability. This session will introduce how the model serving capabilities introduced in Backend.AI 23.09 have been extended to the operational side of GenAI, in terms of technology, convenience, and fate resource savings. This will be a session that will inspire you with the many innovations that can be created by combining efficient operation of GPU resources with automation of GenAI services and fine-tuning.
About the presenter
-Software Engineer, Lablup
29 November 2023
[Track1-4_1] How developers collaborate with octocat without a planner - Jihyun Kang (Lablup)
By Jihyun KangLablup doesn't have a planner position, but we're still releasing a lot of products and new features, including Backend.AI. We'll talk about the many trials and errors that led us to use GitHub, a platform that developers are familiar with. In particular, we'll talk about how we ended up using GitHub Projects, how most of our development infrastructure is open source, when we tried to adopt Jira and why we stopped, and the underlying issues of scaling the company. We'll also talk about how we use the most important GitHub Projects, their shortcomings, and how we're using GitHub Actions and Labels to solve them.
About the presenter
- Software Engineer, Lablup
29 November 2023
[Track1-4_2]How developers collaborate with octocat without planners - Sion Kang (Lablup)
By Sion KangLablup doesn't have a planner position, but we're still releasing a lot of products and new features, including Backend.AI. We'll talk about the many trials and errors that led us to use GitHub, a platform that developers are familiar with. We'll cover how we came to use GitHub Projects, how most of our development infrastructure is open source, when we tried to adopt Jira and why we stopped, and the scaling issues of our company. We'll also talk about how we use the most important GitHub Projects, their shortcomings, and how we use GitHub Actions and Labels to solve them.
About the presenter
- Software Engineer, Lablup
- GitHub Campus Expert29 November 2023
[Track1-5] Trends in hybrid inference in private-generated AI with WebGPUs - SukHyun Ko (Sionic AI)
By SukHyun Ko- WASM, the Rise of WebGPUs
- Performance evolution of edge devices - Apple M2 ultra beats A100
- Agent configuration by sLLM
- Federated Inference in the Age of Generative AI
- Use cases for private generative AI - LLM + Diffusion
Speaker Introduction
I am the CEO of Sionic AI and previously led major AI projects at NAVER and TOSS. At NAVER, I led the development of AI products for Clova and NAVER Cloud, and developed a system to orchestrate tens of thousands of deep learning models. At Toss, he rebuilt the semantic search and brand recommendation systems for the main search service.
Currently, Sionic AI provides enterprise-class custom LLM services and is developing a SaaS product specialized in LLM Agent.
We are challenging the new generative AI market with our technology and business experience.
29 November 2023
[Track2-2] whisper fine-turning for Voice Beginner - Sungcheol Choi (PKNU)
By Sungchul ChoiIn this presentation, "Fine-tuning Whisper for Voice Novelty", I will introduce the painstaking process of fine-tuning the Speech-to-Text feature by utilizing Whisper, a model provided by OpenAI, for a team touching voice data for the first time.
In the age of LLM, he will also share how Whisper models and LLM can come together to transform new areas such as maritime communications, and how they leveraged Backend.AI to learn how to fine-tune Whisper models for their purposes.About the Speaker
Currently, he is a professor at Pukyong National University, School of System Management Engineering, and has been conducting AI research mainly in the field of NLP. In addition to being a professor, he is also an entrepreneur who recently completed his LLM with ChatGPT and recklessly started an AI company in the field of trade, "TeamLibutte", believing that the world is changing due to the change of technology. As a company, I have to do voice fields other than NLP, so I am challenging it with tears (as a researcher).
29 November 2023
[Track2-3] You've come this far in Generative AI? - Hyunsoo Kim (Microsoft)
By Hyunsoo KimUnderstand the background of the AI era sparked by generative AI and how to capitalize on it. In this session, you'll learn how real-world customers are utilizing LLM, how to prompt engineer with generative AI to meet business needs, how to choose the right LLM model, a comparison of RAG architecture and fine-tuning, how to integrate real-time APIs into LLM, building intelligent applications designed for a changed UX, and how to build complex applications as LLMOps.
About the presenter
Hyunsoo Kim is an expert technology strategist with development experience in various fields such as IoT, Back-end, Front-end, Automation, Data Analytics, AI/ML, and Cloud, and has worked with customers in various industries to build solutions that meet their needs. He is currently working as an expert technology strategist for digital native customers at Microsoft Korea, helping them solve their business needs using generative AI technologies. Learn more: http://www.studydev.com/me/
A collection of use cases from Korean customers utilizing Azure OpenAI:
https://www.youtube.com/playlist?list=PLGh_JNxzXsX9NSm-iyAdS4Ioco0vp4jtq
Hands-on with Auzre OpenAI: https://github.com/HyounsooKim/azure-openai-samples-kr
29 November 2023
[Track2-4] How I went from backend developer to teaching data and AI - Joeun Park (todaycode)
By Joeun ParkIt's been a few years since I started running the TodayCode YouTube channel, and I've been asked to create content and teach a lot of different things, and I've taught a lot of different people in a lot of different places. I've taught students, job seekers, people who want to use data in their jobs, people who want to switch jobs, and I've talked to people who are struggling because they're non-majors, because they're older, because they have to work for a living right now, and they want to get into development or data, and they're struggling.
About the presenter
- Todaycode YouTube Channel Operator
- Microsoft MVP (Python Developer Technologies)
- Director of FastCampus Kernel 360
- Inflearn Knowledge Sharer
- NAVER Connect Boost CourseData Science Production and CoachingStudy Live Coach
- Lectures and content production for Seoul National University Big Data Innovation Sharing University, Yonsei University, Hanshin University, Korea Meteorological Administration, Statistics Korea, Seoul Digital Foundation, etc.
- Author of Everyone's Korean Text Analysis with Python
29 November 2023
[Track2-5]VisuTale's AI Vision: Pioneering the Next Wave of Generative Storytelling - Leksikov (Lablup)
By Sergey LeksikovDiscover the magic behind VisuTale AI, where images become the seeds of stories and art. We'll delve into the intricacies of each AI model, from interpreting images to crafting stories and generating related digital art. This session promises a deep dive into the models and engines that power VisuTale, offering a blueprint for those looking to harness the potential of generative AI on Backend.AI.
About the presenter
- Researcher, Lablup
- ESG Data Scientist, Who's Good
- MS, KAIST Graduate School of Data Science
29 November 2023
[Track2-6] Support for high-speed NFS storage integration - Sang Hun Lee (Lablup)
By Sang Hun LeeHigh-speed storage is often used to train AI with large amounts of data or to quickly deploy AI models. Backend.AI supports a lot of high-speed storage, and I'd like to share how I worked on integrating vast data storage.
About the presenter
- Software Engineer, Lablup
29 November 2023
[Track2-7] Backend.AI and AI Semiconductors - Sanghyeon Seo (Lablup)
By Sanghyeon SeoWe'll look at the accelerator plugin structure of Backend.AI, the accelerator plugins developed to date (Mock, CUDA, CUDA Enterprise, ROCm, TPU, IPU, ATOM, Warboy), additional accelerator plugins currently in development (SAPEON, HyperAccel), and discuss what needs to be done on the AI semiconductor side.
About the presenters
- Software Engineer, Lablup
29 November 2023
