
Ki-Ung Song
Problem Solver with AI and Mathematics Who Wants to Change the World
Seoul, South Korea
Featured Updates
08-09-2024
Neural Solver Towards Future of Simulation: Deep DivePost
08-09-2024
Neural Solver Towards Future of Simulation: ExplorationPost
Since May 2023
LLM4FinanceProject
Tags
See All >>Experience
Click for complete list.
Work Experience
Nota AI
AI Research Engineer
Jul 2024 - CurrentAdvancing AI for real-world, on-device applications.
- Developing VLM applications for edge devices to address practical challenges.
- Working on model compression techniques to enhance AI efficiency and deployment.
Deargen Inc.
AI Scientist
Sep 2022 - Jun 2024Developed AI models for drug discovery to advance healthcare.
- Designed a representation learning framework for molecules of various scales, embedding small molecules to proteins in a unified space.
- Built a controllable molecular generation model using diffusion models, conditioned on protein properties.
- Identified and addressed modality imbalance in molecular interaction prediction via a multimodal-mixing approach.
Project Experience
Personal Projects
Deepest: SNU Deep Learning Society
NCIA Lab
Growth Hackers: Business Data Analysts
Greenhouse Gas and Energy Management Center
Student Worker
Jan 2020 - Aug 2020- Managed and visualized SNU’s greenhouse gas and energy data using R.
- Improved data workflow and established visual baselines to track energy trends and detect anomalies.
- Gained hands-on experience with real-world data management.
Research Experience
Current Work
Research Topics in Interest
-
Efficient LLM & VLM
- To make LLMs and VLMs more efficient via compression and pruning.
-
DL for Simulation
- To accelerate the process of simluation-based science and engineering via DL.
Past Work
Researched Topics
-
DL for Drug DiscoverySep 2022 - Jun 2024
- Representation learning to handle various scale of molecules universally.
- Ligand generation using diffusion models for protein target pockets.
- Multimodal model for predicting protein-ligand binding affinity.
During M.S.
Sep 2020 - Aug 2022Researched Topics
-
Neural Tangent Kernels (NTKs) and DL theories
- NTK arises in the infinite-width limit of neural networks, simplifying DL models to a linearized form under certain conditions.
- The trend toward larger NNs has driven research on initialization and training in wide networks, leading to the infinite-width assumption for analyzing their dynamics.
- Modern overparameterized DL models can be analyzed via NTK in the infinite-width limit as feature dimensions increase.
-
Generative Models (Diffusion and Schrödinger Bridge models)
- Diffusion models have demonstrated state-of-the-art performance across various domains.
- Schrödinger Bridge (SB) models, based on entropy-regularized optimal transport, generalize diffusion models.
During B.S.
Mar 2016 - Aug 2020Undergraduate Research Internship
-
Topic : Theoretical Background on the Convergence of Optimizers
Used in Deep Learning
Mar 2020 - Aug 2020 -
Topic : Exploring the Mathematical Background Related to Machine
Learning(Reinforcement Learning)
Jun 2019 - Aug 2019
Academic Experience
During M.S.
Sep 2020 - Aug 2022Key Courses
-
Machine Learning for Visual Understanding
- Team Project: Image Deblurring with Generative Diffusion Process
-
Practical Application Research of IoT·AI·Big Data
- Personal Project: Various GANs and its Application(Face Aging)
- Mathematical Algorithm
- Numerical Analysis
During B.S.
Mar 2016 - Aug 2020Key Courses
-
Mathematical Modeling and Computational Experiments
- Team Project: Text Detection based on YOLO v3
- Combinatorial Optimization
- Linear and Non-linear Optimization
- Operation Research
Continual Learning
A journey of continuous growth.Textbooks
- [Sumio Watanabe] Algebraic Geometry and Statistical Learning Theory
- [Cuturi] Computational Optimal Transport
- [Kevin Murphy] Probabilistic Machine Learning
- [de Berg] Computational Geometry
- [S. Boyd] Convex optimization
Open Courses
- CS224W: Machine Learning with Graphs by Stanford University
- CS329S: Machine Learning Systems Design by Stanford University
- CS231n: Convolutional Neural Networks for Visual Recognition by Stanford University
Teaching Experience
Teaching Assistant (TA)
-
Elementary Mathematical Analysis
Spring 2022 -
Linear Algebra
Spring 2022 / Fall 2021 -
Calculus
Fall 2021 / Spring 2021 / Fall 2020
Featured Updates
08-09-2024
Neural Solver Towards Future of Simulation: Deep DivePost
08-09-2024
Neural Solver Towards Future of Simulation: ExplorationPost
Since May 2023
LLM4FinanceProject