Navigation bar avatar

Ki-Ung Song

Problem Solver with AI and Mathematics Who Wants to Change the World
Seoul, South Korea

Featured Updates

08-09-2024

Neural Solver Towards Future of Simulation: Deep Dive

Post

08-09-2024

Neural Solver Towards Future of Simulation: Exploration

Post

Since May 2023

LLM4Finance

Project

Tags

See All >>

Experience

Click for complete list.

Work Experience

Nota AI

AI Research Engineer

Jul 2024 - Current

Advancing AI for real-world, on-device applications.

  • Developing VLM applications for edge devices to address practical challenges.
  • Working on model compression techniques to enhance AI efficiency and deployment.

Deargen Inc.

AI Scientist

Sep 2022 - Jun 2024

Developed AI models for drug discovery to advance healthcare.

  • Designed a representation learning framework for molecules of various scales, embedding small molecules to proteins in a unified space.
  • Built a controllable molecular generation model using diffusion models, conditioned on protein properties.
  • Identified and addressed modality imbalance in molecular interaction prediction via a multimodal-mixing approach.

Project Experience

Personal Projects

Deepest: SNU Deep Learning Society

NCIA Lab

Growth Hackers: Business Data Analysts

Greenhouse Gas and Energy Management Center

Student Worker

Jan 2020 - Aug 2020
  • Managed and visualized SNU’s greenhouse gas and energy data using R.
  • Improved data workflow and established visual baselines to track energy trends and detect anomalies.
  • Gained hands-on experience with real-world data management.

Research Experience

Current Work

Research Topics in Interest
  • Efficient LLM & VLM
    • To make LLMs and VLMs more efficient via compression and pruning.
  • DL for Simulation
    • To accelerate the process of simluation-based science and engineering via DL.

Past Work

Researched Topics
  • DL for Drug Discovery
    Sep 2022 - Jun 2024
    • Representation learning to handle various scale of molecules universally.
    • Ligand generation using diffusion models for protein target pockets.
    • Multimodal model for predicting protein-ligand binding affinity.

During M.S.

Sep 2020 - Aug 2022
Researched Topics
  • Neural Tangent Kernels (NTKs) and DL theories
    • NTK arises in the infinite-width limit of neural networks, simplifying DL models to a linearized form under certain conditions.
    • The trend toward larger NNs has driven research on initialization and training in wide networks, leading to the infinite-width assumption for analyzing their dynamics.
    • Modern overparameterized DL models can be analyzed via NTK in the infinite-width limit as feature dimensions increase.

  • Generative Models (Diffusion and Schrödinger Bridge models)
    • Diffusion models have demonstrated state-of-the-art performance across various domains.
    • Schrödinger Bridge (SB) models, based on entropy-regularized optimal transport, generalize diffusion models.

During B.S.

Mar 2016 - Aug 2020
Undergraduate Research Internship
  • Topic : Theoretical Background on the Convergence of Optimizers Used in Deep Learning
    Mar 2020 - Aug 2020

  • Topic : Exploring the Mathematical Background Related to Machine Learning(Reinforcement Learning)
    Jun 2019 - Aug 2019

Academic Experience

During M.S.

Sep 2020 - Aug 2022
Key Courses
  • Machine Learning for Visual Understanding
    • Team Project: Image Deblurring with Generative Diffusion Process
  • Practical Application Research of IoT·AI·Big Data
    • Personal Project: Various GANs and its Application(Face Aging)
  • Mathematical Algorithm
  • Numerical Analysis

During B.S.

Mar 2016 - Aug 2020
Key Courses
  • Mathematical Modeling and Computational Experiments
    • Team Project: Text Detection based on YOLO v3
  • Combinatorial Optimization
  • Linear and Non-linear Optimization
  • Operation Research

Continual Learning

A journey of continuous growth.
Textbooks
  • [Sumio Watanabe] Algebraic Geometry and Statistical Learning Theory
  • [Cuturi] Computational Optimal Transport
  • [Kevin Murphy] Probabilistic Machine Learning
  • [de Berg] Computational Geometry
  • [S. Boyd] Convex optimization
Open Courses
  • CS224W: Machine Learning with Graphs by Stanford University
  • CS329S: Machine Learning Systems Design by Stanford University
  • CS231n: Convolutional Neural Networks for Visual Recognition by Stanford University

Teaching Experience

Teaching Assistant (TA)

  • Elementary Mathematical Analysis
    Spring 2022
  • Linear Algebra
    Spring 2022 / Fall 2021
  • Calculus
    Fall 2021 / Spring 2021 / Fall 2020

Featured Updates

08-09-2024

Neural Solver Towards Future of Simulation: Deep Dive

Post

08-09-2024

Neural Solver Towards Future of Simulation: Exploration

Post

Since May 2023

LLM4Finance

Project

Tags

See All >>