Under Review

Motion-Surface-Appearance Dynamic Gaussian Splatting for Accurate Geometry and High-Fidelity Rendering
Seungjae Lee, Ho Jun Kim, Hak Gu Kim
Rethinking Facial Deformation Representation for Speech-Driven 3D Facial Animation
Hyung Kyu Kim, Byungchan Hwang, Hak Gu Kim
Language-Guided Scene Text Segmentation via Hierarchical Text Context Reasoning and Implicit Glyph Refinement
Ho Jun Kim, Hak Gu Kim

2026

Revealing Hidden Response Ambiguity in Binary Evaluation of Cultural Gesture Understanding
Sunghun Kang, Seungjae Lee, Hongseok Cho, Hyeokjun Kweon, Hak Gu Kim
IEEE International Conference on Image Processing Workshop (ICIPW) 2026
Vision-Language Multimodal Learning Human-Centered AI
ArtBoost: Synthetic Articulatory Data Augmentation for Acoustic-to-Articulatory Inversion
Hyung Kyu Kim, Byungchan Hwang, Hak Gu Kim
Interspeech 2026 arXiv Project
Top-tier AI Conference
Speech Processing Motion Generation
Deformable 3D Point Cloud Perturbations using Cage-based Deformation for Semantic Consistency
Kyo Seok Lee, Hak Gu Kim
IEEE Transactions on Information Forensics and Security (TIFS) 2026 PDF Project
JCR Top 7.8% [Impact Factor: 8.0]
3D Vision Adversarial Learning
Unsharp-Inspired Adversarial Point Cloud Perturbation via Low-Rank Approximation
Kyo Seok Lee, Hak Gu Kim
Signal Processing Letters (SPL) 2026 PDF
3D Vision Adversarial Learning

2025

MemoryTalker: Personalized Speech-Driven 3D Facial Animation via Audio-Guided Stylization
Hyung Kyu Kim, Sangmin Lee, Hak Gu Kim
International Conference on Computer Vision (ICCV) 2025 PDF Project Code
Top-tier AI Conference [Acceptance rate: 24%]
Speech Processing Motion Generation Digital Human
Enhancing 3D Scene Representation with Structural Dissimilarity-Aware Learning
Seungjae Lee, Ho Jun Kim, Hak Gu Kim
IEEE International Conference on Image Processing (ICIP) 2025 PDF
3D Vision Gaussian Splatting Digital Human
Learning Phonetic Context-Dependent Viseme for Enhancing Speech-Driven 3D Facial Animation
Hyung Kyu Kim, Hak Gu Kim
Interspeech 2025 PDF Project Code
Top-tier AI Conference [Acceptance rate: 49.87%]
Speech Processing Motion Generation Digital Human
Leveraging Text Signed Distance Function Map for Boundary- Aware Guidance in Scene Text Segmentation
Ho Jun Kim, Hak Gu Kim
IEEE Access 2025 PDF
Scene Understanding Segmentation
MSCoTDet: Language-driven Multi-modal Fusion for Improved Multispectral Pedestrian Detection
Taeheon Kim, Sangyun Chung, Damin Yeom, Youngjoon Yu, Hak Gu Kim, Yong Man Ro
IEEE Transactions on Circuits and Systems for Video Technology (TCSVT) 2025 PDF
JCR Top 5.5% [Impact Factor: 8.3]
Vision-Language Object Detection

2024

Unveiling the Potential of Multimodal Large Language Models for Scene Text Segmentation via Semantic-Enhanced Features
Ho Jun Kim*, Hyung Kyu Kim*, Sangmin Lee, Hak Gu Kim
IEEE International Conference on Image Processing Workshop (ICIPW) 2024 PDF
Vision-Language Segmentation Scene Understanding
Analyzing Visible Articulatory Movements in Speech Production for Speech-Driven 3D Facial Animation
Hyung Kyu Kim, Sangmin Lee, Hak Gu Kim
IEEE International Conference on Image Processing (ICIP) 2024 PDF
Speech Processing Face Analysis Motion Generation
Causal Mode Multiplexer: A Novel Framework for Unbiased Multispectral Pedestrian Detection
Taeheon Kim, Sebin Shin, Youngjoon Yu, Hak Gu Kim, Yong Man Ro
IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2024 PDF Project Code
Top-tier AI Conference [Acceptance rate: 23.6%]
Object Detection Robust Learning
Super-Resolution Neural Radiance Field via Learning High Frequency Details for High-Fidelity Novel View Synthesis
Han-nyoung Lee, Hak Gu Kim
IEEE Signal Processing Letters (SPL) 2024 PDF
3D Vision Neural Rendering
Photometric Stereo Super Resolution via Complex Surface Structure Estimation
Han-nyoung Lee, Hak Gu Kim
IEEE Access 2024 PDF
3D Vision Generative Modeling

2022

Assessing Individual VR Sickness through Deep Feature Fusion of VR Video and Physiological Response
Sangmin Lee, Seongyeop Kim, Hak Gu Kim, Yong Man Ro
IEEE Transactions on Circuits and Systems for Video Technology (TCSVT) 2022 PDF
JCR Top 15.7% [Impact Factor: 4.685]
VR/XR Visual Quality Assessment
Natural-Looking Adversarial Examples from Freehand Sketches
Hak Gu Kim, Davide Nanni, Sabine Süsstrunk
IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) 2022 PDF
Adversarial Learning Generative Modeling

2021

Robust Video Frame Interpolation with Exceptional Motion Map
Minho Park, Hak Gu Kim, Yong Man Ro
IEEE Transactions on Circuits and Systems for Video Technology (TCSVT) 2021 PDF
Generative Modeling Robust Learning
Video Prediction Recalling Long-term Motion Context via Memory Alignment Learning
Sangmin Lee, Hak Gu Kim, Dae Hwi Choi, Hyung-il Kim, Yong Man Ro
IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) 2021 PDF
Top-tier AI Conference [Acceptance rate: 23.7%]
Generative Modeling
Visual Comfort Aware-Reinforcement Learning for Depth Adjustment of Stereoscopic 3D Images
Hak Gu Kim, Minho Park, Sangmin Lee, Seongyeop Kim, Yong Man Ro
Association for the Advancement of Artificial Intelligence (AAAI) 2021 PDF
Top-tier AI Conference [Acceptance rate: 21%]
VR/XR Visual Quality Assessment Reinforcement Learning
Towards a Better Understanding of VR Sickness: Physical Symptom Prediction for VR Contents
Hak Gu Kim, Sangmin Lee, Seongyeop Kim, Heoun-taek Lim, Yong Man Ro
Association for the Advancement of Artificial Intelligence (AAAI) 2021 PDF
Top-tier AI Conference [Acceptance rate: 21%]
VR/XR Visual Quality Assessment

2020

SACA Net: Cybersickness Assessment of Individual Viewers for VR Content via Graph-based Symptom Relation Embedding
Sangmin Lee, Jung Uk Kim, Hak Gu Kim, Yong Man Ro
European Conference on Computer Vision (ECCV) 2020 PDF
Top-tier AI Conference [Acceptance rate: 26%]
VR/XR Visual Quality Assessment
Structure Boundary Preserving Segmentation for Medical Image with Ambiguous Boundary
Hong Joo Lee, Jung Uk Kim, Sangmin Lee, Hak Gu Kim, Yong Man Ro
IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) 2020 PDF
Top-tier AI Conference [Acceptance rate: 22%]
Segmentation
Deep Virtual Reality Image Quality Assessment with Human Perception Guider for Omnidirectional Image
Hak Gu Kim*, Heoun-taek Lim*, Yong Man Ro
IEEE Transactions on Circuits and Systems for Video Technology (TCSVT) 2020 PDF
JCR Top 15.7% [Impact Factor: 4.685]
VR/XR Visual Quality Assessment
BBC Net: Bounding-Box Critic Network for Occlusion-Robust Object Detection
Jung Uk Kim, Jungsu Kwon, Hak Gu Kim, Yong Man Ro
IEEE Transactions on Circuits and Systems for Video Technology (TCSVT) 2020 PDF
JCR Top 15.7% [Impact Factor: 4.685]
Object Detection Robust Learning
MCSIP Net: Multichannel Satellite Image Prediction via Deep Neural Network
Jae-Hyeok Lee, Sangmin S. Lee, Hak Gu Kim, Sa-Kwang Song, Seongchan Kim, Yong Man Ro
IEEE Transactions on Geoscience and Remote Sensing (TGRS) 2020 PDF
JCR Top 12.8% [Impact Factor: 5.6]
Generative Modeling
BMAN: Bidirectional Multi-scale Aggregation Networks for Abnormal Event Detection
Sangmin Lee, Hak Gu Kim, Yong Man Ro
IEEE Transactions on Image Processing (TIP) 2020 PDF
JCR Top 3.2% [Impact Factor: 10.856]
Scene Understanding

2019

Endometrium Segmentation on Transvaginal Ultrasound Image Using Key‐point Discriminator
Hyenok Park, Hong Joo Lee, Hak Gu Kim, Yong Man Ro, Dongkuk Shin, Sa Ra Lee, Sung Hoon Kim, Mikyung Kong
Medical Physics (MP) 2019 PDF
JCR Top 24.1% [Impact Factor: 3.317]
Segmentation
VRSA Net: VR Sickness Assessment Considering Exceptional Motion for 360° VR Video
Hak Gu Kim, Heoun-taek Lim, Sangin Lee, Yong Man Ro
IEEE Transactions on Image Processing (TIP) 2019 PDF
JCR Top 4.1% [Impact Factor: 9.340]
VR/XR Visual Quality Assessment
Binocular Fusion Net: Deep Learning Visual Comfort Assessment for Stereoscopic 3D
Hak Gu Kim*, Hyunwook Jeong*, Heoun-taek Lim, Yong Man Ro
IEEE Transactions on Circuits and Systems for Video Technology (TCSVT) 2019 PDF
JCR Top 18.7% [Impact Factor: 4.133]
Visual Quality Assessment
Generative Guiding Block: Synthesizing Realistic Looking Variants Capable of Even Large Change Demands
Minho Park, Hak Gu Kim, Yong Man Ro
IEEE International Conference on Image Processing (ICIP) 2019 PDF
Generative Modeling
Deep Objective Assessment Model based on Spatio-temporal Perception of 360-degree Video for VR Sickness Prediction
Kihyun Kim*, Sangmin Lee*, Hak Gu Kim, Minho Park, Yong Man Ro
IEEE International Conference on Image Processing (ICIP) 2019 PDF
Best Paper Finalists [Acceptance Rate: 2.1%]
VR/XR Visual Quality Assessment
Physiological Fusion Net: Quantifying Individual VR Sickness with Content Stimulus and Physiological Response
Sangmin Lee, Seongyeop Kim, Hak Gu Kim, Min Seob Kim, Seokho Yun, Bumseok Jeong, Yong Man Ro
IEEE International Conference on Image Processing (ICIP) 2019 PDF
VR/XR Visual Quality Assessment
Region-guided Adversarial Learning for Anatomical Landmark Detection in Uterus Ultrasound Image
Hong Joo Lee, Hak Gu Kim, Hyenok Park, Dongkuk Shin, Yong Man Ro
SPIE Medical Imaging (MI) 2019 PDF
Object Detection
Photo-Realistic Facial Emotion Synthesis Using Multi-level Critic Networks with Multi-level Generative Model
Minho Park, Hak Gu Kim, Yong Man Ro
International Conference on Multimedia Modeling (MMM) 2019 PDF
Face Analysis Generative Modeling

2018

Adversarial Spatial Frequency Domain Critic Learning for Age and Gender Classification
Sangmin S. Lee, Hak Gu Kim, Kihyun Kim, Yong Man Ro
IEEE International Conference on Image Processing (ICIP) 2018 PDF
Face Analysis
Object Bounding Box-Critic Networks for Occlusion-Robust Object Detection in Road Scene
Jung Uk Kim*, Jungsu Kwon*, Hak Gu Kim, Yong Man Ro
IEEE International Conference on Image Processing (ICIP) 2018 PDF
Object Detection Robust Learning
FSF-C Net: Face Spatial Frequency-Critic Network for Face Super Resolution
Kihyun Kim, Hak Gu Kim, Yong Man Ro
IEEE/IEIE International Conference on Consumer Electronics-Asia (ICCE-Asia) 2018 PDF
Best Student Paper Award (Silver Prize)
Face Analysis Generative Modeling
VR IQA NET: Deep Virtual Reality Image Quality Assessment Using Adversarial Learning
Heoun-taek Lim, Hak Gu Kim, Yong Man Ro
IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) 2018 PDF
VR/XR Visual Quality Assessment
STAN: Spatio-Temporal Adversarial Networks for Abnormal Event Detection
Sangmin Lee, Hak Gu Kim, Yong Man Ro
IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) 2018 PDF
Scene Understanding Object Detection
ICADx: Interpretable Computer Aided Diagnosis of Breast Masses
Seong Tae Kim, Hakmin Lee, Hak Gu Kim, Yong Man Ro
SPIE Medical Imaging (MI) 2018 PDF
Robert F. Wagner All Conference Best Student Paper Final Lists Award
Scene Understanding
Teacher and Student Joint Learning for Compact Facial Landmark Detection Network
Hong Joo Lee, Wissam J. Baddar, Hak Gu Kim, Seong Tae Kim, Yong Man Ro
International Conference on Multimedia Modeling (MMM) 2018 PDF
Face Analysis

2017

Ultrafast Layer based Computer-Generated Hologram Calculation with Sparse Template Holographic Fringe Pattern for 3-D Object
Hak Gu Kim, Yong Man Ro
Optics Express (OE) 2017 PDF
JCR Top 20.2% [Impact Factor: 3.356]
3D Vision Generative Modeling
Multiview Stereoscopic Video Hole Filling Considering Spatiotemporal Consistency and Binocular Symmetry for Synthesized 3D Video
Hak Gu Kim, Yong Man Ro
IEEE Transactions on Circuits and Systems for Video Technology (TCSVT) 2017 PDF
JCR Top 18.1% [Impact Factor: 3.558]
3D Vision Generative Modeling
Measurement of Exceptional Motion in VR Video Contents for VR Sickness Assessment Using Deep Convolutional Autoencoder
Hak Gu Kim, Wissam J. Baddar, Heoun-taek Lim, Hyunwook Jeong, Yong Man Ro
ACM Symposium on Virtual Reality Software and Technology (VRST) 2017 PDF
Top-tier AI Conference [Acceptance Rate: 21%]
VR/XR Visual Quality Assessment
Modality-bridge Transfer Learning for Medical Image Classification
Hak Gu Kim*, Yeoreum Choi*, Yong Man Ro
IEEE International Congress on Image and Signal Processing, BioMedical Engineering and Informatics (CIPS-BMEI) 2017 PDF
Scene Understanding
Robust and Real-Time Visual Tracking with Triplet Convolutional Neural Network
Jung Uk Kim, Hak Gu Kim, Yong Man Ro
ACM Multimedia Workshop (MMW) 2017 PDF
Robust Learning
Visual Comfort Assessment of Stereoscopic Images Using Deep Visual and Disparity Features based on Human Attention
Hyunwook Jeong, Hak Gu Kim, Yong Man Ro
IEEE International Conference on Image Processing (ICIP) 2017 PDF
Visual Quality Assessment
Iterative Deep Convolutional Encoder-Decoder Network for Medical Image Segmentation
Jung Uk Kim, Hak Gu Kim, Yong Man Ro
IEEE Engineering in Medicine and Biology Society (EMBC) 2017 PDF
Segmentation
Sparsity-based Fast CGH Generation Using Layer-based Approach for 3D Point Cloud Model
Hak Gu Kim, Hyunwook Jeong, Yong Man Ro
SPIE Photonics West (PW) 2017 PDF
3D Vision Generative Modeling
Investigating Numerical Reconstruction Quality and Sparsity Constraints on the Holographic Fringe Pattern in Digital Holography
Hyunwook Jeong, Hak Gu Kim, Yong Man Ro
SPIE Photonics West (PW) 2017 PDF
3D Vision

2016

Acceleration of the Calculation Speed of Computer-Generated Holograms Using the Sparsity of the Holographic Fringe Pattern for a 3D Object
Hak Gu Kim, Hyunwook Jeong, Yong Man Ro
Optics Express (OE) 2016 PDF
JCR Top 18.5% [Impact Factor: 3.307]
3D Vision Generative Modeling
Experimental Investigation of the Effect of Binocular Disparity on the Visibility Threshold of Asymmetric Noise in Stereoscopic Viewing
Hak Gu Kim*, Seong-il Lee*, Yong Man Ro
Optics Express (OE) 2016 PDF
JCR Top 18.5% [Impact Factor: 3.307]
VR/XR Visual Quality Assessment
Critical Binocular Asymmetry Measure for the Perceptual Quality Assessment of Synthesized Stereo 3D Images in View Synthesis
Yong Ju Jung, Hak Gu Kim, Yong Man Ro
IEEE Transactions on Circuits and Systems for Video Technology (TCSVT) 2016 PDF
JCR Top 17.2% [Impact Factor: 3.599]
VR/XR Visual Quality Assessment
Measurement of Critical Temporal Inconsistency for Quality Assessment of Synthesized Video
Hak Gu Kim, Yong Man Ro
IEEE International Conference on Image Processing (ICIP) 2016 PDF
VR/XR Visual Quality Assessment
A New Hole Filling Method based on 3D Geometric Transformation for Synthesized Image
Hak Gu Kim, Heoun-taek Lim, Yong Man Ro
Electronic Imaging (EI) 2016 PDF
3D Vision Generative Modeling
Learning based Hole Filling Method Using Deep Convolutional Neural Network for View Synthesis
Heoun-taek Lim, Hak Gu Kim, Yong Man Ro
Electronic Imaging (EI) 2016 PDF
3D Vision Generative Modeling

2015

Multi-frame De-raining Algorithm Using a Motion-compensated Non-local Mean Filter for Rainy Video Sequences
Hak Gu Kim, Hyunwook Jeong, Yong Man Ro
Journal of Visual Communication and Image Representation (JVCI) 2015 PDF
Generative Modeling
A Sparse Representation-Based Label Pruning for Image Inpainting Using Global Optimization
Hak Gu Kim, Yong Man Ro
Pacific Rim Conference on Multimedia (PCM) 2015 PDF
Best Student Paper Award
Generative Modeling
Temporally Consistent Hole Filling Method based on Global Optimization with Label Propagation for 3D Video
Hak Gu Kim, Soo Sung Yoon, Yong Man Ro
IEEE International Conference on Image Processing (ICIP) 2015 PDF
3D Vision Generative Modeling
Multi-view Stereo Image Synthesis Using Binocular Symmetry-based Global Optimization
Hak Gu Kim, Yong Ju Jung, Soo Sung Yoon, Yong Man Ro
SPIE/IS&T Electronic Imaging (EI) 2015 PDF
3D Vision Generative Modeling

2014

Investigating Experienced Quality Factors in Synthesized Multi-view Stereo Images
Hak Gu Kim, Yong Ju Jung, Soo Sung Yoon, Yong Man Ro
IEEE International Conference on Digital Signal Processing (DSP) 2014 PDF
3D Vision Visual Quality Assessment