Prof. Tong-Yee (Tony)
Lee is a Chair
Professor in the Computer Science and Information Engineering
Department of National
Cheng-Kung University, and the
head of the Computer Graphics Group/Visual
System Laboratory. His research interests are in multimedia retargeting, computer graphics,
visualization, deep learning and medical applications. His email: tonylee@mail.ncku.edu.tw and the research summary of his major publications is listed below. Up to now, he has published (or accepted) near 90 IEEE/ACM
Transactions/SIGGRAPH/SIGGRAPH Asia/CVPR papers including 13 ACM TOG and 48 IEEE TVCG papers. Both TOG and TVCG are TOP journals in computer
graphics. Our 13 ACM TOG papers are also SIGGRAPH/SIGGRAPH Asia
papers (total 12
siggraph/siggraph asia papers). My
publication list
(2024/10/08)
Multimedia Retargeting
In this research, we have studied different methods/optimization
to solve multimedia retargeting problems from image/video to stereo
images/video. The image is divided into either uniformed grids or irregular
patches. For video resizing, we consider either in-between frame-coherence or
continuous volumetric space coherence. In addition, we also consider
summarizing objects (i.e. delete similar objects) to resize images. To
determine similar objects’ importance, we measure and predict visual importance
of similar objects. Recently, we also propose a deep learning strategy to
handle image resizing.
In total, our body of work on multimedia retargeting has been
cited more than 1400 times. Additionally, visual retargeting has since matured into a
billion-dollar industry due to the explosion of different media formats and
device capabilities. This multimedia retargeting work has made a clear mark in
this segment of industry, as can be evidenced from our US Provisional Patent Application No. 61/334,953, that was licensed
to Walt Disney for video cropping, temporally-coherent warping and retargeting.
(1)
Huisi
Wu, Hao Meng, Chengze Li, Xueting Liu, Zhenkun Wen, and Tong-Yee Lee,
“Cartoon Animation Outpainting with Region-guided Motion Inference”, IEEE Transactions on Visualization and
Computer Graphics, (TVCG) (SCI/EI) (accepted)(2024/03)
(2)
Thi-Ngoc-Hanh
Le, HuiGuang Huang, Yi-Ru Chen, and Tong-Yee Lee*,
"Retargeting Videos to Arbitrary Aspect Ratios with an End-to-end
Model," IEEE Transactions on
Visualization and Computer Graphics, (TVCG) VOL. 30, NO. 9, SEPTEMBER 2024, pp 6164~6176 (SCI/EI)
(3)
Fan Tang, Weiming Dong, Yiping Meng,Chongyang Ma, Fuzhang Wu,
Xinrui Li, Tong-Yee Lee " Image
Retargetability," IEEE Transactions on Multimedia (TMM) Vol. 22, No. 3, March, pp, 641~654, 2020 (SCI/EI)
(4)
Yu Song,
Fan Tang, Weiming Dong, Xiaopeng Zhang, Oliver Deussen, Tong-Yee Lee "Photo Squarization by Deep Multi-Operator
Retargeting" ACM Multimedia 2018 (Top conference on Multimedia), 22 - 26 October 2018, Seoul, Korea
(5)
Yan
Kong, Weiming Dong, Xing Mei, Chongyang Ma, Tong-Yee Lee,
Siwei Lyu, Feiyue Huang, and Xiaopeng Zhang, "Measuring and Predicting
Visual Importance of Similar Objects," IEEE Transactions on
Visualization and Computer Graphics (TVCG), No. 12 - Dec., vol. 22, 2016, pp. 2564-2578, (SCI/EI)
(6)
Weiming
Dong, Fuzhang Wu, Yan Kong, Xing Mei, Tong-Yee Lee, Xiaopeng
Zhang ,"Image Retargeting by Content-Aware Synthesis," IEEE
Transactions on Visualization and Computer Graphics (TVCG), vol. 22, No. 2, 2016,
pp.1088~1101 (SCI/EI)
(7)
Weiming
Dong, Ning Zhou, Tong-Yee Lee, Fuzhang Wu, Yan Kong and
Xiaopeng Zhang, “Summarization-Based Image Resizing by Intelligent Object
Carving,” IEEE Transactions on Visualization and Computer Graphics (TVCG), Vol. 20, No. 1, Jan. Issue,
2014, pp. 111-124 (SCI/EI)
(8)
Shih-Syun
Lin, Chao-hung Lin Yu-Hsuan Kuo; Tong-Yee Lee*, “Consistent
Volumetric Warping Using Floating Boundaries for Stereoscopic Video
Retargeting,” IEEE Transactions on Circuits and Systems for Video
Technology (TCSVT), vol. 5,
No. 26, 2016, pp. 801-813 (SCI/EI)
(9)
Shih-Syun
Lin, Chao-Hung Lin, Shu-Huai Chang, Tong-Yee Lee*,
“Object-Coherence Warping for Stereoscopic Image Retargeting,” IEEE
Transactions on Circuits and Systems for Video Technology (TCSVT),Vol. 24, Issue No. 5, May 2014,
pp. 759-768 (SCI/EI)
(10)
Shih-Syun
Lin, Chao-Hung Lin, I-Cheng Yeh, Shu-Huai Chang, Chih-Kuo Yeh, Tong-Yee
Lee*, “Content-aware Video Retargeting Using Object-preserving
Warping,” IEEE Transactions on Visualization and Computer Graphics (TVCG), Vol. 19, No. 10, Oct. 2013, pp.
1677-1688. (SCI/EI)
(11)
Shih-Syun
Lin, I-Cheng Yeh, Chao-Hung Lin, Tong-Yee Lee*, “Patch-based
Image Warping for Content-Aware Retargeting,” IEEE Transactions on
Multimedia (TMM), Vol.
15, No. 2, 2013, Feb., pp. 359 -368 (SCI/EI)
(12)
YuShuen
Wang, Jen-Hung Hsiao, Olga Sorkine, Tong-Yee Lee*, “Scalable
and Coherent Video Resizing with
Per-Frame Optimization,” ACM Transaction on Graphics (TOG) (also in Proceedings of SIGGRAPH
2011), Vol. 30, No.4, Aug. 2011 (SCI/EI)
(13)
Huisi
Wu, Yushuen Wang, Kun-Chuan Feng, Tien-Tsin Wong, Tong-Yee Lee,
Pheng-Ann Heng, “Resizing by Summarization”, Vol. 29, No. 6, Article No.
159, ACM Transactions on Graphics (TOG) (also in Proceedings of SIGGRAPH Asia 2010),
Seoul, 2010 (SCI/EI)
(14)
YuShuen
Wang, Hui-Chih Lin, Olga Sorkine, Tong-Yee Lee*,
“Motion-based Video Retargeting with Optimized Crop-and-Warp,” ACM
Transaction on Graphics (TOG)
(also in Proceedings of SIGGRAPH 2010), Vol. 29, No.3,
Article No. 90, pp. 1-9, July 2010 (SCI/EI)
(15)
YuShuen
Wang, Hongbo Fu, Olga Sorkine, Tong-Yee Lee*, and Hans-Peter
Seidel, “Motion-Aware Temporal Coherence for Video Resizing,” ACM
Transaction on Graphics (TOG)
(also in Proceedings of SIGGRAPH Asia 2009), Vol. 28, No.5,
Article: 127, Dec. 2009, (SCI/EI)
(16)
Yu-Shuen
Wang, Chiew-Lan Tai, Olga Sorkine, Tong-Yee Lee*, “Optimized
Scale-and-Stretch for Image Resizing,” ACM Transaction on Graphics (TOG) (also in Proceedings of SIGGRAPH
Asia 2008) Vol. 27, No.5, Dec. 2008 (SCI/EI)
Surface Modeling/Texture Mapping/Geometrric Steganography/AGIM
In this research, we have studied different methods/optimization to solve/reconstruct surface modeling problems such as skeleton extraction, geometric blending for stylized models, 3D surface fitting/morphing using templates and high-relief surface reconstruction from a single image. In addition, we also solve constrained texture mapping problems on 3D models and discuss how to hide multiple layers from 7-13 layers steganography information on 3D models and also how to store 3D geometrical information on 2D adaptive geometry image (AGIM) files.
(1)
Jie Zhang, Yan
Luximon, Tong-Yee Lee,
Kangneng Zhou, and Ping Li, "3DCMM: 3D Comprehensive Morphable
Models with UV-UNet for Accurate Head Creation," IEEE Transactions on Multimedia (TMM)(accepted) (2024/09)
(2)
Jie Zhang, Kangneng Zhou, Yan Luximon,
Tong-Yee Lee, and Ping Li "MeshWGAN: Mesh-to-Mesh Wasserstein GAN with
Multi-Task Gradient Penalty for 3D Facial Geometric Age Transformation" IEEE
Transactions on Visualization and Computer Graphics (TVCG), Aug. 2024, pp.
4927-4940, vol. 30 (SCI/EI)
(3)
Chih-Kuo Yeh, Hsin-Ping Wang,
Jie-Cheng Jhang, Tong-Yee Lee*
"3D Reconstruction from a Single Image with Duplicate Objects via Template
Models" ACM Transactions on Graphics (TOG) (under revision) (SCI/EI) 2019/05
(4)
Chih-Kuo
Yeh, Thi-Ngoc-Hanh
Le, Zhi-Ying Hou, Tong-Yee Lee* "Generation and Optimization of Wire
Sculptural Art from 3D Models," ACM Transactions on Multimedia Computing, Communications
and Applications (TOMM) Volume 18,
Issue 2, May 2022, Article No.: 51, pp 1–23 Volume 18, Issue 2, May 2022, Article No.: 51, pp
1–23 (SCI/EI)
(5)
Yunfei Fu, Hongchuan Yu, Chih-Kuo Yeh, Jianjun Zhang, Tong-Yee
Lee* "High Relief from Brush Painting" IEEE
Transactions on Visualization and Computer Graphics (TVCG) vol. 25, No. 9, Sept., 2019, pp. 2763~2776 (SCI/EI)
(6)
Yi-Jheng Huang, Wen-Chieh Lin, I-Cheng Yeh, Tong-Yee
Lee* "Geometric and Textural Blending Approach to Design
Stylized Models," IEEE Transactions on Visualization and
Computer Graphics (TVCG), vol. 24, no. 2, pp. pp. 1114-1126,
Feb., 2018 (SCI/EI)
(7)
Chih-Kuo
Yeh, Shi-Yang Huang, Pradeep Kumar Jayaraman, Chi-Wing Fu, Tong-Yee
Lee* "Interactive High-Relief Reconstruction for Organic and
Double-sided Objects from a Photo," IEEE Transactions on
Visualization and Computer Graphics (TVCG), No. 7, July, Vol. 23, 2017, pp. 1796-1808 (SCI/EI)
(8)
Hongchuan
YU, Tong-Yee Lee, I-Cheng Yeh, Xiaosong Yang, Wenxi Li and
Jian J. Zhang, “RBF based Reparameterization Method for Constrained Texture
Mapping,” IEEE Transactions on Visualization and Computer Graphics (TVCG), July 2012 (vol. 18 no. 7) pp.
1115-1124 (SCI/EI)
(9)
I-Cheng
Yeh, Chao-Hung Lin, Olga Sorkine, Tong-Yee Lee*,
“Template-based 3D Model Fitting Using Dual-domain Relaxation,” IEEE
Transactions on Visualization and Computer Graphics (TVCG), Vol., 17, No. 8, pp. 1178-1190,
2011 (SCI/EI)
(10)
Min-Wen
Chao, Chao-Hung Lin, Cheng-Wei Yu and Tong-Yee Lee*, “A High
Capacity 3D Steganography Algorithm,” IEEE Transactions on
Visualization and Computer Graphics (TVCG), vol. 15 no. 2,pp. 274-284, 2009.
(11)
Yu-Shuen
Wang, Tong-Yee Lee*, “Curve Skeleton Extraction Using
Non-Linear Least Squares Optimization,” IEEE Transactions on
Visualization and Computer Graphics (TVCG), Vol. 14, No. 4. 2008, pp. 926-936
(12)
Oscar
Kin-Chung Au, Chiew-Lan Tai, Hung-Kuo Chu, Daniel Cohen-Or, Tong-Yee
Lee, “SkeletonExtraction by Mesh Contraction,” ACM
Transaction on Graphics (TOG)
(also in Proceedings of ACM SIGGRAPH 2008) Vol. 27, No.3,
Article: 44, August 2008 (SCI/EI)
(13)
Zhi-Yuan
Yao, Tong-Yee Lee*, “Adaptive Geometry Image,” IEEE
Transactions on Visualization and Computer Graphics (TVCG), July/Aug, Vol. 14, No. 4, 2008,
pp. 948-960 (SCI/EI)
(14)
Tong-Yee Lee*, Shao-Wei Yen I-Cheng Yeh, “Texture Mapping with Hard Constraints
Using Warping Scheme,” IEEE Transactions on Visualization and
Computer Graphics (TVCG),
March/April, Vol. 14,No. 2, pp. 382-395,2008 (SCI/EI)
Non-photo-realistic rendering (NPR)
& Illusion
In this research, we have developed stylized NPR, art-related
research such as Escher Arts and Camouflage Images, and illusion related
methods/application such as Self-Animating Images. In addition, some of our
approaches can be potentially applied to create high-quality aesthetic QR code
and still and animating “Captcha” images/video such as “Emerging Images”. We
also parallelize sort-last polygon rendering on 2D mesh multi-computers in my
earlier rendering research. Recently, we also decompose intrinsic images using
illumination optimization from a single image, create depth of field rendering
effect using multilayer-neighborhood optimization and also propose a real-time
vector graphics rendering.
(a) Self-Animating Images
(b) Escher
Arts (c) MSEmbGAN
(1)
Xiangqiao
Meng, Lei He, Tong-Yee Lee, Ping Li, "Super-Color:
Let There Be Focus," IEEE
Transactions on Visualization and
Computer Graphics (TVCG) (under revision), (2024/02) (SCI/EI)
(2) Xin-Rong Hu, Chen Yang, Jin Huang, Lei
Zhu, Ping Li, Bin Sheng, Tong-Yee Lee ,"MSEmbGAN :
Multi-Stitch Embroidery Synthesis via Region-Aware Texture Generation
Network," IEEE Transactions on
Visualization and Computer Graphics (TVCG)(accepted) (2024/08)(SCI/EI)
(3)
Huisi Wu, Zhaoze Wang, Yifan Li, Xueting
Liu, Tong-Yee Lee,”
Suitable and Style-consistent Multi-texture Recommendation for Cartoon
Illustrations,” ACM Transactions on Multimedia Computing Communications and Applications (TOMM), (SCI/EI) Volume
20 Issue 7,July, Article No.: 220 pp 1–26 https://doi.org/10.1145/3652518
(4)
Yu
Cao, Xiangqiao Meng, P. Y. Mok, Tong-Yee
Lee, Xueting Liu, and Ping Li, “AnimeDiffusion: Expressive Anime
Drawing Colorization via Intensive Diffusions,” IEEE Transactions on Visualization
and Computer Graphics (TVCG)
, vol. 30, no. 10, pp. 6956-6969, Oct. 2024, doi:
10.1109/TVCG.2024.3357568. (SCI/EI)
(5)
Kexin Wu, Ning Liu, Fan Tang,
Thi-Ngoc-Hanh Le, Oliver Deussen, Weiming Dong, Tong-Yee Lee,” Iterative Correlation-based Channel Pruning
for Efficient Image/Video Style Transfer,” IEEE Transactions on Circuits and Systems
for Video Technology, (SCI/EI) (submitted, 2023/07)
(6)
Chih-Kuo
Yeh, I-Hsuan Lin, Zhanping Liu, Eugene Zhang, and Tong-Yee Lee* "WYSIWYG Hypnotic Line Art Design" IEEE
Transactions on Visualization and Computer Graphics (TVCG) Vol. 28,
June 2022, pp. 2517-2529 (SCI/EI)
(7)
Juncong
Lin, Yinan Fu, Pintong Xiao, Yubin Shi, Hongran Wang, Shihui Guo, Ying He, Tong-Yee Lee "C^3 Assignment:
Camera CubeMaps Color Assignment for Creative Interior Design" IEEE Transactions on
Visualization and Computer Graphics (TVCG) Vol.
28, Issue: 8 (August), pp. 2895-2908, 2022 (SCI/EI)
(8)
Shihui Guo, Yubin
Shi, Pintong Xiao, Yinan Fu, Juncong Lin, Wei Zeng, Tong-Yee Lee "Creative and Progressive Interior Color
Design with Eye-tracked User Preference" ACM Transactions on
Computer-Human Interaction (TOCHI)
30 Issue 1 Article No.: 5, pp 1–31,2023 (SCI/EI) (SCI/EI)
(9)
Yunfei Fu, Hongchuan Yu, Chih-Kuo Yeh,
Tong-Yee Lee, Jianjun Zhang, “Fast Accurate and Automatic Brushstroke
Extraction" ACM
Transactions on Multimedia Computing, Communications and Applications (TOMM), May 2021,
Article No.: 44, pp 1–24 (SCI/EI)
(10) Yang Wen, Bin Sheng, Ping Li, Ping Tan, Tong-Yee Lee "Structure-Aware Motion Deblurring via
Multi-Adversarial Optimized CycleGAN" IEEE Transactions on Image Processing (TIP),
Volume: 30, July 2021, 6142 - 6155 (SCI/EI)
(11)
Benxuan Zhang, Bin Sheng, Ping Li, and Tong-Yee Lee "Depth of
Field Rendering Using Multilayer-Neighborhood Optimization" IEEE
Transactions on Visualization and Computer Graphics (TVCG) Vol. 26, No.8, pp 2546-2559, 2020 (SCI/EI)
(12) Kuo-Wei Chen, Ying-Sheng Luo, Yu-Chi Lai,
Yen-Lin Chen, Chih-Yuan Yao, Hung-Kuo Chu, Tong-Yee
Lee "Image Vectorization with Real-Time Thin-Plate Spline," IEEE
Transactions on Multimedia (TMM),
VOL.
22, NO. 1, January,
pp. 15~29, 2020 (SCI/EI)
(13)
Bin Sheng, Ping Li, Yuxi Jin, Ping Tan,
and Tong-Yee Lee, "Intrinsic Images Decomposition
Using Illumination Optimization from a Single Image" IEEE
Transactions on Visualization and Computer Graphics (TVCG) VOL.
26, NO. 2, FEBRUARY, 2020, pp. 1332~1346 (SCI/EI)
(14)
Shih-Syun Lin, Charles C. Morace, Chao-Hung Lin, Li-Fong Hsu, Tong-Yee
Lee* "Generation of Escher Arts with Dual Perception" IEEE
Transactions on Visualization and Computer Graphics (TVCG), vol. 24, no. 2, pp. 1103-1113, Feb.,2018, (SCI/EI)
(15)
Ying-Miao
Kuo, Hung-Kuo Chu, Ming-Te Chi, Ruen-rone Lee, Tong-Yee Lee,
"Ambiguous Figure-Ground Images," IEEE Transactions on
Visualization and Computer Graphics (TVCG), Issue No. 05 - May, vol. 23, 2017, pp.
1534-1545, 2017 (SCI/EI)
(16)
Shih-Syun
Lin, Min-Chun Hu, Chien-Han Lee, Tong-Yee Lee* "Efficient
QR Code Beautification with High Quality Visual Content," IEEE
Transactions on Multimedia (TMM),
Sept., 1515-1524, 2015 (SCI/EI)
(17)
Zhi-Yuan Yao, Ming-Te Chi, Tong-Yee Lee*, Tao Ju, “Region-Based
Line Field Design Using Harmonic Functions,” Vol. 18, No. 6, June Issue, IEEE
Transactions on Visualization and Computer Graphics (TVCG), pp.
902-913, 2012 (SCI/EI)
(18)
Hung-Kuo
Chu, Wei-Hsin Hsu, Niloy J. Mitra, Daniel Cohen-Or, Tien-Tsin Wong, Tong-Yee
Lee*, “Camouflage Images,” ACM Transaction on Graphics (TOG) (also
in Proceedings of SIGGRAPH 2010), Vol. 29, No.3,
Article No. 51, pp. 1-8, July 2010 (SCI/EI)
(19)
Niloy
J. Mitra, Hung-Kuo Chu, Tong-Yee Lee*, Lior Wolf, Hezy
Yeshurun, Daniel Cohen-Or, “Emerging Images, ” ACM Transaction on
Graphics (TOG)
(also in Proceedings of SIGGRAPH Asia 2009), Vol. 28,
No.5, Dec. 2009, (SCI/EI)
(20)
Ming-Te
Chi, Tong-Yee Lee*, Yingge Qu, Tien-Tsin Wong,
“Self-Animating Images: Illusory Motion Using Repeated Asymmetric Patterns,” ACM
Transaction on Graphics (TOG)
(also in Proceedings of ACM SIGGRAPH 2008) Vol.
27, No.3, August 2008 (SCI/EI)
(21)
Chung-Ren
Yan, Ming-Te Chi, Tong-Yee Lee*, Wen-Chieh Lin, ”Stylized
Rendering Using Samples of a Painted Image,” IEEE Transactions on
Visualization and Computer Graphics (TVCG), Vol. 14, No. 2, pp. 468-480, 2008(SCI/EI)
(22) Ming-Te Chi, Tong-Yee Lee*, "Stylized and
Abstract Painterly Rendering System Using a Multi-Scale Segmented Sphere
Hierarchy", VOL.
12, NO. 1, JANUARY/FEBRUARY, pp. 61-72, 2006, IEEE Transactions on
Visualization and Computer Graphics (TVCG) (SCI/EI).
(23) Ping-Hsien Lin, Tong-Yee Lee*, “Camera- Sampling Field and Its
Applications,” IEEE Transactions on Visualization and Computer Graphics (TVCG), Vol. 10, No. 3, May/June, 2004, pp.
241-251. (SCI/EI).
(24) Tong-Yee
Lee*, C.S Raghavendra,
J.B. Nicholas, ``Image Composition Schemes for Sort-Last Polygon Rendering on
2-D Mesh Multicomputers,'' Volume 2, Number 3 of the IEEE Transactions on
Visualization and Computer Graphics (TVCG), pp. 202-217, 1996. (SCI/EI)
Motion Overview + Animation
Generation+Music
We have developed 3D camera systems to generate good views (single v.s.
multiple camera paths) of 3D animation (single character v.s. multiple
characters), designed good searching method for 3D animation modelling and some
methods to generate 2.5D cartoon hair animation and propose double-sided 2.5D
carton animation, and also proposed physics-based 3D biped character animation.
In addition, we proposed methods to stabilize video sequence, i.e., avoid
shaking effect. In another our
2.5D projects, we introduce double-sided 2.5D graphics, aiming at enriching the
visual appearance when manipulating conventional 2D graphical objects in 2.5D
worlds. We also propose a novel three-fold solution to
handle the problem: (i and ii) new layering and completion methods to construct
a 2.5D hair model from a still cartoon image; and (iii) a deformation strategy
to animate 2.5D hairs based on fluid simulations.
(1) Sifei Li, Weiming Dong, Yuxin
Zhang, Fan Tang, Chongyang Ma, Oliver Deussen, Tong-Yee Lee, “Dance-to-Music
Generation with Encoder-based Textual Invers,” (accepted) ACM SIGGRAPH Asia
2024 Conference Proceeding (Technical Paper), ACM SIGGRAPH Asia 2024
Conference Proceeding (Technical Paper) Dec 2024,
Tokyo, Japan
(2)
Yu Cao, Xiangqiao Meng, P. Y. Mok, Tong-Yee Lee, Xueting Liu, and
Ping Li, “AnimeDiffusion: Expressive Anime Drawing Colorization via Intensive
Diffusions,” IEEE Transactions on Visualization and
Computer Graphics
(TVCG) vol. 30,
no. 10, pp. 6956-6969, Oct. 2024, (SCI/EI)
(3)
Ziyao
Huang, Fan Tang, Yong Zhang, Xiaodong Cun, Juan Cao,Jintao Li, Tong-Yee
Lee, "Make-Your-Anchor: A Diffusion-based 2D Avatar Generation
Framework," CVPR 2024 (The IEEE/CVF Conference on Computer Vision and Pattern
Recognition 2024) (204/02/27), Jun
17th through Fri Jun 21st, 2024, at the Seattle Convention Center,
2024/06
(4)
Thi-Ngoc-Hanh
Le, Shang-Yi Yao, Chun-Te Wu, and Tong-Yee
Lee* "Regenerating Arbitrary Video Sequences with Distillation
Path-Finding" IEEE Transactions on Visualization and Computer Graphics, vol.
30 July 2024, pp. 3622-3635
(SCI/EI)
(5)
Thi-Ngoc-Hanh Le, Ya-Hsuan Chen, Tong-Yee Lee* "Cartography-structure-aware
in Video Stylization with Cartography art," ACM Transactions on Multimedia
Computing Communications and Applications, ,19 Issue 3s Feb., Article No.: 131,pp 1–25, 2023 (SCI/EI)
(6)
Thi-Ngoc-Hanh
Le, Chih-Kuo Yeh, Ying-Chi Lin, Tong-Yee
Lee* "Animating still natural images using warping" ACM Transactions
on Multimedia Computing Communications and Applications (TOMM) Volume 19 Issue 1
January 2023 Article No.: 4 pp 1–24 (SCI/EI)
(7)
Bin Sheng, Ping Li, Nan Jiang, and Tong-Yee Lee
"One-Stop Photographing Assistant by Feature-Based Retrieval and
Instruction" IEEE Transactions on Multimedia (TMM),vol. 25, pp. 2226-2238, 2023 (SCI/EI)
(8) Chih-Kuo Yeh, Pradeep Kumar
Jayaraman, Xiaopei Liu, Chi-Wing Fu, Tong-Yee Lee* "2.5D
Cartoon Hair Modeling and Manipulation" IEEE Transactions on Visualization and Computer Graphics
(TVCG), Vol. 21, No.1, 2015, pp.
304-314 (SCI/EI)
(9)
YuShuen
Wang, Feng Liu, Pu-Sheng Hsu, Tong-Yee Lee*, “Spatially and Temporally
Optimized Video Stabilization,” IEEE Transactions on Visualization and
Computer Graphics (TVCG),
Vol. 19, No. 8, pp.1354-61, 2013. (SCI/EI)
(10)
Chih-Kuo
Yeh, Peng Song, Peng-Yen Lin, Chi-Wing Fu, Chao-Hung Lin, TongYee
Lee*, “Double-sided 2.5D Graphics,” IEEE Transactions on Visualization and Computer Graphics (TVCG), Vol. 19, No. 2, pp. 223-235,
2013 (SCI/EI)
(11) I-Cheng Yeh, Wen-Chieh Lin, Tong-Yee
Lee*, Hsin-Ju Han, Jehee Lee, Manmyung Kim, “Social-Event-Driven Camera
Control for Multi-Character Animations,” IEEE Transactions on Visualization and Computer Graphics
(TVCG) 2012, Sept Issue. (SCI/EI)
(12)
Min-Wen
Chao, Chao-Hung Lin, Jackie Assa, Tong-Yee Lee*, "Human
Motion Retrieval from Hand-drawn Sketch ," IEEE Transactions on
Visualization and Computer Graphics (TVCG), Vol. 18, No. 5, May Issue, pp. 729-740, 2012. (SCI/EI)
(13)
Yao-Yang
Tsai, Wen-Chieh Lin, Kuangyou B. Cheng, Jehee Lee, Tong-Yee Lee*,
“Real-time Physics-based 3D Biped Character Animation Using an Inverted Pendulum
Model ” IEEE Transaction Visualization and Computer Graphics (TVCG), March/April Issue,
Vol. 16, No. 2, pp. 325-337,2010 (SCI/EI)
(14)
Jackie
Assa, Daniel Cohen-Or, I-Cheng Yeh, Tong-Yee Lee, “Motion
Overview of Human Actions,” ACM Transaction on Graphics (TOG) (also in Proceedings of SIGGRAPH
Asia 2008) Vol. 27, No.5, Dec. 2008 (SCI/EI)
Focus+Context/Word and Image/Shape
Cloud/Map Art/ Visualization
We have
designed visualization techniques for focus+context, word cloud and map art visualization
via drawing/warping road network with mental map. In addition, we also extend
our method to handle multi-focus application to visualize coherent time-varying
graphs. Our word cloud
paper presents a novel method that uses rigid body dynamics to arrange
multi-temporal word-tags or 2D images/shapes in a specific shape sequence under
various constraints. We also present a new approach for time-varying graph drawing that
achieves both spatiotemporal coherence and multifocus+context visualization in
a single framework. We also present a new, interactive Focus+Context method for
visualizing large surface models. Our method, based on an energy optimization
model, allows the user to magnify an area of interest to see it in detail while
deforming the rest of the area without perceivable distortion. In addition, we
also execute feature-preserving 3D volume reduction and focus+context
visualization.
(1)
Zijun Zhou, Fan Tang, Yuxin Zhang, Oliver Debussen,
Juan Cao, Weiming Dong, Xiangtao Li, Tong-Yee Lee, “A
Comprehensive Evaluation of Arbitrary Image Style Transfer Methods,’ IEEE Transactions on
Visualization and Computer Graphics (TVCG) (accepted) (2024/09) (SCI/EI)
(2)
Huisi Wu, Zhaoze Wang, Yifan Li,
Xueting Liu, Tong-Yee Lee,”
Suitable and Style-consistent Multi-texture Recommendation for Cartoon
Illustrations,” ACM Transactions on Multimedia Computing Communications and Applications (TOMM), Volume 20 Issue 7,July, Article No.: 220 pp 1–26
https://doi.org/10.1145/3652518 (SCI/EI)
(3)
Yuxin Zhang, Weiming Dong, Fan Tang, Nisha
Huang, Haibin Huang, Chongyang Ma, Tong-Yee
Lee, Oliver Deussen, Changsheng Xu, “Prompt
Spectrum: Visual Attribute Transfer via Expanded Conditioning in Diffusion
Models,” (published
in the SIGGRAPH Asia
2023 issue) of ACM
Transactions on Graphics (TOG), 42,
6, Article 246 (December 2023), 14 pages. https://doi.org/10.1145/3618342 (SCI/EI)
(4)
Dong-Yi
Wu, Thi-Ngoc-Hanh Le, Shang-Yi Yao, Yun-Chen Lin, and Tong-Yee Lee*, ‘Image Collage on Arbitrary Shape via
Shape-Aware Slicing and Optimization,” IEEE Transactions on Visualization and
Computer Graphics (TVCG), vol. 30, no. 8 (August), pp. 4449-4463, Aug. 2024, doi:
10.1109/TVCG.2023.3262039 (SCI/EI)
(5)
Sheng-Yi Yao, Dong-Yi Wu,
Thi-Ngoc-Hanh Le, Tong-Yee Lee*,
‘"Shape Cloud Visualization,” IEEE Transactions on Visualization and
Computer Graphics
(TVCG), (under
revision), 2023/06 (SCI/EI)
(6)
Zhan Wang, Qian Zhu, David
Yip, Tong-Yee Lee, Fugee F
Gee, Wei Zeng, "CineFolio: Cinematography-Guided Camera Planning for
Immersive Narrative Visualization," IEEE Transactions on Visualization and
Computer Graphics (TVCG), (under revision), (2023/06) (SCI/EI)
(7)
Yuxin Zhang, Fan Tang, Weiming Dong,
Haibin Huang, Chongyang Ma, Tong-Yee Lee, Changsheng Xu, "A Unified
Arbitrary Style Transfer Framework via Adaptive Contrastive Learning," ACM
Transactions on Graphics (TOG) 42, 5, Article 169 (July 2023), 16 pages (SCI/EI)
(8)
Yuxin
Zhang, Fan Tang, Weiming Dong, Haibin Huang, Chongyang Ma, Tong-Yee Lee,
Changsheng Xu "“Domain Enhanced Arbitrary Image Style Transfer via
Contrastive Learning,”" ACM SIGGRAPH 2022 Conference Proceeding
(Technical Paper) (2022/08
(9)
Yu Song,
Fan Tang, Weiming Dong, Feiyue Huang, Tong-Yee
Lee. Changsheng Xu, “Balancing-Aware Grid Collage for Small Image
Collection,”IEEE Transactions on Visualization and Computer Graphics, (TVCG) Feb. 2023, pp. 1330-1344, vol. 29, DOI Bookmark: 10.1109/TVCG.2021.3113031
(10)
Anam Nazir,
Muhammad Nadeem Cheema, Bin Sheng, Ping Li, Jinman Kim and Tong-Yee Lee
" Living Donor-Recipient Pair Matching for Liver Transplant via Ternary
Tree Representation with Cascade Incremental Learning" (featured article) IEEE
Trans. Biomedical Engineering Volume: (TBME) 68,
Issue: 8, pp. 2540-2551,
August 2021 (SCI/EI)
(11)
Xingjia Pan, Fan Tang,
Weiming Dong, Chongyang Ma, Yiping Meng, Tong-Yee
Lee, Changsheng Xu, "Content-Based Visual Summarization for Image
Collection" IEEE Transactions on Visualization and Computer Graphics (TVCG), Vol.
27, Issue 4, pp. 2298-2312, April 2021 (SCI/EI)
(12) Ming-Te Chi, Shih-Syun Lin, Shiang-Yi
Chen, Chao-Hung Lin, Tong-Yee Lee*, "Morphable Word
Clouds for Time-varying Text Data Visualization," IEEE
Transactions on Visualization and Computer Graphics (TVCG), No.12 - Dec. ,vol.21, pp: 1415-1426,
2015 (SCI/EI) (also presented at ACM SIGGRAPH Asia,
Kobe, Japan, Nov. 2-5. 2015) (SCI/EI)
(13) Shih-Syun Lin ,Chao-Hung Lin,
Yan-Jhang Hu, Tong-Yee Lee*, “Drawing Road Networks with
Mental Maps,” IEEE Transactions on Visualization and Computer Graphics
(TVCG), Vol. 20, No.9, pp.
1241-1252, Sept. Issue, 2014. (SCI/EI) (also presented at ACM SIGGRAPH
Asia 2014, Shenzhen, China. Dec. 2014) (SCI/EI)
(14) Kun-Chuan Feng, Chaoli Wang, Han-Wei
Shen, Tong-Yee Lee*, “Coherent Time-Varying Graph Drawing
with Multi-Focus+Context Interaction,” IEEE Transactions on
Visualization and Computer Graphics (TVCG), Vol. 18, No. 8, August 2012, pp. 1330-1342(SCI/EI)
(15) YuShuen Wang, Chaoli Wang, Tong-Yee
Lee*, Kwan-Liu Ma, “Feature-Preserving Volume Data Reduction and
Focus+Context Visualization,” IEEE Transactions on Visualization and
Computer Graphics (TVCG),
Vol. 17, No.2, Feb. Issue, pp. 171-181, 2011 (SCI/EI)
(16) Yu-Shuen Wang, Tong-Yee
Lee*, Chiew-Lan Tai, “Focus+Context Visualization with Distortion
Minimization,” IEEE Transactions on Visualization and Computer
Graphics (TVCG) (also
in Proceedings of IEEE Visualization), Volume 14, Number 6,
November, 2008 (SCI/EI)
Morphing, Shape Interpolation and its Medical Applications
We design 2D/3D metamorphosis techniques for solving different
conditions, i.e., fixed and different poses, merged mesh vs. progressive
meshes. In addition, we solve the
problem of 3D shape interpolation with significant pose variation. In contrast to
a state-of-the-art work, the proposed approach can achieve comparable or even
better results and have better computational efficiency as well. We also
present a compact representation for animating meshes based on novel key-frames
extraction and animating mesh simplification approaches. The proposed methods
are based on a deformation analysis of animating mesh to preserve both the
geometric features and motion characteristics. Finally, we also apply morphing technique to 2D/3D medical image
interpolation and 3D surgical simulation such as colonoscopy execution and
facial/nose (Rhinoplasty) surgery.
(1)
Ziyao Huang, Fan
Tang, Yong Zhang, Juan Cao, Chengyu
Li, Sheng Tang, Jintao Li, Tong-Yee Lee, “Identity-Preserving
Face Swapping via Dual Surrogate Generative Models,” ACM Transactions on Graphics (TOG),
(to present it at ACM Siggraph
Asia 2024, Tokyo,
Japan, 2024). Dec. 2024), Volume 43, Issue 5, October,
Article No.: 161, Pages 1 – 19, https://doi.org/10.1145/3676165 [project] (SCI/EI)
(2)
Huisi Wu, Baiming Zhang, Zhuoying Li, Jing
Qin, and Tong-Yee Lee,
"3DSN-Net: A 3D scale-aware convNet with non-local context guidance for
kidney and tumor segmentation from CT volumes," IEEE Transactions on
Cybernetics (TCYB) May 2024, Vol. 54, Issue: 5,
3299-3312 10.1109/TCYB.2023.3291369, Online
ISSN: 2168-2275 (SCI/EI)
(3)
Hung-Kuo
Chu, Tong-Yee Lee*, “Multi-resolution Mean Shift Clustering
Algorithm for Shape Interpolation,” IEEE Transactions on
Visualization and Computer Graphics (TVCG), vol. 15, No. 5, pp. 853-866, 2009(SCI/EI)
(4)
Tong-Yee
Lee*, Chao-Hung Lin, Yu-Shuen Wang,
Tai-Guang Chen," Animation Key-frame Extraction and Simplification Using
Deformation Analysis," IEEE Transactions on Circuits and
Systems for Video Technology (TCSVT), April, Vol. 18, No. 4, 2008, pp.
478-486 (SCI/EI)
(5)
Tong-Yee Lee*, Chung-Ren Yen, Ming-Te Chi, “Stylized Rendering for Anatomic
Visualization,” Special Issue - Anatomic Rendering and
Visualization, IEEE Computing in Science & Engineering (CiSE), vol. 9, no. 1, pp.
13-19, Jan/Feb, 2007 (SCI/EI)
(6)
Chao-Hung
Lin, Tong-Yee Lee*, “Metamorphosis of 3D Polyhedral
Models Using Progressive Connectivity Transformations,” IEEE
Transactions on Visualization and Computer Graphics (TVCG),
Jan./Feb. Issue, Vol. 11, No.1, pp. 2-12, 2005(SCI/EI)
(7)
Tong-Yee
Lee*, Po-Hua Huang, “Fast and Intuitive
Metamorphosis of 3D Polyhedra Models Using SMCC Mesh Merging Scheme, “ IEEE
Transactions on Visualization and Computer Graphics (TVCG), Vol.
9, No. 1, Jan-March, 2003, pp 85-98(SCI/EI)
(8)
Tong-Yee
Lee*, Chao-Hung Lin, “Feature-guided
Shape-based Image Interpolation”, IEEE Transactions on Medical
Imaging (IEEE TMI), Dec. 2002 Vol. 21, No. 12, pp. 1479-1489. (SCI/EI)
(9)
Tong-Yee
Lee*, Wen-Hsui Wang,"
Morphology-based Three-dimensional Interpolation," IEEE
Transactions on Medical Imaging (IEEE TMI) Vol. 19, Issue
7, pp. 711-721, 2000 (SCI/EI)
(10)
Tong-Yee
Lee*, Chao-Hung Lin, Han-Ying Lin,
"Computer-aided Prototype System for Nose Surgery
(Rhinoplasty)," IEEE Transactions on Information Technology in
Biomedicine (IEEE TITB), Vol. 5, Issue 4, pp. 271-278,
2001(SCI/EI)
(11)
Tong-Yee
Lee*, Yung-Nein Sun, Y. C. Lin, Leewen
Lin, C.N. Lee, " Three Dimensional Facial Model Reconstruction &
Plastic Surgery Simulation," IEEE Transactions on Information
Technology in Biomedicine (IEEE TITB), Vol. 3, No. 3, pp. 214-220,
1999. (SCI/EI)
(12)
Tong-Yee
Lee*, Ping-Hsien Lin, Chao-Hung Lin,
Yung-Nein Sun, Xi-Zhang Lin, "Interactive 3D Virtual Colonoscopy
System," IEEE Transactions on Information Technology in
Biomedicine (IEEE TITB), Vol 03, No. 02, pp. 139-150, 1999.
(SCI/EI)