交互式元素填充动画技术

Interactive element packing for animation

摘要

现有的元素填充算法通过逐帧计算或脚本动画的方法帮助设计师加快设计过程,然而无法满足设计师的交互性需求。本文采用笔刷作为交互工具,在物理系统中通过笔刷控制静态元素填充图案中的元素运动生成元素填充动画,利用过滤器消除动画中不可避免的元素抖动,降低元素填充动画设计的门槛。通过物理系统的消融实验以及与现有方法的对比实验,邀请多位测试用户进行用户调研,验证交互式元素填充动画技术具有较高紧密性和稳定性,用户能够交互式设计元素填充动画,利用视频演示实现完整交互。

Abstract

Exiting element packing algorithms attempt to accelerate design process through frame-by-frame computation or scripted animations, yet algorithms fail to meeting designer’s interactive needs. In this work, we introduce a brush-based interactive system that allows designers to control the movement of elements within a static element packing pattern, enabling seamless animation generation. The effectiveness of the proposed system for interactive design is demonstrated via ablation studies, comparative experiments with existing methods, and a user study involving multiple participants, showing that it enables users to create personalized element packing animations more conveniently.

关键词

元素填充 / 动画 / 物理模拟 / 笔刷设计

Key words

element packing / animation / physics simulation / brush design

参考文献

[1] XING Jinbo , LIU Hanyuan , XIA Menghan , et al. Tooncrafter: generative cartoon interpolation[J]. ACM Transactions on Graphics, 2024, 43(6): 1-11.

[2] SMITH K , LIU Yunjun , KLEIN A . Animosiacs[C]// Proceedings of the ACM Eurographics Symposium on Computer Animation. New York: ACM, 2005: 201-208.

[3] SAPUTRA R A , KAPLAN C S , ASENTE P . Animation Pak: packing elements with scripted animations[C]// Proceedings of the 46th Graphics Interface Conference. Toronto: ACM, 2020: 393-403.

[4] SAPUTRA R A , KAPLAN C S , ASENTE P , et al. Repulsion Pak: deformation—driven element packing with repulsion forces[C]// Proceedings of the 44th Graphics Interface Conference. Toronto: ACM, 2018: 10-17.

[5] SAPUTRA R A , KAPLAN C S , ASENTE P . Improved deformation—driven element packing with repulsion Pak[J]. IEEE Transactions on Visualization and Computer Graphics, 2019, 27(4): 2396-2408.

[6] 梁沐, 徐鹏飞, 黄惠 . 基于笔刷的交互式元素填充技术[J]. 图学学报, 2025, 46(1): 188-199.

[7] LIANG Mu , XU Pengfei , HUANG Hui . Brush—based interactive element packing[J]. Journal of Graphics, 2025, 46(1): 188-199.

[8] KAZI R H , CHEVALIER F , GROSSMAN T , et al. Kitty: sketching dynamic and interactive illustrations[C]// Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology. Hawaii: ACM, 2014: 395-405.

[9] WILLETT N S , KAZI R H , CHEN M , et al. A mixed—initiative interface for animating static pictures[C]// Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology. Busan: ACM, 2018: 649-661.

[10] XING Jun , LI Yiwei , SHIRATORI T , et al. Autocomplete hand—drawn animations[J]. ACM Transactions on Graphics, 2015, 34(6): 1-11.

[11] SU Qingkun , BAI Xue , FU Hongbo , et al. Livesketch: video—driven dynamic deformation of static drawings[C]// Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. Montreal: ACM, 2018: 1-12.

[12] SCOTT J , DAVIS R . Physink: sketching physical behavior[C]// Proceedings of the 26th Annual ACM Symposium on User Interface Software and Technology. Andrews: ACM, 2013: 9-10.

[13] XING J , KAZI R H , GROSSMAN T , et al. Energy—brushes: interactive tools for illustrating stylized elemental dynamics[C]// Proceedings of the 29th Annual Symposium on User Interface Software and Technology. Tokyo: ACM, 2016: 755-766.

[14] IGARASHI T , MOSCOVICH T , HUGHES J F . As—rigid—as—possible shape manipulation[J]. ACM Transactions on Graphics, 2005, 24(3): 1134-1141.

[15] SMITH H J , ZHENG Q Y , LI Y F , et al. A method for animating children’s drawings of the human figure[J]. ACM Transactions on Graphics, 2023, 42(3): 1-15.

[16] WILLETT N S , LI W , POPOVIC J , et al. Secondary motion for performed 2D animation[C]// Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology. Quebec City: ACM, 2017: 97-108.

[17] ZHANG J E , BANG S , LEVIN D I , et al. Complementary dynamics[J]. ACM Transactions on Graphics, 2020, 39(6): 1-11.

[18] NIETO J R , SUSÍN A . Cage based deformations: a survey[C]// Proceedings of the Deformation Models: Tracking, Animation and Applications. Netherlands: Springer, 2012: 75-99.

[19] KAZI R H , GROSSMAN T , UMETANI N , et al. Motion amplifiers: sketching dynamic illustrations using the principles of 2D animation[C]// Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. San Jose: ACM, 2016: 4599-4609.

[20] MÜLLER M , HEIDELBERGER B , TESCHNER M , et al. Meshless deformations based on shape matching[J]. ACM Transactions on Graphics, 2005, 24(3): 471-478.

[21] WU Y H , UMETANI N . Two—way coupling of skinning transformations and position based dynamics[C]// Proceedings of the ACM on Computer Graphics and Interactive Techniques. Los Angeles: ACM, 2023: 1-18.

[22] JACOBSON A , DENG Z G , KAVAN L , et al. Skinning: real—time shape deformation[C]// Proceedings of the SIGGRAPH 2014 Courses. Vancouver: ACM, 2014.

[23] MÜLLER M , HEIDELBERGER B , HENNIX M , et al. Position based dynamics[J]. Journal of Visual Communication and Image Representation, 2007, 18(2): 109-118.

[24] FAN X Y , BERMANO A H , KIM V G , et al. ToonCap: a layered deformable model for capturing poses from cartoon characters[C]// Proceedings of the Joint Symposium on Computational Aesthetics and Sketch—based Interfaces and Modeling and Non—photorealistic Animation and Rendering. Victoria: ACM, 2018: 1-12.

[25] SEDERBERG T W , PARRY S R . Free—form deformation of solid geometric models[C]// Proceedings of the 13th Annual Conference on Computer Graphics and Interactive Techniques. Dallas: ACM, 1986: 151-160.

[26] RAI G , GUPTA S , SHARMA O . SketchAnim: real—time sketch animation transfer from videos[J]. Computer Graphics Forum, 2024, 43(8): 15176.

[27] FLOATER M S . Mean value coordinates[J]. Computer Aided Geometric Design, 2003, 20(1): 19-27.

[28] JACOBSON A , BARAN I , POPOVIC J , et al. Bounded biharmonic weights for real—time deformation[J]. ACM Transactions on Graph, 2011, 30(4): 78.

[29] PAN Junjun , ZHANG Jun . Sketch—based skeleton—driven 2D animation and motion capture[J]. Transactions on edutainment VI, 2011: 164-181.

[30] KWAN K C , SINN L T , HAN C , et al. Pyramid of arc length descriptor for generating collage of shapes[J]. ACM Transactions on Graphics, 2016, 35(6): 229-241.

[31] SAPUTRA R A , KAPLAN C S , ASENTE P , et al. Repulsion Pak: deformation—driven element packing with repulsion forces[C]// Proceedings of the 44th Graphics Interface conference. Toronto: ACM, 2018: 10-17.

[32] SAPUTRA R A , KAPLAN C S , ASENTE P . Improved deformation—driven element packing with repulsion Pak[J]. IEEE Transactions on Visualization and Computer Graphics, 2019, 27(4): 2396-2408.

[33] REINERT B , RITSCHEL T , SEIDEL H P . Interactive by—example design of artistic packing layouts[J]. ACM Transactions on Graphics, 2013, 32(6): 1-7.

[34] HSU Chenyuan , LI Yiwei , YOU Lihua , et al. Brushing element fields[C]// Proceedings of the SIGGRAPH Asia Technical Briefs. Tokyo: ACM, 2018: 1-4.

[35] HSU Chenyuan , LI Yiwei , YOU Lihua , et al. Autocomplete element fields[C]// Proceedings of the CHI Conference on Human Factors in Computing Systems. Hawaii: ACM, 2020: 1-13.

[36] SAPUTRA R A , KAPLAN C S , ASENTE P , et al. FlowPak: flow—based ornamental element packing[C]// Proceedings of the 43rd Graphics Interface Conference. Waterloo: ACM, 2017: 8-15.

[37] HÄDRICH T , BANUTI D T , PAŁUBICKI W , et al. Fire in paradise: mesoscale simulation of wildfires[J]. ACM Transactions on Graphics, 2021, 40(4): 1-15.

[38] BARAFF D , WITKIN A , KASS M . Untangling cloth[J]. ACM Transactions on Graphics, 2003, 22(3): 862-870.

[39] LIU T T , BARGTEIL A W , O’BRIEN J F , et al. Fast simulation of mass—spring systems[J]. ACM Transactions on Graphics, 2013, 32(6): 1-7.

[40] MIRTICH B , CANNY J . Impulse—based simulation of rigid bodies[C]// Proceedings of the 1995 Symposium on Interactive 3D Graphics. Monterey: ACM, 1995: 181-188.

[41] JAN B , MÜLLER M , MACKLIN M . A survey on position based dynamics[C]// Proceedings of the European Association for Computer Graphics. Lyon: Wiley, 2017: 1-31.

[42] MACKLIN M , MÜLLER M , CHENTANEZ N . XPBD: position—based simulation of compliant constrained dynamics[C]// Proceedings of the 9th International Conference on Motion in Games. California: ACM, 2016: 49-54.

基金资助

国家自然科学基金资助项目(62472287)

广东省自然科学基金资助项目(2023A1515011297)