hct logo part1UBC
department of ECE
HCT title
about_hctresearchpeopleopportunitiespublicationsresourcescontact
side menu top
music and sound
art and performance
physical interfaces
modeling
graphics
side menu end
hct logo part2
ArtiSynth
A 3D Biomechanical Modeling Toolkit
ArtiSynth A Project by
Sidney Fels
John Loyd
Kees van den Doel
Bryan Gick
Alan Hannam
Carol Jaeger
Eric Vatikiotis-Bateson
Ian Stavness
Edgar Flores


Abstract
ArtiSynth Website
Funding
Publications
Contact Information

ArtiSynth is a 3D biomechanical simulation platform directed toward modelling the vocal tract and upper airway. It provides an open-source, cross-platform environment in which researchers can create and interconnect various kinds of dynamic and parametric models to form a complete integrated biomechanical system that is capable of articulatory speech synthesis. An interactive graphical timeline runs the simulation and allows the temporal arrangement of input/output channels to control or observe properties of the model's components. Library support is available for particle-spring and rigid body systems, finite element models, and spline-based curves and surfaces. To date, these have been used to create a dynamic muscle-based model of the jaw, a deformable tongue model, a deformable airway, and a non-linear acoustics model, which have been connected together to form a complete vocal tract that produces speech and is drivable both by data and by dynamics.

ArtiSynth Website

For more detailed project information visit

Funding

We gratefully acknowledge our funding partners:

  • Natural Sciences and Engineering Research Council of Canada (NSERC)
  • Advanced Telecommunication Research (ATR - Japan)
  • Communication Research Lab (CRL - Japan)
  • Peter Wall Institute for Advanced Studies (PWIAS)

Publications

PDFbibtexSidney S. Fels and John E. Lloyd and Ian Stavness and Florian Vogt and Alan Hannam and Eric Vatikiotis-Bateson. ArtiSynth: A 3D biomechanical simulation toolkit for modeling anatomical structures. Journal of the Society for Simulation in Healthcare. Volume 2. No. 2. Pages 148. 2007. 2007.
PDFbibtexFlorian Vogt and John E. Lloyd and Stephanie Buchaillard and Pascal Perrier and Matthieu Chabanas and Yohan Payan and Sidney S. Fels. An Efficient Biomechanical Tongue Model for Speech Research. Proceedings of ISSP 06. Pages 51-58. 2006. 2006.
PDFbibtexKees van den Doel and Florian Vogt and R. Elliot English and Sidney S. Fels. Towards Articulatory Speech Synthesis with a Dynamic 3D Finite Element Tongue Model. Proceedings of ISSP 06. Pages 59-66. 2006. 2006.
PDFbibtexSidney S. Fels and John E. Lloyd and Kees van den Doel and Florian Vogt and Ian Stavness and Eric Vatikiotis-Bateson. Developing Physically-Based, Dynamic Vocal Tract Models using ArtiSynth. Proceedings of ISSP 06. Pages 419-426. 2006. 2006.
PDFbibtexIan Stavness and Alan G. Hannam and John E. Lloyd and Sidney Fels. An Integrated, Dynamic Jaw and Laryngeal Model Constructed From CT Data. Proceedings of ISBMS 06 in Springer LNCS 4072. Pages 169-177. 2006. 2006.
PDFbibtexFlorian Vogt and John E. Lloyd and Stephanie Buchaillard and Pascal Perrier and Matthieu Chabanas and Yohan Payan and Sidney S. Fels. Investigation of Efficient 3D Finite Element Modeling of a Muscle-Activated Tongue. Proceedings of ISBMS 06 in Springer LNCS 4072. Pages 19-28. 2006. 2006.
PDFbibtexSidney Fels and Florian Vogt and Kees van den Doel and John Lloyd and Ian Stavness and Eric Vatikiotis-Bateson. ArtiSynth: A Biomechanical Simulation Platform for the Vocal Tract and Upper Airway. No. TR-2006-10. Computer Science Dept., University of British Columbia.
PDFbibtexFlorian Vogt. Finite Element Modeling of the Tongue. International Workshop on Auditory Visual Speech Processing. Pages 143-144. July. 2005. 2005.
PDFbibtexSidney Fels and Florian Vogt and Kees van den Doel and John Lloyd and Oliver Guenter. Artisynth: Towards Realizing an Extensible, Portable 3D Articulatory Speech Synthesizer. International Workshop on Auditory Visual Speech Processing. Pages 119-124. July. 2005. 2005.
PDFbibtexFlorian Vogt and Oliver Guenther and Alan Hannam and Kees van den Doel and John Lloyd and Leah Vilhan and Rahul Chander and Justin Lam and Charles Wilson and Kalev Tait and Donald Derrick and Ian Wilson and Carol Jaeger and Bryan Gick and Eric Vatikiotis-Bateson and Sidney Fels. ArtiSynth Designing a modular 3d articulatory speech Synthesizer. Journal of the Acoustical Society of America. Volume 117. No. 4. Pages 2542. May. 2005. 2005.
PDFbibtexEdgar Flores and Sidney Fels. Design of a 6DOF Antropomorphic Robotic Jaw. Journal of the Acoustical Society of America. Volume 117. No. 4. Pages 2542. May. 2005. 2005.
PDFbibtexSidney S. Fels and Florian Vogt and Bryan Gick and Carol Jaeger and Ian Wilson. User-centered Design for an Open source 3D Articulatory synthesizer. Processdings of the 15th International Congress of Phonetic Science (ICPhS). Pages 179-182. 2003. 2003.
PDFbibtexFlorian Vogt and Sidney S. Fels and Bryan Gick and Carol Jaeger and Ian Wilson. Extensible infrastructure for a 3D face and vocal-tract model. Processdings of the 15th International Congress of Phonetic Science (ICPhS). Pages 2345-2349. 2003. 2003.
PDFbibtexFlorian Vogt and Graeme McCaig and Adnan Mir Ali and Sidney S. Fels. Tongue 'n' Groove. 2nd International Conference on New Interfaces for Musical Expression (NIME02). Pages 60-64. May. 2002. 2002.
PDFbibtexFlorian Vogt and Ian Wilson and Sidney S. Fels and Bryan Gick. Articulatory speech synthesis based on 3D human vocal-tract simulation. BC Advanced Systems Institute Exchange (ASI 2001), Poster presentation. Mar. 2001. 2001.

Contact Information

Sidney Fels


Last up-dated: 01/11/2007
© 2002-2005 HCT
about_hctresearchpeopleopportunitiespublicationsresourcescontact