期刊文献+
任意字段
题名或关键词
题名
关键词
文摘
作者
第一作者
机构
刊名
分类号
参考文献
作者简介
基金资助
栏目信息

基于SVD的唇动视觉语音特征提取技术 被引量：3

Visual-audio feature extraction of lip movements based on SVD
在线阅读 下载PDF
导出
摘要 唇动视觉语音特征提取是音视频驱动的人脸动画唇动表示和唇读研究的关键技术.首先针对彩色视频图像进行唇色增强,对增强后的灰度图像进行阈值分割,获取唇部包围框,并根据口型发音的视觉特征进行初分类;然后进行尺度与灰度归一化处理,对预处理后的图像提取奇异值特征;最后采用基于欧氏距离的模板匹配法对该奇异值特征所包含的视觉语音信息进行测试试验,结果表明该低维度特征包含了大量唇动视觉语音信息,可用于单个人在自然环境下的唇语口型识别. Visual feature extraction of lip movement is a key issue in video and speech driven face (animation systems. )The approach is like this: firstly enhance chromatic video image, then segment enhanced gray images with thresholds, and finally obtain lip shapes. This method classifies the lip-shapes according to the visual features of pronunciations, regulates the dimensions and grayscales of lip images, and (extracts) features based on SVD from the preprocessed images. Finally, the template (matching algorithm based ) on Euclidean distance is applied. The results show that the character of lower dimensions includes a large number of visual speeches' information, so it can be applied in individual natural conditions.
作者 张建明 陶宏 王良民 詹永照 宋顺林
机构地区 江苏大学计算机科学与通讯工程学院
出处 《江苏大学学报（自然科学版）》 EI CAS 2004年第5期426-429,共4页 Journal of Jiangsu University：Natural Science Edition
基金 国家自然科学基金资助项目(60273040) 江苏省高校自然科学基金资助项目(02KJB520003)
关键词 唇动 特征提取 SVD 唇读 lip movements feature extraction SVD lipreading
分类号 TP391.4 [自动化与计算机技术—计算机应用技术]
  • 相关文献

参考文献13

  • 1Potamianos G, Neti C, Iyengar G, et al. A cascade visual front end for speaker independent automatic speechreading[J]. International Journal of speech technology, 2001 (4) :193 -208.
  • 2Gerasimos Potamianos, Chalapathy Neti. Improved ROI and within frame discriminant features for lipreading[A]. In: Proceedings of the International Conference on Image Processing[C]. Piscataway: IEEE, 2001.
  • 3Kazuhiro Nakamura, Noriaki Murakam, Ka-zuyoshi Takagi, et al. A real-time lipreading LSI for word recognition [J/OL]. http:∥www. ap-asic. org/2002/proceedings/SC/3C _ 5. pdf, 2002.
  • 4姚鸿勋,吕雅娟,高文.基于色度分析的唇动特征提取与识别[J].电子学报,2002,30(2):168-172. 被引量：9
  • 5AWC Liew, SH Leung, WH Lau. Lip contour extraction from color images using a deformable model[J]. Pattern Recognition, 2002, 35: 2949- 2962.
  • 6Uda K, Tagawa N, Minagawa A, et al. Effectiveness evaluation of word characteristics obtained from 3D image information for lipreading[A]. In: Proceedings 11th International Conference on Image Analysis and Processing[C]. Los Alamitos: IEEE, 2001.
  • 7Matthews I, Potamianos G, Neti C, et al. A comparison of model and transform-based visual features for audiovisual LVCSR[A]. In: Proc lnt Conf Multimedia Expo[C]. Los Alamitos: IEEE, 2001.
  • 8lain Matthews J , Andrew Bangham , Richard Harvey.Extraction of visual features for lipreading [J]. IEEE Transaction on Pattern Analysis and Machine Intelligence, 2002,24(2) :198 -213.
  • 9Zhang Jian-ming, Wang Liang-min, Niu De-jiao, et al.Research and implementation of a real time approach to lip detection in video sequences [A]. In: Proceedings of 2003 International Conference on Machine Learning and Cybernetics [C]. Piscataway: IEEE, 2003.
  • 10王良民,张建明,詹永照,宋顺林.人脸检测研究现状和发展[J].江苏大学学报（自然科学版）,2003,24(3):75-79. 被引量：13

二级参考文献30

  • 1Yang J, Waibel A. A Real-Tine Face Tracker[C]. In:IEEE Proc of the 3^rd Workshop on ACV, Florida,1996.
  • 2Hongo H, Ohya M, Yasumoto M. Focus of Attention for Face and Hand Gesture Recognition Using Multiple Cameras[C]. In: pro 4^th IEEE Inter Conf on AFGR,2000.
  • 3Yoo T W, Oh I S. A Fast Algorithm for Tracking Humane Faces Based in Chromatic Histogram[J ]. Pattern Recognition Letters, 1999, 20(10) :967 - 978.
  • 4Yuille A, Hallinan P, Cohen D. Feature Extraction from Faces Using Deformable Templates [ J ]. International Journal of Computer Vision, 1992, 8 (2) : 99 - 111.
  • 5Yang G Z, Huang T S. Human Face Detection in a Complex Background [ J ]. Pattern Recognition, 1994,27(1): 53-63.
  • 6Turk M, Pentland, A. Eigenface for Recognition[J]. JCog Neurosei, 1991,23(3) :71 - 86.
  • 7Moghaddam B, Pentland A. Probabilistic Visual Learning for Object Representation[J ]. IEEE Trans on Pattern Analysis and Machine Intelligence, 1997, 19 (7) :696 - 710.
  • 8Sung K K , Poggio T . Example - Based Learning for View-Based Human Face Detection[J ]. IEEE Trans on Pattern Analysis and Machine Intelligence, 1998, 20(1):39-51.
  • 9Rowley H A, Baluja S, Kanade T. Neural Network Based Face Detection[J]. IEEE Trans Pattern Analysis and Machine Intelligence, 1998, 20(1) :23 - 38.
  • 10Rowley H A, Baluja S, Kanade T. Rotation Invariant Neural Network Based Face Detection[C]. In:Proceeding of IEEE Computer Society Conference on CVPR'98. California, 1998.

共引文献97

同被引文献87

  • 1汤敏,王元全,夏德深.基于Snake模型的嘴部特征分割[J].计算机工程,2004,30(21):7-9. 被引量：5
  • 2洪子泉,杨静宇.基于奇异值特征和统计模型的人像识别算法[J].计算机研究与发展,1994,31(3):60-65. 被引量：49
  • 3刘剑毅,郑南宁,游屈波.一种基于小波的人脸衰老化合成方法[J].软件学报,2007,18(2):469-476. 被引量：7
  • 4Scanlon P,Reilly R B.Feature analysis for automatic speechreading[C]//IEEE International Conference on Multimedia Signal Processing.Cannes,France:IEEE,2001:625-630.
  • 5Guitarte Pérez J F,Frangi A F,Lleida Solano E,et al.Lip reading for robust speech recognition on embedded devices[C]//IEEE International Conference on Acoustics,Speech,and Signal Processing.Philadelphia,PA,USA:IEEE,2005,1:473-476.
  • 6Potamianos G,Neti C.Improved ROI and within frame discriminant features for lipreading[C]//International Conference on Image Processing.Thessaloniki.Greece:IEEE.2001,3:250-253.
  • 7Iwano K,Tamura S,Furui S.Bimodal speech recognition using lip movement measured by opticalflow analysis[C]//InternationaI Workshop on Hands-Free Speech Communication.Kyoto,Japan:[s.n.],2001:187-190.
  • 8Gray M S,Movellan J R,Sejnowski T J,et al.Dynamic features for visual speechreading:a systematic comparison[C]//3rd Joint Symposium on Neural Computation.La Jolla,CA,USA:University of California,San Diego,1996,6:222-230.
  • 9Luettin J,Thaeker N A,Beet S W.Visual speechrecognition using active shape models and hidden markov models[C]//IEEE International Conference on Acoustics,Speech,and Signal Processing.Atlanta,GA,USA:IEEE,1996,2:817-820.
  • 10Luettin J,Thacker N A,Beet S W.Speechreading using shape and intensity information[C]//IEEE 4th International Conference on Spoken Language.Philadelphia,PA,USA:IEEE,1996,1:58-61.

引证文献3

二级引证文献7

江苏大学学报（自然科学版）
2004年 第5期

相关作者

内容加载中请稍等...

相关机构

内容加载中请稍等...

相关主题

内容加载中请稍等...

浏览历史

内容加载中请稍等...
;
使用帮助 返回顶部