Renato De Mori
Emeritus Professor

Contact 
 

School of Computer Science, McGill University
3480 University Street
McConnell Building, Room 204N
Montréal, QC, H3A 0E9
Canada 

email:

rdemori@

cs.

mcgill.ca

 

 

Biographical Information

 

I am   Emeritus Professor at McGill University (Computational Linguistics Group) and the University of Avignon - Academy of Marseille – (Computer Science laboratory - LIA).

I am LIFE Fellow of the Computer Society of the Institute of Electrical and Electronic Engineers and

former Distinguished Lecturer of the IEEE Signal Processing Society.

 

I have been Professor of Computer Science at the Université d’Avignon, France and Director of LIA CNRS France,

Professor and Director at the  School of Computer Science at McGill University, Montreal, Quebec, Canada, Professor and Chairman at Concordia University, Computer Science, Montreal, Quebec, Canada, Professor and Chairman at the Institute of Computer Science , University of Turin, Italy,  Assistant, then Associate Professor, Electrical Engineering at Politecnico di Torino, Italy.

 

I am working on the French ANR project AISSPER on spoken language understanding site 

and on the Canada-Quebec MILA SpeechBrain project as a scientific advisor site 

 

 

Recent research activity and selected publications

 

 

Quaternion deep neural networks

 

Titouan Parcollet, Mohamed Morchid,  Xavier Bost, Georges Linarès, and Renato De Mori

Real to H-space Autoencoders for Theme Identification in Telephone Conversations

IEEE/ACM TRANSACTIONS ON AUDIO, SPEECH, AND LANGUAGE PROCESSING, 2020 TASP: 20

 

Titouan Parcollet, Mohamed Morchid, Georges Linarès, and Renato De Mori

Real to H-space Encoder for Speech Recognition

Proc. International Conference on Speech Communication and Technology, INTERSPEECH, 2019, GRAZ, AUSTRIA

 

Titouan Parcollet, Mohamed Morchid, Georges Linarès, and Renato De Mori

BIDIRECTIONAL QUATERNION LONG-SHORT TERM MEMORY

RECURRENT NEURAL NETWORKS FOR SPEECH RECOGNITION

Proc  IEEE International Conference on Acoustic, Speech and Signal Processing,, Brighton, U.K. May 2019

 

Titouan Parcollet, Mirco Ravanelli, Mohamed Morchid, Georges Linarès, Chiheb Trabelsi, Renato De Mori, Yoshua Bengio

Quaternion Recurrent Neural Networks

Proc. International Conference on Learning Representations ICLR 2019, New Orleans, Louisiana, USA, May 2019

 

Titouan Parcollet, Mirco Ravanelli, Mohamed Morchid, Georges Linarès, Renato De Mori

Speech Recognition with Quaternion Neural Networks

NIPS 2018 - IRASL Workshop  Montréal, QC, Canada

 

Titouan Parcollet, Ying Zhang, Mohamed Morchid, Chiheb Trabelsi, Georges Linarès, Renato De Mori and Yoshua Bengio

Quaternion-Valued Convolutional Neural Networks for End-to-End Automatic Speech Recognition

Proc. International Conference on Speech Communication and Technology, INTERSPEECH, 2018, HYDERABAD, INDIA,

 

Titouan Parcollet, Mohamed Morchid, Pierre-Michel Bousquet, Richard Dufour

Georges Linares and Renato De Mori

QUATERNION NEURAL NETWORKS FOR SPOKEN LANGUAGE UNDERSTANDING

IEEE Workshop on Spoken Language technology, San Diego, CA, Dec 2016

 

 

Topic identification in human/human dialogues

 

Killian Janod, Mohamed Morchid, Richard Dufour, Georges Linares, Renato De Mori

Denoised Bottleneck Features from Deep Autoencoders for Telephone Conversation Analysis

IEEE/ACM Transactions o  Audio, Speech, and Language Processing, Volume: 25TASP: 17

Pages:1809-1820, 2017

 

Mohamed Morchid, Richard Dufour, Mohamed Bouallegue, Georges Linarès, Driss Matrouf and Renato De Mori

Compact Multi-View Representation of Documents based on the Total Variability Space

IEEE/ACM Transactions on  Audio, Speech, and Language Processing, August 2015, 23, TASL: 15 ,  1245-1308

 

Mohamed Morchid, Richard Dufour, Mohamed Bouallegue, Georges Linarès, Driss Matrouf and Renato De Mori

An I-vector Based Approach to Compact Multi-Granularity Topic Spaces Representation of Textual  Documents

Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP),

pages 443–454, October 25-29, 2014, Doha, Qatar

 

Xavier Bost; Grégory Senay; Marc El-Beze,; Renato De Mori
Multiple topic identification in human/human conversations

Computer Speech and Language, (2015) 18–42

 

Spoken language understanding

 

Gokhan Tur and Renato  De Mori Eds. "Spoken Language Understanding"

J. Wiley 2011

 

Stefan Hahn, Marco Dinarelli, Christian Raymond, Fabrice Lefèvre, Patrick Lehnen,

Renato De Mori, Hermann Ney, and Giuseppe Riccardi

"Comparing Stochastic Approaches to Spoken Language Understanding in Multiple Languages"

IEEE Transactions on  Audio, Speech, and Language Processing, 19, TASL: 11 , pp 1569-1583, Aug. 2011.

 

R. De Mori, F. Bechet, D. Hakkani-Tur, M. McTear, G. Riccardi, G. Tur

Spoken language understanding

Signal Processing Magazine, IEEE; Volume 25, SPM:08  , May 2008 Page(s):50 – 58

 

C. Raymond, F. Béchet, N. Camelin, Renato De Mori and Géraldine Damnati,

 Sequential decision strategies for machine interpretation of speech,

 IEEE Transactions on Speech and Audio Processing, 15 TASL:07 :162-171, January 2007.

 

C. Raymond, F. Béchet R. de Mori and G. Damnati,

On the use of finite state transducers for semantic interpretation,

 Speech Communication, 48(3): 288-304, March 2006.

 

Cettolo M., Corazza A. and De Mori R.

Language Portability of a Speech Understanding System

Computer Speech and Language, 12(1):1-21, Jan. 1998.

 

De Mori, R. and Kuhn, R.,

The Application of Semantic Classification Trees to Natural Language Understanding

IEEE Transactions on Pattern Analysis and Machine Intelligence, vol PAMI-17, PAMI:17  , May 1995, pp. 449-460.

 

C. Pateras, G. Dudek and R. de Mori

Understanding Referring Expressions in a Person-Machine Spoken Dialogue

IEEE International Conference on Acoustics, Speech and Signal Processing,, Detroit, MI, ICASSP:95  ,pp.197-200, May 1995.

 

Automatic speech recognition

 

M. Benzeghiba, R. De Mori, O. Deroo, S. Dupont *, T. Erbes, D. Jouvet, L. Fissore,

P. Laface, A. Mertins, C. Ris, R. Rose, V. Tyagi, C. Wellekens

Automatic speech recognition and speech variability: A review

Speech Communication 49 (2007) 763–786

Best paper award 2009

 

Roberto Gemello, Franco Mana, Stefano Scanzio, Pietro Laface , Renato De Mori

Linear hidden transformations for adaptation of hybrid ANN/HMM models

Speech Communication 49 (2007) 827–835

 

R. Gemello, F. Mana and R. De Mori

Automatic speech recognition with a modified ephraim-malah rule 

IEEE Signal Processing Letters , 13, SPL:1  ,p. 52-55, January 2006

 

Roberto Gemello, Franco Mana, Dario Albesano and Renato De Mori  

Multiple resolution analysis for robust automatic speech recognition

Computer Speech and Language, 20(1), pp. 2-21, January 2006

 

Yannick Estève, Christian Raymond, Renato De Mori and David Janiszek,

On the use of linguistic consistency in automatic speech recognition

IEEE Transaction on Speech and Audio Processing, SAP-11, TSAP:03 746-756,  November 2003

  

R.De Mori,  L.Moisa, R.Gemello, F.Mana and D. Albesano

Computation of robust acoustic features for automatic speech recognition

Computer Speech and Language, 2001, 15(4):341-354.

 

R.  De Mori,  Spoken dialogues with computers, Academic Press, 1998

 

Opinion analysis

 

N. Camelin, F. Bechet, G Damnati, and R. De Mori

Detection and Interpretation of Opinion Expressions in Spoken Surveys
Audio, Speech, and Language Processing, IEEE Transactions on
Volume 18,
TASL:10 , Feb. 2010 Page(s):369 - 381

 

Software engineering

 

Gayane Petrosyan, Martin P. Robillard, Renato De Mori

Discovering Information Explaining API Types Using Text Classification

Proc ACM/IEEE International Conference on Software EngineeringIssue:6 Florence Italy May 2015

 

E. Merlo, I. Mc Adam, R. De Mori,

Feed-forward and recurrent neural networks for source code information analysis, 2003

Journal of Software Maintenance, 3:1-2

 

Kontogiannis K., De Mori R., Merlo E., Galler M. and Bernstein M.,

Pattern matching for Clone and Concept Detection

Automated Software Engineering, vol. 3, no. 1-2, pages 77-108, June 1996

.

 

Merlo E., Gagne' P.Y., Girard J. F., Kontogiannis K., Hendren L., Panangaden P. and De Mori R.,

Reengineering User Interfaces

IEEE Software, Jan. 1995, IEEE Software:1   pp.64-73.

 

Merlo, E., Girard, J.F., Hendren, L.J. and De Mori, R.,

Multi-valued constant propagation analysis for user interface engineering,

International Journal of Software Engineering and Knowledge Engineering, v. 5, no. 1, March 1995, pp. 5-23.

 

 

Information retrieval

 

C.Carpineto, R. De Mori, G. Romano, B. Bigi

An information theoretic approach to automatic query expansion

ACM Transactions on INFORMATION SYSTEMS, 19(1):1-27,2001  ACM TOIS 

 

Funding

 

These research activities were mostly funded by the following European projects:

 

SMADA: Telephone directory assistance (France-Télécom, Swiss Télécom, CSELT, KPN, Univ Nijmegen, Politecnico di Torino)  2000 – 2003  

 

DIVINES: Research on variability of speech features  variability (France-Télécom, Telecom Italia, Univ Oldenburg, Multitel, Babel, Politecnico di Torino)  2004 – 2007

 

PASCAL: Machine learning and application Network of Excellence,  2004 – 2008

 

LUNA:  Spoken language understanding for telephone applications (France-Télécom, Loquendo, Univ. of  Aachen, Univ. of Trento, CSI Piemonte, Polish Academy of Sciences, IIJPT) 2006-2009

 

m2cr : neural machine translation MILA lab Montreal Canada, Univ of Le Mans France, LAMP Spain,  2015-2017

 

the French Agence nationale de la Recherche (ANR) :

 

Artificial Intelligence for Semantically controlled SPEech UndeRstanding ( AISSPER ), 2020-2022

and by

 

the Centre de National d’Etudes en Telecommunications (now Orange Lab) of France Télécom

 

 

Selected publications and research history

 

My research activity started with my doctoral thesis at the Politecnico di Torino on the design and construction of a system for Automatic Speech Recognition (ASR) based on perceptions used for recognizing phonemes. The work is described in:

 

De Mori, R., Gilli, L. and Meo, A.R.

A Flexible Real-time Recognizer of Spoken Words for Man-machine Communication

International Journal on Man-machine Studies, Vol. 2, No. 4, pp. 317-326, October 1970.

 

With the purpose of having faster computers for real-time signal processing, I worked on Computer architectures, particularly on fast, parallel arithmetic units.

Selected publications in this field are:

 

De Mori, R.

Suggestion for an I.C. Fast Parallel Multiplier

Electronics Letters, Vol. 5, No. 3, pp. 50-51, February 1969.

 

De Mori, R., Rivoira, S. and Serra, A.

A Special Purpose Computer for Digital Signal Processing

IEEE Transactions on Computers, Issue:C24 , pp. 1202-1211, December 1975

 

De Mori, R. and Cardin, R.

A Recursive Algorithm for Binary Multiplication and its Implementation

ACM Transactions on Computer Systems, Vol. 3, No. 4, pp. 294-314, 1985.

 

ASR research evolved with the use of syntactic and artificial intelligence   techniques of which selected publications are in

 

SYNTACTIC PATTERN RECOGNITION-APPLICATIONS Edited by K.S. Fu, Springer-Verlag Publishing Co., 1977.

De Mori, R.

A Descriptive Technique for Automatic Speech Recognition

IEEE Transactions on Audio and Electroacoustic, Vol. Au-21, AU:21 , pp. 89-100, April 1973.

 

De Mori, R., Lam, L. and Gilloux, M.

Learning and Plan Refinement in a Knowledge-based System for Automatic Speech Recognition

IEEE Transactions on Pattern Analysis and Machine Intelligence,  Vol. PAMI-9, PAMI:87 , pp. 289-305, 1987

 

De Mori, R.

Computer Models of Speech Using Fuzzy Algorithms

Plenum Press, NY, 1983.

 

ASR research evolved with application of statistical methods described in selected publications describing attempts to go beyond n-gram language models, maximum likelihood estimation and left-to-right parsing with stochastic context-free grammars:

Kuhn, R. and De Mori, R.

A Cache-based Natural Language Model for Speech Recognition

IEEE Transactions on Pattern Analysis and Machine Intelligence,  Vol. PAMI-12, PAMI:90 , pp. 570-583, June 1990

 

Corazza, A., De Mori, R., Gretter, R. and Satta, G.

Computation of Probabilities for an Island-driven Parser

IEEE Transactions on Pattern Analysis and Machine Intelligence, September 1991, Vol. PAMI-13, PAMI:91 , pp. 936-950

 

Normandin, Y., Cardin, R. and De Mori, R.,

High-performance Connected Digit Recognition Using Maximum Mutual Information Estimation

IEEE Transactions on Speech and Audio Processing, Vol. 2, TSAP:94  , April 1994, pp. 299 - 311.

 

Corazza, A., De Mori, R., Gretter, R. and Satta, G.

Optimal Probabilistic Evaluation Functions for Search Controlled by Stochastic Context-free Grammars

IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 16, PAMU:94  , October 1994, pp. 1018-1027

 

Neural models attempting to join optimizing hidden Markov models and acoustic features extracted with multilayer neural networks  described in

 

 

 

Bengio, Y. and De Mori, R.

Use of Multi-layer Networks for Acoustic Property Extraction and Automatic Speech Recognition

Computational Intelligence, No. 5, pp. 134-147, August 1989.

 

Bengio, Y., De Mori, R., Flammia, G. and Kompe, R.

Neural Network - Gaussian Mixture Hybrid for Speech Recognition or Density Estimation

Advances in Neural Information Processing Systems 4, pp. 175-182, Edited by J.E. Moody, S.J. Hansen and R. Lippmann, Morgan Kaufmann Publishers, 1992

 

Bengio, Y., Cardin, R. and De Mori, R.

Speaker-independent Speech Recognition with Neural Networks and Speech Knowledge

Advances in Neural Information Processing Systems 2, Edited by D.S. Touretzky, Morgan Kaufmann Publishers, 1990.

 

Bengio, Y., Gori, M. and De Mori, R.

BPS : A Learning Algorithm for Capturing the Dynamic of Speech

International Joint Conference on Neural Networks 1989 proceeding, pp. 417-424.

 

Cosi, P., Bengio, Y. and De Mori, R.

On the Generalization Capability of Multi-layered Networks Used for Automatic Speech Recognition

International Joint Conference on Artificial Intelligence, pp. 1531-1536, Detroit, MI, August 1989.

 

Cosi, P., Bengio, Y. and De Mori, R.

Phonetically-based Multi-layered Neural Networks for Vowel Classification

Speech Communication special issue on Neurospeech, Vol. 9, No. 1, pp. 15-30, February 1990.

 

Bengio, Y., De Mori, R., Flammia, G. and Kompe, R.

Global Optimization of a Neural Network - Hidden Markov Model Hybrid

IEEE Transactions on Neural Networks, Vol. 3, TNN:92 , March 1992, pp. 252-259.

 

Bengio, Y., Cardin, R. and De Mori, R.

Speaker-independent Speech Recognition with Neural Networks and Speech Knowledge

Advances in Neural Information Processing Systems 2, Edited by D.S. Touretzky, Morgan Kaufmann Publishers, 1990.

 

De Mori, R., Bengio, Y. and Cardin, R.

Data-driven Execution of Multi-layered Networks for Automatic Speech Recognition

7th Conference of the American Association for Artificial Intelligence proceedings, St. Paul, MN, August 1988, pp. 734-738.

 

De Mori, R. and Flammia, G.,

Speaker-independent Consonant Classification in Continuous Speech with Distinctive Features and Neural Networks

Journal of the Acoustical Society of America, Vol. 94, no. 6, December 1993,  pp. 3091-3103.

 

Other selected publications:

 

Automatic Speech Recognition

 

De Mori, R., Laface, P. and Mong, Y.

Parallel Algorithms for Syllable Recognition in Continuous Speech

IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. PAMI-7, PAMI:85 , pp. 56-69, 1985.

 

Demichelis, P., De Mori, R., Laface, P. and O'Kane, M.

Computer Recognition of Plosive Sounds Using Contextual Information

IEEE Transactions on Acoustics, Speech and Signal Processing, Vol. ASSP-31, TASSP:83 , pp. 359-377, 1983.

 

De Mori, R. and Laface, P.

Use of Fuzzy Algorithms for Phonetic and Phonemic Labelling of Continuous Speech

IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. PAMI-2, PAMI:80 , pp. 136-148, March 1980.

 

De Mori, R., Gubrinowicz, R. and Laface, P.

Inference of a Knowledge Source for the Recognition of Nasals in Continuous Speech

IEEE Transactions on Acoustics, Speech and Signal Processing,  Vol ASSP-27, TASSP:79 , pp. 538-549, October 1979.

 

De Mori, R., Laface, P. and Piccolo, E.

Automatic Detection and Description of Syllabic Features in Continuous Speech

IEEE Transactions on Acoustics, Speech and Signal Processing,Vol. ASSP-24, TASSP:76 , pp. 365-379, October 1976.

 

Software engineering;

 

Buss, E., De Mori, R., Gentleman, W. M., Henshaw, J., Johnson, H., Kontogiannis, K.

Merlo, E., Muller, H. A., Mylopoulos, J., Paul, S., Prakash, A., Stanley, M.,

Tilley, S.R., Troster, J. and Wong, K.

Investigating Reverse Engineering Technologies for the CAS Program Understanding Project

IBM System Journal, Vol. 33, no. 3, 1994, pp. 477-500.

 

 

E. Merlo, J. F. Girard, L. Hendren and R. De Mori

Multi-Valued Constant Propagation for the Reengineering of User Interfaces

IEEE Conference on Software Maintenance, Montreal, QC, (Canada), pp. 120-129, September 1993.

 

E. Merlo, I. McAdam and R. De Mori

Source Code Informal Information Analysis Using Connectionist Models

Proc. 13th International Joint Conference on Artificial Intelligence, Chambéry (France), August 1993, pp. 1339-1345

 

Biomedical signals

 

Belforte, G., De Mori, R. and Ferraris, F.

A Contribution to the Automatic Processing of Electrocardiograms Using Syntactic Methods

IEEE Transactions on Biomedical Engineering, Vol. BME-26, BME 79 , pp. 125-136, March 1979

 

Qualitative reasoning

 

De Mori, R., and Prager, R.

Perturbation Analysis with Qualitative Models

International Joint Conference on Artificial Intelligence, pp. 1180-1186, Detroit, MI, August 1989.

 

Funding

 

The research in the period 1983-1996 was mostly funded by the Natural Science and Engineering Research Council (NSERC) of Canada,

The Institute of Robotics and Intelligent systems (IRIS), a Canadian Center of Excellence.

 

Editorial activities 

 

Chief Editor, SPEECH COMMUNICATION (2003 - 2006t), Elsevier,

Associate Editor, SIGNAL PROCESSING (1979 – 1995) Elsevier,

Associate Editor, SPEECH COMMUNICATION (1981 –present), Elsevier,

Associate Editor, PATTERN RECOGNITION LETTERS (1982 – 2004) Elsevier

Associate Editor, COMPUTER SPEECH AND LANGUAGE (1986 – present) Academic Press

Associate Editor then Advisory Board member IEEE TRANSACTIONS ON PATTERN ANALYSIS

AND MACHINE INTELLIGENCE (1988 – 1994)

Associate Editor IEEE TRANSACTIONS ON AUDIO, SPEECH and LANGUAGE PROCESSING

(2009-2014)

Associate Editor, COMPUTATIONAL INTELLIGENCE (1991 – 2004)

 

Committees and services

 

General co-chairman  INTERSPEECH CONFERENCE Florence (Italy) 2011

Member, (1983 – 1987 and  2003-2006) IEEE Speech technical committee

Member (2003 – 2006) IM2 – Scientific  Council, Swiss Network of excellence

Member (2003 – 2014),  Scientific Council,  Interdoctoral polytechnic Schools

Republic of Italy

Member (2002 2006) Canadian Chairs Review panel

Member (1999 – 2000) Interdisciplinary Committee Canadian Foundation for Innovation

Member: Scientific Council, Réseau Francophone de l'Ingénierie de la Langue,

 France

Conseiller Scientifique :  , Centre National  d'Etudes des Télécommunications

Lannion, France Telecom

Vice-President, Research (1987 – 1994) Centre de recherche informatique de Montréal

Member (1990-1995), Executive Advisory Board, IBM Canada Toronto Research Lab.  

Member (1991 – 1993) Advisory Panel on Software Engineering Industry, Science and Technology Canada

Member (1991 – 1996) Advisory Board,  Information Systems National Research Council of Canada

Member then Chairman (1987 – 1990) Artificial Intelligence Associate Committee National Research Council of Canada

Member then Chairman (1989 -1994)  Scientific Advisory Board Information Technology

Research Center, Ontario

Member then Chairman (1983 – 1986) Natural Science and Engineering Research Council of Canada (NSERC) Computing and Information Sciences Grant Section Committee

Member ‘1987 - 1990    1996-1999) Natural Science and Engineering Research Council of Canada (NSERC) Strategic Grant Committee Communication and Computers Panel

Vice-President (1986 – 1990), Canadian Society for the Computational Studies of  Intelligence

 

 Evaluator of research projects in Europe, America, Asia and Australia