Publications

This section contains publications published by ISI over the past several decades.

2024

The SHADOW Team Submission to the ASVSpoof 2024 Challenge

Jesús Villalba, Tiantian Feng, Thomas Thebaud, Jihwan Lee, Shrikanth Narayanan, Najim Dehak
Proc. ASVspoof 2024, 36-42,  2024

State-of-the-art speech production MRI protocol for new 0.55 Tesla scanners

Prakash Kumar, Ye Tian, Yongwan Lim, Sophia X Cui, Christina Hagedorn, Dani Byrd, Uttam K Sinha, Shrikanth Narayanan, Krishna S Nayak
Proc. Interspeech 2024, 2590-2594,  2024

Analysis of articulatory setting for L1 and L2 English speakers using MRI data

Kevin Huang, Jack Goldberg, Louis Goldstein, Shrikanth Narayanan
Korea 7, 789,  2024

Multimodal analysis of temporal affective variability within treatment for depression.

Adar Paz, Eshkol Rafaeli, Eran Bar-Kalifa, Eva Gilboa-Schechtman, Sharon Gannot, Shrikanth S Narayanan, Dana Atzil-Slonim
2024

ConPro: Learning Severity Representation for Medical Images using Contrastive Learning and Preference Optimization

Hong Nguyen, Hoang Nguyen, Melinda Chang, Hieu Pham, Shrikanth Narayanan, Michael Pazzani
Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern …,  2024

Association of Majority versus Minority First Language Multilingualism and Socioeconomic Status on Cognition among Older Indian Adults

Iris M Strangmann, Justina F Avila, Sarah Petrosyan, Erik Meijer, Emma Nichols, Shrikanth Narayanan, Leon M Aksman, Jinkook Lee, Miguel Arce Rentería
Alzheimer's & Dementia 20, e090676,  2024

People make mistakes: Obtaining accurate ground truth from continuous annotations of subjective constructs

Brandon M Booth, Shrikanth S Narayanan
Behavior Research Methods 56 (8), 8784-8800,  2024

Can Generic LLMs Help Analyze Child-Adult Interactions Involving Children with Autism in Clinical Observation?

Tiantian Feng, Anfeng Xu, Rimita Lahiri, Helen Tager-Flusberg, So Hyun Kim, Somer Bishop, Catherine Lord, Shrikanth Narayanan
arXiv preprint arXiv:2411.10761,  2024

Can text-to-image model assist multi-modal learning for visual recognition with visual modality missing?

Tiantian Feng, Daniel Yang, Digbalay Bose, Shrikanth Narayanan
Proceedings of the 26th International Conference on Multimodal Interaction …,  2024

Direct articulatory observation reveals phoneme recognition performance characteristics of a self-supervised speech model

Xuan Shi, Tiantian Feng, Kevin Huang, Sudarsana Reddy Kadiri, Jihwan Lee, Yijing Lu, Yubin Zhang, Louis Goldstein, Shrikanth Narayanan
JASA Express Letters 4 (11),  2024

Can a Machine Distinguish High and Low Amount of Social Creak in Speech?

Anne-Maria Laukkanen, Sudarsana Reddy Kadiri, Shrikanth Narayanan, Paavo Alku
Journal of Voice,  2024

Scaling wearable foundation models

Girish Narayanswamy, Xin Liu, Kumar Ayush, Yuzhe Yang, Xuhai Xu, Shun Liao, Jake Garrison, Shyam Tailor, Jake Sunshine, Yun Liu, Tim Althoff, Shrikanth Narayanan, Pushmeet Kohli, Jiening Zhan, Mark Malhotra, Shwetak Patel, Samy Abdel-Ghaffar, Daniel McDuff
arXiv preprint arXiv:2410.13638,  2024

Towards large-scale cross-speaker articulatory modeling of vowels

Sean Foley, Shrikanth Narayanan
The Journal of the Acoustical Society of America 156 (4_Supplement), A49-A49,  2024

Evaluation of state-of-the-art ASR Models in Child-Adult Interactions

Aditya Ashvin, Rimita Lahiri, Aditya Kommineni, Somer Bishop, Catherine Lord, Sudarsana Reddy Kadiri, Shrikanth Narayanan
arXiv preprint arXiv:2409.16135,  2024

Speech2rtMRI: Speech-Guided Diffusion Model for Real-time MRI Video of the Vocal Tract during Speech

Hong Nguyen, Sean Foley, Kevin Huang, Xuan Shi, Tiantian Feng, Shrikanth Narayanan
arXiv preprint arXiv:2409.15525,  2024

Towards child-inclusive clinical video understanding for autism spectrum disorder

Aditya Kommineni, Digbalay Bose, Tiantian Feng, So Hyun Kim, Helen Tager-Flusberg, Somer Bishop, Catherine Lord, Sudarsana Kadiri, Shrikanth Narayanan
arXiv preprint arXiv:2409.13606,  2024

Personalized Speech Recognition for Children with Test-Time Adaptation

Zhonghao Shi, Harshvardhan Srivastava, Xuan Shi, Shrikanth Narayanan, Maja J Matarić
arXiv preprint arXiv:2409.13095,  2024

Egocentric Speaker Classification in Child-Adult Dyadic Interactions: From Sensing to Computational Modeling

Tiantian Feng, Anfeng Xu, Xuan Shi, Somer Bishop, Shrikanth Narayanan
arXiv preprint arXiv:2409.09340,  2024

Data efficient child-adult speaker diarization with simulated conversations

Anfeng Xu, Tiantian Feng, Helen Tager-Flusberg, Catherine Lord, Shrikanth Narayanan
arXiv preprint arXiv:2409.08881,  2024

ModalityMirror: Improving Audio Classification in Modality Heterogeneity Federated Learning with Multimodal Distillation

Tiantian Feng, Tuo Zhang, Salman Avestimehr, Shrikanth S Narayanan
arXiv preprint arXiv:2408.15803,  2024