Pedro Morgado

Assistant Professor

University of Wisconsin-Madison

Dept. of Electrical and Computer Engineering

Dept. of Computer Sciences (Affiliate)

Address:
Engineering Centers Building - Office M1002E
1550 Engineering Dr, Madison, WI 53706
EmailCVScholarGithub

I am an Assistant Professor at the University of Wisconsin-Madison in the department of Electrical and Computer Engineering, and affiliated with the Computer Sciences department. My research interests are at the intersection of computer vision and machine learning. Specifically, I develop systems that continuously learn to perceive the world through multiple sensory modalities.

Previously, I was a postdoc researcher at Carnegie Mellon University, working with Abhinav Gupta. I completed my PhD at the University of California San Diego advised by Nuno Vasconcelos, and both BSc and MSc degrees at Instituto Superior Técnico, Universidade de Lisboa, where I worked with Margarida Silveira and Jorge S Marques.


News

--- show more ---

Research Group

PhD Students

MSc/Undergrad Students

  • Victor Suciu
  • Jinhong (Jones) Lin
  • Yijing Zhang
  • Eleanna Panagiotou

External Student Collaborators


Teaching


Publications

Audio-Synchronized Visual Animation

Lin ZhangShentong Mo,  Yijing Zhang,  Pedro Morgado

arxiv preprint (2403.05659), 2024.

paper

@Article{zhang2024asva,
 title={Audio-Synchronized Visual Animation},
 author={Lin Zhang, Shentong Mo, Yijing Zhang, Pedro Morgado},
 journal={ArXiv},
 year={2024}
 }

Unveiling the Power of Audio-Visual Early Fusion Transformers with Dense Interactions through Masked Modeling

Shentong MoPedro Morgado

IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), Seattle, 2024.

paper

@InProceedings{mo2024_efav,
 title={Unveiling the Power of Audio-Visual Early Fusion Transformers with Dense Interactions through Masked Modeling},
 author={Shentong Mo, Pedro Morgado},
 booktitle={IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR)},
 year={2024}
 }

A Unified Audio-Visual Learning Framework for Localization, Separation, and Recognition

Shentong MoPedro Morgado

International Conference on Machine Learning (ICML), Honolulu, HI, 2023.

paper code

@InProceedings{mo2022_slavc,
 title={A Unified Audio-Visual Learning Framework for Localization, Separation, and Recognition},
 author={Shentong Mo, Pedro Morgado},
 booktitle={Proceedings of the 40th International Conference on Machine Learning (ICML)},
 year={2023}
}

Prompt Tuning Vision Language Models is Robust to Noisy Labels

Cheng-En Wu,  Yu Tian,  Haichao Yu,  Heng Wang,  Pedro MorgadoYu Hen Hu,  Linjie Yang

International Conference on Computer Vision (ICCV), Paris, France, 2023.

paper

@InProceedings{wu2023_robust_pt,
 title={Why Is Prompt Tuning for Vision-Language Models Robust to Noisy Labels?},
 author={Cheng-En Wu, Yu Tian, Haichao Yu, Heng Wang, Pedro Morgado, Yu Hen Hu, Linjie Yang},
 booktitle={International Conference in Computer Vision (ICCV)},
 year={2023}
 }

A Closer Look at Weakly-Supervised Audio-Visual Source Localization

Shentong MoPedro Morgado

Neural Information Processing Systems (NeurIPS), New Orleans, 2022.

paper code

@InProceedings{mo2022_slavc,
 title={A Closer Look at Weakly-Supervised Audio-Visual Source Localization},
 author={Shentong Mo, Pedro Morgado},
 booktitle={Advances in Neural Information Processing Systems (NeurIPS)},
 year={2022}
}

Learning Visual Representation from Audible Interactions

Himangi MittalPedro MorgadoUnnat JainAbhinav Gupta

Neural Information Processing Systems (NeurIPS), New Orleans, 2022.

paper code

@InProceedings{mittal2022_replai,
 title={Learning Visual Representation from Audible Interactions},
 author={Himangi Mittal, Pedro Morgado, Unnat Jain, Abhinav Gupta},
 booktitle={Advances in Neural Information Processing Systems (NeurIPS)},
 year={2022}
}

Benchmarking and Automating the Image Recognition Capability of an In Situ Plankton Imaging System

Kevin T. Le,  Zhouyuan Yuan,  Areeb Syed,  Devin Ratelle,  Eric C. Orenstein,  Melissa L. Carter,  Sarah Strang,  Kasia M. Kenitz,  Pedro MorgadoPeter J. S. FranksNuno VasconcelosJules S. Jaffe

Frontiers in Marine Science, 2022.

paper

@InProceedings{le2022_plankton_bench,
 title={Benchmarking and Automating the Image Recognition Capability of an In Situ Plankton Imaging System},
 author={Kevin T. Le, Zhouyuan Yuan, Areeb Syed, Devin Ratelle, Eric C. Orenstein, Melissa L. Carter, Sarah Strang, Kasia M. Kenitz, Pedro Morgado, Peter J. S. Franks, Nuno Vasconcelos and Jules S. Jaffe},
 booktitle={Frontiers in Marine Science},
 year={2022}
}

The Challenges of Continuous Self-Supervised Learning

Senthil Purushwalkam*,  Pedro Morgado*,  Abhinav Gupta

European Conference on Computer Vision (ECCV), Tel Aviv, Israel, 2022.

paper code data video Oral presentation

@InProceedings{purushwalkam2022_continuous_ssl,
 title={The Challenges of Continuous Self-Supervised Learning},
 author={Senthil Purushwalkam, Pedro Morgado, Abhinav Gupta},
 booktitle={European Conference on Computer Vision (ECCV)},
 year={2022}
}

Localizing Visual Sounds the Easy Way

Shentong MoPedro Morgado

European Conference on Computer Vision (ECCV), Tel Aviv, Israel, 2022.

paper code video

@InProceedings{mo2022_ezvsl,
 title={Localizing Visual Sounds the Easy Way},
 author={Shentong Mo, Pedro Morgado},
 booktitle={European Conference on Computer Vision (ECCV)},
 year={2022}
}

Learning to see and hear without human supervision

Pedro Morgado

PhD Thesis, University of California San Diego, 2021.

thesis

@phdthesis{morgado_phdthesis,
 author = {Pedro Morgado},
 title = {Learning to see and hear without human supervision},
 school = {University of California San Diego},
 year = 2021
}

Robust Audio-Visual Instance Discrimination

Pedro MorgadoIshan MisraNuno Vasconcelos

IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), 2021.

paper video Oral presentation

@InProceedings{morgado2021_robust_xid,
 title={Robust Audio-Visual Instance Discrimination},
 author={Pedro Morgado, Ishan Misra, Nuno Vasconcelos},
 booktitle={Computer Vision and Pattern Recognition (CVPR), IEEE/CVF Conf. on },
 year={2021}}

Audio-Visual Instance Discrimination with Cross-Modal Agreement

Pedro MorgadoNuno VasconcelosIshan Misra

IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), 2021.

paper code video blogpost Best paper candidate

@InProceedings{morgado2021avid,
 title={Audio-Visual Instance Discrimination with Cross-Modal Agreement},
 author={Pedro Morgado, Nuno Vasconcelos, Ishan Misra},
 booktitle={Computer Vision and Pattern Recognition (CVPR), IEEE/CVF Conf. on },
 year={2021}
}

Audio-Visual Instance Discrimination

ECCV Workshop - Multi-Modal Video Analysis, 2020.

paper talk

Learning Representations from Audio-Visual Spatial Alignment

Pedro Morgado*,  Yi Li*,  Nuno Vasconcelos

Neural Information Processing Systems (NeurIPS), 2020.

paper suppl code video

@inproceedings{morgadoNIPS20,
 title={Learning Representations from Audio-Visual Spatial Alignment},
 author={Pedro Morgado, Yi Li, Nuno Vasconcelos},
 booktitle={Advances in Neural Information Processing Systems (NeurIPS)},
 year={2020}
}

[Workshop] Learning Representations from Audio-Visual Spatial Alignment

Yi Li *,  Pedro Morgado *,  Nuno Vasconcelos

CVPR Workshop - Sight and Sound, 2021.

paper talk

Deep Hashing with Hash-Consistent Large Margin Proxy Embeddings

Pedro MorgadoYunsheng LiJose Costa PereiraMohammad SaberianNuno Vasconcelos

International Journal of Computer Vision (IJCV), 2020.

paper

@article{MorgadoProxyHashing,
 author = {Morgado, Pedro and Li, Yunsheng and Costa Pereira, Jose and Saberian, Mohammad and Vasconcelos, Nuno},
 journal = {International Journal of Computer Vision},
 title = {Deep Hashing with Hash-Consistent Large Margin Proxy Embeddings},
 year = {2020},
 doi = {10.1007/s11263-020-01362-7},
 isbn = {1573-1405},
 url = {https://doi.org/10.1007/s11263-020-01362-7}
}

Solving Long-tailed Recognition with Deep Realistic Taxonomic Classifier

Tz-Ying WuPedro MorgadoPei WangChih-Hui HoNuno Vasconcelos

European Conference on Computer Vision (ECCV), Glasgow, UK, Virtual, 2020.

paper suppl code website video

@inproceedings{Wu20DeepRTC,
 title={Solving Long-tailed Recognition with Deep Realistic Taxonomic Classifier},
 author={Tz-Ying Wu and Pedro Morgado and Pei Wang and Chih-Hui Ho and Nuno Vasconcelos},
 booktitle={European Conference on Computer Vision (ECCV)},
 year={2020}
}

NetTailor: Tuning the Architecture, Not Just the Weights

Pedro MorgadoNuno Vasconcelos

IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), Long Beach, CA, 2019.

paper code website

@inproceedings{morgado2019nettailor,
 title={NetTailor: Tuning the Architecture, Not Just the Weights},
 author={Morgado, Pedro and Vasconcelos, Nuno},
 booktitle={Computer Vision and Pattern Recognition (CVPR), IEEE/CVF Conf. on},
 pages={3044--3054},
 year={2019}
}

[Workshop] NetTailor: Tuning the Architecture, Not Just the Weights

Southern California Machine Learning Symposium (SCMLS), 2020.

paper

assets/publications/2019-nettailor/scmls20_ref.txt

PIEs: Pose Invariant Embeddings

Chih-Hui HoPedro MorgadoAmir PersekianNuno Vasconcelos

IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), Long Beach, CA, 2019.

paper suppl code data website

@InProceedings{Ho_2019_CVPR,
 author = {Ho, Chih-Hui and Morgado, Pedro and Persekian, Amir and Vasconcelos, Nuno},
 title = {PIEs: Pose Invariant Embeddings},
 booktitle = {Computer Vision and Pattern Recognition (CVPR), IEEE/CVF Conf. on },
 month = {June},
 year = {2019}
}

Self-Supervised Generation of Spatial Audio for 360° Video

Pedro MorgadoNuno VasconcelosTimothy LangloisOliver Wang

Neural Information Processing Systems (NeurIPS), Montreal, Canada, 2018.

paper suppl code data website video

@inproceedings{morgadoNIPS18,
 title={Self-Supervised Generation of Spatial Audio for 360° Video},
 author={Pedro Morgado, Nuno Vasconcelos, Timothy Langlois and Oliver Wang},
 booktitle={Advances in Neural Information Processing Systems (NeurIPS)},
 year={2018}
}

Semantically Consistent Regularization for Zero-Shot Recognition

Pedro MorgadoNuno Vasconcelos

IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), Honolulu, Hawaii, 2017.

paper code

@inproceedings{morgadoCVPR17,
 title={Semantically Consistent Regularization for Zero-Shot Recognition},
 author={Pedro Morgado and Nuno Vasconcelos},
 booktitle={Computer Vision and Pattern Recognition (CVPR), IEEE/CVF Conf.~on},
 year={2017},
 organization={IEEE}
}

Minimal Neighborhood Redundancy Maximal Relevance: Application to the Diagnosis of Alzheimer's Disease

Pedro MorgadoMargarida Silveira

Neurocomputing, Vol. 155, pp. 295-308, May, 2015.

paper

@article{morgado2015minimal,
 title={Minimal neighborhood redundancy maximal relevance: Application to the diagnosis of Alzheimer׳ s disease},
 author={Morgado, Pedro M and Silveira, Margarida and Alzheimer׳ s Disease Neuroimaging Initiative and others},
 journal={Neurocomputing},
 volume={155},
 pages={295--308},
 year={2015},
 publisher={Elsevier}
}

Efficient Selection of Non-redundant Features for the Diagnosis of Alzheimer's Disease

International Symposium on Biomedical Imaging (ISBI), San Francisco, CA, 2013.

paper Oral presentation

@inproceedings{Morgado:ISBI2013,
 title={Efficient selection of non-redundant features for the diagnosis of Alzheimer's disease},
 author={Morgado, Pedro M and Silveira, Margarida and Marques, Jorge S},
 booktitle={IEEE 10th International Symposium on Biomedical Imaging},
 year={2013}
}

Predicting Conversion from MCI to AD with FDG-PET Brain Images at Different Prodromal Stages

Carlos Cabral,  Pedro MorgadoDurval C. CostaMargarida Silveira

Computers in Biology and Medicine, Vol. 58, pp. 101-109, March, 2015

paper

@article{cabral2015predicting,
 title={Predicting conversion from MCI to AD with FDG-PET brain images at different prodromal stages},
 author={Cabral, Carlos and Morgado, Pedro M and Costa, Durval Campos and Silveira, Margarida and Alzheimer׳ s Disease Neuroimaging Initiative and others},
 journal={Computers in biology and medicine},
 volume={58},
 pages={101--109},
 year={2015},
 publisher={Elsevier}
}

Texton-based Diagnosis of Alzheimer's Disease

Pedro MorgadoMargarida SilveiraDurval C. Costa

IEEE Int. Workshop on Machine Learning for Signal Processing (MLSP), Southampton, UK, 2013.

paper

@inproceedings{Morgado:MLSP13,
 title={Texton-based diagnosis of Alzheimer's disease},
 author={Pedro Morgado, Margarida Silveira and Durval Campos Costa},
 booktitle={Machine Learning for Signal Processing (MLSP), 2013 IEEE International Workshop on},
 year={2013},
 organization={IEEE}
}

Diagnosis of Alzheimer's disease using 3D Local Binary Patterns

Pedro MorgadoMargarida SilveiraJorge S. Marques

Computer Methods in Biomechanics and Biomedical Engineering: Imaging Visualization, Vol. 1, April, 2013

paper

@article{morgado2013diagnosis,
 title={Diagnosis of Alzheimer's disease using 3D local binary patterns},
 author={Morgado, Pedro and Silveira, Margarida and Marques, Jorge S},
 journal={Computer Methods in Biomechanics and Biomedical Engineering: Imaging Visualization},
 volume={1},
 number={1},
 pages={2--12},
 year={2013},
 publisher={Taylor Francis}
}

Extending Local Binary Patterns to 3D for the Diagnosis of Alzheimer's Disease

International Symposium on Biomedical Imaging (ISBI), San Francisco, CA, 2013.

paper

@inproceedings{Morgado:ISBI2013b,
 title={Extending Local Binary Patterns to 3D for the diagnosis of Alzheimer's disease},
 author={Morgado, Pedro M and Silveira, Margarida and Marques, Jorge S},
 booktitle={IEEE 10th International Symposium on Biomedical Imaging},
 year={2013}
}

Automated Diagnosis of Alzheimer's Disease using PET Images: A study of alternative procedures for feature extraction and selection

Pedro Morgado

Master Thesis, Instituto Superior Tecnico, Lisboa, Portugal.

thesis summary

@masterthesis{morgado_mscthesis,
 author = {Pedro Morgado},
 title = {Automated Diagnosis of Alzheimer's Disease using PET Images: A study of alternative procedures for feature extraction and selection},
 school = {Instituto Superior Tecnico, Lisboa, Portugal},
 year = 2012
}