CaltechTHESIS
  A Caltech Library Service

Where the Wild Things Are: Computer Vision for Global-Scale Biodiversity Monitoring

Citation

Beery, Sara Meghan (2023) Where the Wild Things Are: Computer Vision for Global-Scale Biodiversity Monitoring. Dissertation (Ph.D.), California Institute of Technology. doi:10.7907/m4mt-2q51. https://resolver.caltech.edu/CaltechTHESIS:04242022-005200355

Abstract

We require a real-time, modular earth observation system that unites efforts across research groups in order to provide the necessary information necessary for global-scale impact in sustainability and conservation in the face of climate change. The development of such systems requires collaborative, interdisciplinary approaches that translate diverse sources of raw information into accessible scientific insight. For example, we need to monitor species in real time and in greater detail to quickly understand which conservation efforts are most effective and take corrective action. Current ecological monitoring systems generate data far faster than researchers can analyze it, making scaling up impossible without automated data processing. However, ecological data collected in the field presents a number of challenges that current methods, like deep learning, are not designed to tackle. These include strong spatiotemporal correlations, imperfect data quality, fine-grained categories, and long-tailed distributions. Our work seeks to overcome these challenges, and this thesis includes methods which can learn from imperfect data, systematic frameworks and benchmarks for measuring and overcoming performance drops due to domain shift, and the development and deployment of efficient human-AI systems that have made significant real-world conservation impact.

Item Type:Thesis (Dissertation (Ph.D.))
Subject Keywords:Computer Vision, Machine Learning, Data Science, Biodiversity Monitoring, Conservation Technology
Degree Grantor:California Institute of Technology
Division:Engineering and Applied Science
Major Option:Computing and Mathematical Sciences
Awards:Amori Doctoral Prize in CMS, 2023. Amazon AI4Science Fellowship. PIMCO Data Science Fellowship. Caltech CMS Gradient for Change Award, 2021. Caltech EAS New Horizons Award.
Thesis Availability:Public (worldwide access)
Research Advisor(s):
  • Perona, Pietro
Thesis Committee:
  • Yue, Yisong (chair)
  • Bouman, Katherine L.
  • Belongie, Serge J.
  • Perona, Pietro
Defense Date:20 May 2022
Funders:
Funding AgencyGrant Number
National Science Foundation Graduate Research Fellowship1745301
Resnick Sustainability InstituteUNSPECIFIED
Record Number:CaltechTHESIS:04242022-005200355
Persistent URL:https://resolver.caltech.edu/CaltechTHESIS:04242022-005200355
DOI:10.7907/m4mt-2q51
Related URLs:
URLURL TypeDescription
https://doi.org/10.1145/3466857DOIArticle adapted for Chapter 1
https://doi.org/10.1038/s41467-022-27980-yDOIArticle adapted for Chapter 2
https://doi.org/10.1007/978-3-030-01270-0_28DOIArticle adapted for Chapter 3
https://doi.org/10.1007/978-3-030-01270-0_28DOIArticle adapted for Chapter 4
https://doi.org/10.48550/arXiv.1907.07617DOIArticle adapted for Chapter 5
https://doi.org/10.48550/arXiv.2004.10340DOIArticle adapted for Chapter 5
https://doi.org/10.48550/arXiv.2105.03494DOIArticle adapted for Chapter 5
https://doi.org/10.48550/arXiv.2012.07421DOIArticle adapted for Chapter 5
https://doi.org/10.48550/arXiv.2112.05090DOIArticle adapted for Chapter 5
https://doi.org/10.48550/arXiv.1904.05986DOIArticle adapted for Chapter 5
https://doi.org/10.1109/WACV45572.2020.9093570DOIArticle adapted for Chapter 6
https://doi.org/10.1109/cvpr42600.2020.01309DOIArticle adapted for Chapter 7
https://doi.org/10.1109/cvpr52688.2022.02061DOIArticle adapted for Chapter 8
https://doi.org/10.1145/3460112.3471947DOIArticle adapted for Chapter 9
https://doi.org/10.48550/arXiv.2106.11236DOIArticle adapted for Chapter 10
ORCID:
AuthorORCID
Beery, Sara Meghan0000-0002-2544-1844
Default Usage Policy:No commercial reproduction, distribution, display or performance rights in this work are provided.
ID Code:14556
Collection:CaltechTHESIS
Deposited By: Sara Beery
Deposited On:17 Feb 2023 17:45
Last Modified:08 Nov 2023 00:44

Thesis Files

[img] PDF - Final Version
See Usage Policy.

194MB

Repository Staff Only: item control page