Faculty Directory

Costello III, Donald

Costello III, Donald "Bucket"

Director of Test and Evaluation of Autonomous Systems
A. James Clark School of Engineering
MATRIX Lab
44219 Airport Road, California, MD 20619
Website(s):

Dr. Donald “Bucket” Costello is the Director of Test and Evaluation of Autonomous Systems at the University of Maryland (UMD) Clark School of Engineering MATRIX Lab. His research focuses on autonomous systems and how to certify them. His work is making important strides toward a broader use of autonomy.

Previously, Costello spent time as a naval aviator, engineering test pilot, and military professor at the U.S. Naval Academy. In the past, he has been stationed at the Naval Air Station Patuxent River, right down the street from the MATRIX Lab. Costello received his PhD in mechanical engineering from UMD.

In addition to his numerous journal publications, his peer reviewed conference papers have been highlighted at several events, including the International Conference on Unmanned Aircraft Systems, AIAA Science and Technology Forum, and IEEE International Conference on Robotics and Automation.

He is the recipient of the Dr. Delores M. Etter Top Scientists and Engineers of the Year Group Award for 2024 and the Individual Engineer award for 2021. Additionally, he is the recipient of the International Test and Evaluation Association 2021 Publication Award. His military decorations include individual, unit, and campaign awards that are a tribute to the men and women he has served with.

He is also a member of several organizations, including the International Test and Evaluation Association, the Society of Experimental Test Pilots, and the Society of Flight Test Engineers.

Certification and Development of Autonomous Systems for Practical Use, Uncrewed Aerial Refueling, Uncrewed Carrier Aviation

Autonomous Systems, Autonomous Functionality Certification, Test and Evaluation, Naval Aviation, Mechanical Engineering, Systems Engineering, Aeronautical Engineering, Weapons, Robotics and Control Engineering


2021-2024: Assistant Professor, Permanent Military Professor, Weapons Robotics and Control Engineering Department, U.S. Naval Academy (USNA), Annapolis, MD (7 Sections)

2019: NC PACE Instructor, Central Texas College (CTC), Deployed on CVN-74 (1 Section)

2006-Pres: Adjunct Associate Professor, Embry Riddle Aeronautical University (ERAU), Worldwide (100+ Sections)

 

Peer-Reviewed Journals and Papers:

Mwaffo, V., Miller, D., Costello. D. (2025). “Advancing Autonomous Aerial Refueling with Deep Neural Network-Based Image Segmentation.” AIAA Journal of Aerospace Information Systems, Accepted 25 January 2025, https://doi.org/10.2514/1.I011508

Weiss, B., Costello, D., Scassero, M. (2025). “Test and Evaluation of Autonomous Systems: Developing the Educational Landscape,” IEEE Computer, vol 58, no. 1., 121-125, https://doi.org/10.1109/MC.2024.3485928

Costello, D., Jaramillo Cienfuegos, P., Xu, H. (2024). “Using Sensor Errors to Define Autonomous System Situational Awareness.” IEEE Access, vol. 12, 2024, pp. 193763–81, https://doi.org/10.1109/ACCESS.2024.3519764

Miller, D., McCormick, S., Mwaffo, V., Costello, D. (2024). “A Deep Neural Network Approach for Drogue Detection Using Laboratory-Chroma Key Images.” IEEE Access, vol. 12, pp. 188465-188475, https://doi.org/10.1109/ACCESS.2024.3515841

McCormick, S., Richez, A., Mwaffo, V., Costello, D. (2024). “Discriminating Similar Naval Vessels Using YOLOv8 Deep Neural Network.”  IEEE Access, 12, 99163-99174. 1–1. https://doi.org/10.1109/ACCESS.2024.3483014

Clement, D., Mottino, S., Costello, D. H. (2024). “Development Life Cycle for Using a DNN to Complete the Autonomous Aerial Refueling Task”. IEEE Access, 12, 99163–99174. https://doi.org/10.1109/ACCESS.2024.3427668

Bostock, N., & Costello, D. (2024). “Unique Research Platform: The United States Naval Academy Yard Patrol Craft,” AIAA Journal of Aerospace Information Systems, 21(8), 661–666. https://doi.org/10.2514/1.I011363

Helmich, H.F., Doherty, C.J., Costello, D.H., and Kutzer, M.D., (2024). “Automatic Ground-Truth Image Labeling for Deep Neural Network Training and Evaluation Using Industrial Robotics and Motion Capture,” ASME. J. Verif. Valid. Uncert; 9(2): 021001. https://doi.org/10.1115/1.4064311

Costello, D, Hanlon, N, Xu, H., (2023). “Refining Autonomous Vehicle Situational Awareness due to Varying Sensor Error,”  Systems Engineering, 27(2), 386–416. https://doi.org/10.1002/sys.21729

Costello, D., DeVries, L., Mauldin, C., & Ross, B., (2023). “DNN Based Ranging in Support of Autonomous Aerial Refueling.” Journal of Intelligent & Robotic Systems, 109(3), 49-. https://doi.org/10.1007/s10846-023-01969-1

Mwaffo, V.,  Miller, D., and Costello, D., (2023). "Assessing the Predictive Performance of Two DNN Models: A Comparative Analysis to Support Reusing Training Weights for Autonomous Aerial Refueling Missions," IEEE Access, vol. 11, pp. 92070-92079, https://doi.org/10.1109/ACCESS.2023.3308822

Parry, J., Costello, D., Rupert, J., & Taylor, G. (2023). “The National Airworthiness Council artificial intelligence working group (NACAIWG) summit proceedings 2022,” Systems Engineering, 26(6), 925–930. https://doi.org/10.1002/sys.21703

Costello, D. H., and Adams, R., (2023).“A Framework for Airworthiness Certification of Autonomous Systems Within United States Naval Aviation,” Journal of Aviation; 7(1) pp. 7-16. https://doi.org/10.30518/jav.1161725

Costello, D., & Xu, H. (2023). Using a run time assurance approach for certifying autonomy within naval aviation. Systems Engineering, 26(3), 271–278. https://doi.org/10.1002/sys.21654

Costello, D., & Xu, H. (2022). “Generating certification evidence for the certification of collision avoidance in autonomous surface vessels,” Maritime Policy and Management, 51(7), 1497–1516. https://doi.org/10.1080/03088839.2023.2180156

Costello, D. H., and Xu, H., (2021). “Relating Sensor Degradation to Vehicle Situational Awareness for Autonomous Air Vehicle Certification,” AIAA Journal of Aerospace Information Systems, Vol. 18, No. 4, pp. 193–202. https://doi.org/10.2514/1.I010905

Costello, D. H., Jewell, J., and Xu, H., (2021). “Autonomous Flight-Test Data in Support of Safety of Flight Certification,” AIAA Journal of Air Transportation, Vol. 29, No. 2, pp. 93–106. https://doi.org/10.2514/1.D0220

Costello, D. H., and Xu, H.. (2021). “Generating Certification Evidence for Autonomous Aerial Vehicles Decision-Making,” AIAA Journal of Aerospace Information Systems, Vol. 18, No. 1, pp. 3–13. https://doi.org/10.2514/1.I010848

Peer-Reviewed Conference Papers:

Costello, D.,  Scassero, M., Weiss, B. (2025). “Developing a Center of Excellence for the Test and Evaluation of Autonomy: UMD Matrix Lab,” AIAA SciTech 2025 Forum, Orlando, FL. https://doi.org/10.2514/6.2025-2727

Maheshwari, A., Lowe, R., Clement, D., Mottino, S., Mwaffo, V., Costello, D. (2025). “Determining Relative Positioning for Aerial Refueling Through DNN Bounding Box Geometry,” AIAA SciTech 2025 Forum, Orlando, FL. https://doi.org/10.2514/6.2025-2162

Wagner, L., Costello, D., Mwaffo, V. (2025). “Enhancing Autonomous Aerial Refueling with a Hybrid Deep Neural Network and Extended Kalman Filter Predictive Model,” AIAA SciTech 2025 Forum, Orlando, FL. https://doi.org/10.2514/6.2025-1930

Miller, S., Schug, A., Mwaffo, V., Costello, D. (2025). “Determining Relative Positioning Between an UAV and a Navy Surface Vessel with a  DNN,” AIAA SciTech 2025 Forum, Orlando, FL. https://doi.org/10.2514/6.2025-0193

Parry, J., Hubbard, S., Costello, D. (2025). “A Case Study to Explore Crew Resource Management During Crewed Uncrewed Teaming in Aviation,” AIAA SciTech 2025 Forum, Orlando, FL. https://doi.org/10.2514/6.2025-0838

Costello, D., Xu, H. (2024). "Flying is for Droids: A Survey of Research into Generating Certification Evidence for AI/ML Algorithms to Replace Human Pilots," 2024 International Conference on Unmanned Aircraft Systems (ICUAS), Chania - Crete, Greece, pp. 843-849, https://doi.org/10.1109/ICUAS60882.2024.10556846

Bostock, N., Richez, A., Wickramasuriya, M., Webster-Giddings, A., Costello, D. (2024). "Optimizing Drone Operator Workload in the Terminal Area for Shipboard Operations," 2024 International Conference on Unmanned Aircraft Systems (ICUAS), Chania - Crete, Greece, pp. 887-892, https://doi.org/10.1109/ICUAS60882.2024.10556943

Civetta, C. A., Costello, D. H., Kutzer M. D. (2024). "Probabilistic Object Tracking Using Quantified Camera Uncertainty Parameters in a Binocular System," 2024 International Conference on Unmanned Aircraft Systems (ICUAS), Chania - Crete, Greece, pp. 136-143, https://doi.org/10.1109/ICUAS60882.2024.10556911

McCormick, S., Mwaffo, V., Costello, D. (2024). “Deep Neural Network-Based Visual Identification of Naval Surface Vessels,” AIAA SciTech 2024 Forum, Orlando, FL. https://doi.org/10.2514/6.2024-2057

Adams, E., Mwaffo, V., Costello, D. (2024). “Can a DNN trained on a Fabricated Model be Used To Identify an Actual Naval Vessel?” AIAA SciTech 2024 Forum, Orlando, FL. https://doi.org/10.2514/6.2024-2058

Miller D., Mwaffo V., and Costello D. (2024). “Evaluating a DNN Trained on a Laboratory-Generated Dataset Against Actual Flight Test Data for Completing the Autonomous Aerial Refueling Mission,” AIAA SciTech 2024 Forum, Orlando, FL. https://doi.org/10.2514/6.2023-0192.vid

Richez, A., Costello, D. (2024). “Undergraduate Capstone Design Project: Autonomous Landing of an Uncrewed Multi-Rotor in a Radio-Frequency Denied, Maritime-Shipboard Environment” AIAA SciTech 2024 Forum, Orlando, FL. https://doi.org/10.2514/6.2024-0056

Mwaffo, V., Miller, D., Costello., D. (2024). “Image Segmentation using Deep Neural Network for the Autonomous Aerial Refueling Mission.” AIAA SciTech 2024 Forum, Orlando, FL. https://doi.org/10.2514/6.2024-2767

Bostock, N., Wickramasuiya, M., Webster-Giddings, A., Costello, D. (2024). “Drone Operator Workload Analysis for Dynamic Interface Flight Test,”  AIAA SciTech 2024 Forum, Orlando, Fl,  https://doi.org/10.2514/6.2024-0081.

Civetta, C., Miller, D., Costello, D., Clement, D., Mottino, S. (2024). “Environmental Effects on DNN Performance During the Autonomous Refueling Task,” AIAA SciTech 2024 Forum, Orlando, FL, January 2024. AIAA SciTech 2024, Orlando, FL. https://doi.org/10.2514/6.2024-2901

Bostock, N., Richez, A., Costello D. (2023). "Current USNA YP Integration Flight Test" Society of Flight Test Engineers 54th Annual International Symposium, Annapolis, MD.

Clement, D., Mottino, S., and Costello D. (2023). “Process Assurance for Object Detection Through Deep Neural Network to Accomplish the Autonomous Aerial Refueling Task,”2023 IEEE International Automated Vehicle Validation Conference (IAVVC), IEEE, Austin, Tx, 2023, pp. 1–6, https://doi.org/10.1109/IAVVC57316.2023.10328136.

Doherty, C. J., Costello, D. H., and Kutzer, D. M. (2023). "Ensuring Accuracy in Auto-Bounding Box Generation for the Autonomous Aerial Refueling Mission," 2023 International Conference on Unmanned Aircraft Systems (ICUAS), Warsaw, Poland, pp. 383-388, https://doi.org/10.1109/ICUAS57906.2023.10156598

Miller D., Mwaffo V., and Costello D. (2023). "Comparing DNN Performance to Justify Using Transference of Training for the Autonomous Aerial Refueling Task," 2023 International Conference on Unmanned Aircraft Systems (ICUAS), Warsaw, Poland, pp. 372-376, https://doi.org/10.1109/ICUAS57906.2023.10156120

Bowstock, N., Richez, A., Wickramasuriya, M., Costello, D.H., Webster-Giddings, A. (2023). “Verification of YP689 Flow Fields Models for Dynamic Interface Flight Test,”  AIAA SciTech 2023 Forum, National Harbor, MD. https://doi.org/https://doi.org/10.2514/6.2023-0294

Miller, D, Mwaffo, V, Costello, D. H. (2023). “Transference of Training for a DNN to Complete the Aerial Refueling Task,” AIAA  AIAA SciTech 2023 Forum, National Harbor, MD. https://doi.org/10.2514/6.2023-0192

Ross, B. L., Mauldin, C.A., Parry, J. K., and Costello, D.H. (2022). “First Steps Toward Certifying and UAS to Receive Fuel Airborne.” 2022 International Conference on Unmanned Aircraft Systems (ICUAS), Dubrovnik, Croatia, 1656-1661. https://doi.org/10.1109/ICUAS54217.2022.9836174

Professional Journal Papers:

Costello, D. H., Xu, H., “Using a Run Time Assurance Approach for Certifying Autonomy Within Naval Aviation,” The ITEA Journal of Test and Evaluation 2022; 43: 165-173.

Costello, D.H., and Whiteneck, D.J. “Dynamic Maneuver Requires Agile Logistics,” Proceedings of the U.S. Naval Institute, January 2020.

Costello, D., and Gilroy, B., “The Naval Aviation Technical Information Product,” NSAWC Journal, Winter 2015, pp. 40-48.

Costello, D.H., “From Prowlers to Growlers,” Smithsonian Air and Space, November 2010.

Costello, D.H., and Davis, T., “The Original EA-6B Retires,” The Journal of Electronic Defense, Vol. 22, No. 8, August 2010.

Conference/Invited Presentations:

Costello, D., Session Chair: Aerodynamic Design: Analysis, Methodologies, and Optimization Techniques III, AIAA SciTech 2025.

Costello. D., “November 2020 Firescout Class A Ground Mishap,” Guest Lecturer EW401, United States Naval Academy, November 2024.

Clement, D., Costello, D., “Development Life Cycle for Using a DNN to Complete the Autonomous Aerial Refueling Task,” Presentation to the US Army SRD (Airworthiness) AI Working Group, October 2024.

Costello, D., Miller, D., Civetta, C., “A4RS DNN Summit - Sponsored by the United States Naval Academy”, Annapolis MD, February 2024.

Costello, D., “Certifying Autonomy in Naval Aviation”, Guest Lecturer ENEA 380, University of Maryland College Park, November 2023.

Costello, D., “November 2020 Firescout Mishap Case Study,” Guest Lecturer EW401, United States Naval Academy, November 2023.

Costello, D., Miller D., “Supporting Autonomous Aerial Refueling,” Invited Presentation to the Society of Flight Test Engineers 54th Annual International Symposium, Annapolis, MD, October 2023.

Costello. D., “DNN SOF Plan for DNN Based Aerial Refueling as Part of the A4RS FNC,” Invited Presentation to the USN/USAF Future AAR Working Group, NAS Patuxent River, MD, July 2023.

Costello, D., “Autonomous Aerial Refueling, FY24 New Start FNC: First true use of AI in Naval Aviation. “A first step towards the future,” Invited Presentation, to the Commander Naval Air Forces staff, San Diego, CA, June 2023.

Costello, D., “A4RS FNC,” Invited Presentation, Industry Engagement, Lockheed Martin, Palmdale, CA, June 2023.

Miller, D., Mwaffo, V., Costello, D, “Transference Training in Support of the Autonomous Aerial Refueling Mission,” Invited Presentation, 2023 Naval Autonomy Working Group (USNA/NPS), Annapolis MD (Remote), April 2023.

Costello, D. H., “Towards Autonomous Aerial Refueling: Advanced Autonomous Air-to-Air Refueling System (A4RS), ONR FY-24 New Start Future naval Capability (FNC) + USNA Support for the FNC,” Invited Presentation/Panelist, Aerial Refueling Systems Advisory Group 2023, Orlando, FL, April 2023.

Costello, D. H., “Naval Air Worthiness for Autonomy,” Invited Presentation, 2023 Cross Service Autonomy Summit, Patuxent River, MD, March 2023.

Costello, D. H., “Standards and Methods of Compliance for Autonomous Unmanned Aerial Refueling,” Invited Presentation, Seventh Annual Workshop on Naval Applications of Machine Learning, San Diego, CA, March 2023.

Costello, D. H., “USNA Support to the Advanced Autonomous Air-to-Air Refueling System (A4RS) FNC,” Invited Presentation, Brief at the FY-26 New Start A4RS FNC Kickoff Meeting, February 2023, Annapolis MD (Remote), February 2023.

Costello, D., “Navy Airworthiness and Autonomy”, Guest Lecturer ENEA 380, University of Maryland College Park, November 2022.

Doherty, C., Helmich, H., Costello, D., Kutzer, M.; “Toward Automatic Ground-Truth Labeling Using Industrial Robotics and Motion Capture,” ASME IMECE 2022 International Undergraduate Research and Development Expo Poster Session, Columbus, OH, October 2022. 

Costello, D. H., “AI Certification for Naval Aviation: Use Case for Certifying a ML/AI to Complete a Task Without a Human in/on the Loop,” Invited Presentation, IEEE V&V of AI Working Group, Annapolis MD (Remote), September 2022.

Costello, D. H., “Assuring Autonomy for the Future Force”, Invited Presentation, Airworthiness Symposium hosted by Northrop Grumman, Baltimore, MD, August 2022.

Costello, D. H., “Autonomous AR Research at USNA,” Invited Presentation, NAVAIR Aerial Refueling Summit, California, MD, August 2022.

Costello, D. H., and Xu. H., “Judgement Proxies for Certification of Autonomous Systems: Our Research,” Invited Presentation/Panelist, ICRA 2022, May 2022, Philadelphia, PA.

Costello, D. H., “Run Time Assurance Approach to Certifying Autonomy Within Naval Aviation, Possible Method to Certify Without a Human in or On the Loop,” AUVSI Xponential 2022, May 2022, Orlando, FL.

Costello, D., “Navy Airworthiness and Autonomy”, Guest Lecturer ENEA 380, University of Maryland College Park, November 2021