Receiver operating characteristic (ROC) curves are often used to assess the performance of detection and classification systems. The Strategic Environmental Research and Development Program/Environmental Security Technology Certification Program (SERDP/ESTCP) is sponsoring the development of novel systems for detecting and classifying unexploded ordnance (UXO) in underwater environments. SERDP is also sponsoring underwater testbeds to demonstrate the performance of these novel systems in relevant environments. The Institute for Defense Analyses is currently designing and implementing the scoring process for these underwater demonstrations to address the subtleties of ROC curve interpretation. This presentation provides an overview of the main considerations for ROC curve parameter selection when scoring underwater demonstrations for detecting and classifying UXO.