RipBench

Rip currents are a serious and often under-addressed threat to beach safety, and the leading cause of coastal drownings worldwide. They are difficult to detect due to their amorphous structure, similarity to the background, and large variability in viewpoints and environments. Despite their dangers and growing interest in automated detection, existing research remains fragmented across datasets, metrics, models, and approaches, leading to an incomplete understanding of model performance.

We introduce RipBench, a unified benchmark that enables controlled evaluation of rip current detection spanning multiple tasks, including classification, axis-aligned and oriented object detection, and instance, semantic, and panoptic segmentation, on the same data with standardized splits. This allows direct comparison of model performance on all levels of visual abstraction.

Across 304 videos and 303,491 total video frames, with 51,011 sampled frames annotated for all six tasks, collected from diverse coastlines, our results expose a clear performance gap between coarse recognition and precise spatial understanding. While models achieve near-saturated classification performance, accurate localization proves to be substantially more challenging, with performance varying across tasks.

All tasks are supported with carefully curated annotations and evaluated using both standard and safety-critical metrics, with a focus on the F₂ score to emphasize recall in this safety-critical setting. RipBench, along with multiple baseline models per task, will be released to support progress in real-world, multi-task vision for beach safety.