As Maritime Autonomous Surface Ships (MASS) move closer to real-world deployment, ensuring their operational safety is a pressing challenge. Scenario-based simulation testing has become a cornerstone for evaluating autonomous systems across diverse conditions within their Operational Design Domain (ODD). This talk presents a Bayesian approach to quantify residual uncertainty in scenario-based testing, introducing probabilistic safety metrics to support transparent, data-driven assurance and highlighting future research needs.