Looking at the frame-by-frame predictions would not work very well, primarily due to the class imbalance (most objects are not present in most frames). Visually one can plot the predicted probability that an object is present over time - vs the ground truth label, and one can quantify the overlap via PR AUC which is more robust to class imbalance than ROC AUC, and without a need to condition on a given threshold.