Where there's no judge, there's no hangman.

It's not a colloquialism, but I think it would be understood if you were to use it (depending on the context - considering the many lynchings that have occurred over time, the "no judge" part may be questionable).

Thank you!

Variante:
"Die Nürnberger hängen keinen, es sei denn, sie hätten ihn."