@soundnfury multiple models does sound like a good option to dodge some of the risk.
The other bit that I _think_ helps is running the model against other data.
X happens. Model A predicts VWX. Model B predicts XYZ. If we see W, predict V. If we see Y predict Z.
This tends to make people very mad if they only have one model though.