Uh no.

The GPUs have volatile memory. Soon after power is cut you lose everything.

Suppose you could keep them powered somehow, you'd still need to piece the weights together across multiple gpus.

Much easier to try to get to the disks from which the GPUs read those wrights
---
RT @EMostaque
Something I've been wondering about proprietary foundation models.

Like someone breaks into a data centre and takes a GPU that has the weights r…
https://twitter.com/EMostaque/status/1639389324851421189