RT @fchollet
Always keep in mind, though: GPT-3 and GPT-4 were trained on the public ARC tasks and their solutions. The tasks are distributed as JSON files part of a public GitHub repo, which is of course part of the training data.

This is exactly why the *test set* is fully private.