Keeping track of threads we want to return to