The castle, shown in the episode at around 4min:11sec, is the Max Busch House in Pasadena, California. It appears to be the same matte image used in the 1985 film, "Clue," also starring Michael McKean. The house, unfortunately, was destroyed by fire in 2005.