The Captain refers to the Roddenberry bush. This is a reference to Star Trek (1966) creator Gene Roddenberry.
The title is a parody of that of the 1960 novel "Goodbye, Columbus" by Philip Roth and its film adaptation Goodbye, Columbus (1969) in which Richard Benjamin (Adam Quark) played Neil Klugman.