She grew up in and around New York City. Her parents were immigrants who separated when she was 11. Her father was from the Ukraine, and worked as a milliner. Her mother, from Poland, was a garment worker, a union activist and a member of the Communist Party. She took her daughter, about 10 at the time, to a union rally at which
Paul Robeson sang, an event Gilbert later recalled as "transformative".