A member of the Special Engineer Detachment of the U.S. Army, Ray Stein participated in the Manhattan Project at Oak Ridge and was assigned to the Y-12 Plant. At Y-12, he and his fellow SED members donned civilian clothes and were told to keep an eye out for possible saboteurs or spies. It was also at this plant he met the woman he would later marry, Alice Stein.