And so I missed those best years and I find it difficult for me, in groups, to be comfortable.

Despite his illness Albert exercised regularly until shortly before his death. The film Attack! (1956) provided Albert with a dark role as a cowardly psychotic Army captain whose behavior threatens the safety of his company. On stage
The 1950s also saw a return to Broadway for Albert including roles in Miss Liberty (1949–1950) and The Seven Year Itch (1952–1955).

He was nominated for the Academy Award for Best Supporting Actor in 1954 for his performance in Roman Holiday and in 1973 for The Heartbreak Kid. He also had a recurring role as Carlton Travis on Falcon Crest opposite Jane Wyman.