Yes, Floyd Patterson lost his title twice in his career. The first time was in 1959 when he lost to Ingemar Johansson in a 12-round unanimous decision. The second time was in 1962 when he lost to Sonny Liston in a first-round knockout.
Unpacking the Legacy of Floyd Patterson: A Boxing Quiz