Page Kennedy was fired by ABC for improper conduct.
He won't be appearing in the series any longer. The 28-year-old actor was playing a fugitive called Caleb, a character shrouded in mystery that was seen only briefly this season, when locked in Alfred Woodard's basement.
The decision came after a "thorough investigation by the studio", but none of the allegations were made public.
The production company declared though that the alleged misconduct didn't involve another cast member, according to the Associated Press.
Kennedy's part is to be recast to another actor. Variety says newcomer Nashawn Kearse is to receive the role. Kennedy's last appearance in the show will happen on Sunday.
The actor must be "desperate", as the series represented a chance of "making a name" for him.
Talking to the Associated Press, Kennedy praised Woodard as his favorite actress and said the rest of the team "has been so sweet and nice" to him.
He was so thrilled about the show that he had turned down other engagements, such as a recurring role on Showtime's "Barber Shop" and parts on WB's upcoming Rebecca Romijn series, "Pepper Dennis" and on UPN's "Love, Inc".