Jimmy Arndell was in the Hopkins County jail on theft charges.
Arndell was released around 1:45 p.m. on Tuesday.
15 minutes later, employees noticed him trying to steal a tip jar from a local coffee place in Madisonville.
Arndell was arrested and charged with criminal trespassing.
Authorities say he has an extensive history of loitering and stealing from vehicles and local businesses.