Renovation slowly wipes away years of neglect from an old mill building which once housed a Chocolate Factory.