The remains of a burned building which led to the closure are "a blight" according to one local.