Clemson University has been accused of demolition by neglect of a building it wants to tear down at historic vegetable research farm in Charleston.