The South 24 Parganas district administration on Saturday started demolishing the party office of TMC MP Abhishek Banerjee in Amtala after it was found to be constructed allegedly without an approved building plan and in violation of applicable rules, sources said.