The bulldozers are working at speed to dismantle an enormous man cave after accountant millionaire owner lost 10-year fight to keep it