After years of attempts to remove a millionaire accountant’s enormous personal leisure complex, demolition work has been completed