ToroWheelhorse 520xi

Baffle(s) in muffler are gone. Muffler doesn't leak but is very noisy. Will continuing to run the engine without replacing the muffler affect the performance of the engine? Will not replacing the muffler damage the engine?