"Nuestra Música 'Our Music' really goes overboard..."

Yes. Very common expression.

Obviously, an idiomatic or figurative expression like "tirar (or "echar") la casa por la ventana" can't be rendered literally. Well, actually, it can, but to "throw the house out through the window" doesn't quite make it.

"Pulling out all the stops" is a reference to the mechanism of pipe organs. When the organist removes the obstructions (the stops) from the pipes, the result is an open, full-throated, and potentially maximally LOUD musical performance.

That one seems to fit your context best, given its musical roots. But there are also "blows the roof off" (if you want to preserve the architectural metaphor), "lets it all hang out," or, if you prefer the understated route, "doesn't suck."

Cheers,
HC

Yes, this is a figurative expression that means that their music is above the rest.

Hope this helps!

The term is often used as to weddings in which money is no object or sales everything is priced to the bottom dollar.