In being nimble and responsive and to avoid wasting effort, this is a great mindset. It's not laziness-as-an-artform, it's about executing quickly to get a proof-of-concept into someone's hands so that they can quickly affirm that you're on the right track or so that we can quickly discover that the business requirements were wrong.
But as leadership, you must concern yourself with the whole, quality product. You may still want to iterate quickly, and if you've got a forgiving audience who enjoys living on the edge or is excited by continually discovering new features you've just added, but if you have paying customers, you may take the MVPs in bundles to release to your customers.
And it's at those releases of new features that become a great time to celebrate your other MVPs - the "Most Valuable Player" who deliver quality Minimum Viable Products that don't require a lot of refactoring to move from proof-of-concept to world-ready scalable secure releases.