I would say in the vast majority of cases, absolutely not. Really the only species in the hobby that's *thought* to possibly have issues stemming from that is Elliptorhina davidi (since the captive stock originally comes from a single gravid female), which have continued to flounder in captivity years after being introduced to it, but we also might just not understand some aspect of their husbandry. Almost all of the other species stocks in the hobby come from a handful of individuals imported multiple decades ago without any new bloodlines introduced since then, yet they still thrive to this day.
As for first hand experience, I have some colonies that have been going self-sustained for nearly half a decade now and I'm not seeing any signs of any sort of weakening.