At a certain point you realize, "Oh shit! I might need to start over from scratch if I want to scale up much bigger than this... yikes!" Welcome to programming.
The eternal dilemma in programming. Whether to quit or start over. Building a working program is a skill. Refactoring a working program so it's succinct, simple, and continuously useful, that is art. I think that's why I hate all the code I work with. It fits in the first category but misses the second. I spend why more time in reviews than actual coding.
The factories of spaghetti make good debuggers and tend to over interesting challenges, but rarely do they make good products. There's nothing wrong with fragile programs, just don't expect anyone to understand what is being done.