I am 47, riding 32 years now, and I know exactly what you're talking about. Congratulations! In case you don't already know it, when you get used to the VFR you'll still be able to go WAY faster than anybody should on a public road and even lose 95% of the riders out there in the twisties if your skills are up to it, regardless of what they're riding . The nice part is that you can do it all day while they're nursing sore parts. Titanium bolts, removing the chain guard, the latest exhaust can from Max Decibals, two more horsepower, etc. will never substitute for smooth riding, gauging your entry speeds, picking your lines, confidence in your bike's abilities and your's to use them, and putting it all together down a good twisty road.
The real test comes at the parts counter. Will you be able to keep the stock exhaust or will that be too much of a shock to your system?(joke) If you can stand it, the stealth may save you some tickets by not announcing to every cop in a 20 mile radius what you're up to and your ears will love you at the end of a long day!
Before anybody takes the heat, please understand that actually, I love it all. The loud pipes, too. I'm just way beyond dealing with it or spending money on it. I do good maintenance, spend money on good tires, and go wear them out (five sets last year), preferrably edges first, all over the East and Northeast mountains. I guess what I'm trying to say is... I understand your choice completely. Good Luck!