To build a nuclear powered carrier, the French had to either use an existing reactor, or spend a large sum developing a new one. They chose the cheaper option.
Since nuclear reactors are big things, this limits the scalability of the ship design. It can get bigger or smaller only in rather large increments. Rather than go bigger & fit another reactor, the French chose to squeeze as much as possible out of the minimum reactor fit, to keep the cost down - again. So the reactors per se aren't the cause of the limited speed (which is a lot better than it was when she was using old propellers from Clemenceau), but the choices made on number of reactors & size of ship.
They've lengthened the time between refuellings for the reactors in the Barracuda submarines, but that's too late for CdG. Still, she'd need refits about as often as the refuellings anyway: the refuelling just means the refits take longer.