Nah, it’s entirely doable. But you’re better off taking the fast-train to Zürich, then renting a car there and drive over the Saint Gothard or the Saint Bernardino pass. If you got time, it’s totally worth it for the scenery.