I agree 150% I learned when I had my 17ft Lund Pro Sport in 2007. Big water fishing isn't fun when you are full throttle on an 80hp Yamaha 4stroke doing 34-37mph. Hence the upgrade to bigger boat and the 225hp.
My advice is that if weather is a concern, as Crankworm stated, get the bigger...