No because the bandwidth of the AGP bus is never fully utilized. Will it be less, a bit, but not as much as you think. A lot depends on your system.
Same thing happened when the jump was made from AGP 2X - 4X.
is your friend if you want a quantitative answer.
P4 2.6C, Thermalright SP94/Panaflo 92MM M1A, IC7 Max3, Swifty MCX159, 1GB Geil PC4000 Ultra Plat, Radeon 8500, Audigy 2, 2X WD Raptor RAID 0, WD 250GB SE, Plex 708A, 166SDVD, LianLi PC75, XP Pro.