Bethesda have announced that a free patch for The Elder Scrolls V: Skyrim is on the way to PC and later consoles that will add the ability of fighting while mounted on a horse.
A beta of the feature is already running on Steam if you're in a hurry to try it out, and so far there is no firm date as to when the feature will be added to the full game.