The horse will be named for example 'Lydia's horse', and cannot be ridden by anyone else but the owner of that horse. The Dragonborn does not have to acquire a horse for them, however, as they will summon their own horse.
1.6 Mounted Conversations, Looting and Harvesting.