"Mapping each story point to a fixed number of hours removes the relative character of story-point estimation."
Cohn explains that assigning a fixed hour equivalence to story points turns a relative sizing measure back into a time-based estimate.
View Source