Though a minute is a accurate amount of time, we frequently use it to mean a short amount of time. The exact same goes for “moment”; the difference being that a lot of people don’t know that a moment is a accurate measure of time.
Technically, a moment is 90 seconds.
The 1st reference comes from 1398, discovered in the Oxford English Dictionary. Cornish writer John Trevisa wrote that there are 40 moments in an hour (hence 90 seconds each). Oxford has since replaced it with, “a very brief period of time.”
So carry on, keep on using it as a informal measure of time — now you know the real meaning.
Sources: oxford dictionary, wikipedia (moment)