If it's only for a second, I wouldn't worry about it as is usually take a bit of time to build up the oil pressure.
If it is much longer that what you are used to, you might think about starting with a thinner oil as it starts to get cooler. 20-50 really shouldn't be to bad for 55-65 degrees, but it tends to get relavely thick in the cold months.
Also, if you haven't changed oil/filter recently, I'd do that first just to make sure your dealing with clean fluids in the system and your filter isn't clogging.
Lastly, it could also be your oil pressure sensor. They rarely go bad (although sometimes they leak). But again, unless it is unusually long or if you hear more valve chatter than normal (oil starvation), I wouldn't mess too much with it.