I'm raising my first as well so I don't have any experience to draw from but I don't think it's a problem. Heck my little sleeps with me every night and we were taking her morning nap together while I was on maternity leave as well. Now that I'm back at work the napping together has stopped, except on weekends, but I'm not giving up my nights with her. I find that both of us sleep better this way at night than if I put her in her bassinet.

But that's just me. YMMV.