Accidentally slept with my contacts on?

I had an eye doctor tell me that once won't hurt, just don't let it become a habit. I'm in the process of trying getting contacts.