Is this a bad idea? What if I am just feeling this way because she is with someone else?

Thinking about yourself, your expectations, and needs, and using that information to make a decision is not impatience.