Do you think this is a bad sign or am I making a big deal out of nothing?

It is completely natural to feel that way, you should open up to him and tell him about it and how it makes you feel