How do I know that this is teething

Baby is fussier than ever. Cries a lot. I am not against Tylenol but I am too afraid to give it just because baby is crying. It may be just a new development issue aka growth spurt. How do I know? What if I am wrong, I would give pain relief but there would not be teeth No swollen gums, no fever.