How much does Camo actually help?

I have went whitetail hunting for years, as long as you aren’t wearing a particularly bright color, it doesn’t seem to hurt you any, wearing just normal clothes. How does the pattern help?

With the exception of dove and duck hunting, I have never had not having camouflage shirts actually hurt me.