Question about vagabond from a new player?

I keep hearing everyone talking about vagabond being bad for the game but is that only with the extended vagabond options or is it true in the base game as well?

( Also if anyone can explain more why people don't like vagabond it would be appreciated 👍)

Edit: thanks for all the helpful replies, really helped me get the nuance a lot better.