'Trying to frighten me': Tension is building on San Francisco's Billionaires' Row