'My fans get angry' says Bieber