To see your team denied a clear penalty or goal etc is frustrating, it is not fun. Refereeing decisions can cost your team many points per season, which is enough to miss out on the title / europe or to condemn you to relegation.