I think I found out more!
Due to the way the filament is stored its curved when unwrapped for usage (pulled into the nozzle). This curvature is enough to cause the filament to press against the side of the nozzle instead of leaving it centred.
I managed to improve on this issue by a lot by using a bowden tube of about 1 meter. This reduces the curvature of the filament. Be sure that the tube connects straight to your printer and not at an angle.