Xbox tends to slow down the download speed while a game is running in order to reserve internet speed for the active game in case it needs it. It looks like it prioritizes the speed for the active game rather than the downloading procedure.