Halo 3 xbox live "network difficulties"?

In matchmaking, It finds a game w/people, but when the part about "veto map or not" comes up, I get booted. Is it my router or internet connection or xbox live? My friends stay in the game- its just me getting booted.