best you could do is optimizing your video for youtube i encode my videos in x264, 1999kps, 2pass & wave for the audio. wave because like this the encoder focus on the video part as the audio is uncompressed it's not a big of a deal to encode. also the frame size on youtube the max is 960x720 (4/3) and 1280x720(16/9) thus i encode my videos in one these formats. Try to avoid any other size above/below these. Now for vimeo you'd have to do your tests, what's the max frame size/ max bitrate possible.