This invention provides a method of combining two standard video streams, into one standard video stream, in such a way that it can be encoded efficiently, and that it can enhance the TV viewing experience by presenting Stereoscopic 3D imagery, dual-view display capability, panoramic viewing, and user interactive “pan-and-scan”. The video standards for High Definition Video are used, which are governed by the ATSC and SMPTE standards bodies. Having a dual stream of standard video, which occupies now a single stream of standard video, provides a means to use the standard installed base of equipment for recording, transmission, playback and display.