You know NFL defenses do exactly that.. right? It will be something like the field-side corner (covering the lone receiver) to play man coverage on the #1 receiver (the outermost receiver on the weak side) while the boundary-side corner and nickel back to play zone on the three-receiver side, splitting the field into quarters. The strong safety plays a deep half zone on the three-receiver side and the free safety to play a deep quarter zone on the field side, providing help over the top of the man coverage.