I don't think that's out on a limb at all. I think that's the direction the major conferences are heading in. It may happen slowly, I think conferences are afraid of expanding too fast, so they're expanding slowly to assimilate their new teams. I think the SEC is getting two more teams and will sign a ridonkulous tv contract. When that happens the Big Ten and PAC 12 will have no choice but to follow suit, then either the Big 12 or ACC will be the 4th and final major conference.
So with four 16 team conferences, each one will have 4-team divisions, and conference semifinal and championship games. The four champs go on to the playoff. Even though that's technically a 4 team playoff, it's essentially a 16 team playoff. Only the first two rounds are really regular season games.
I don't know if you guys read Clay Travis at outkickthecoverage.com, nut it sounds like you do. The conference playoff idea was first predicted by him. He's been on the money with everything so far in realignment.