It was discussed some on the High School board, if size and class matter. Obviously, at some point it does. The 1A champ isn't going to be competitive with the 7A champ. That's the same principle here. A certain record in the Mountain West or ACC isn't the same as that record in the SEC. Look at the Clemson/USC final game. With that being said, if any of the three-loss SEC teams would have won the games they should have, they'd probably be in.
P.S. What separated Saban from everyone was consistency week to week and year to year. That's what everybody else is missing. It'll probably get worse in the current era. And add depth and injuries.