With regard to academic rigor, I'll cite the US News rankings, which of course always spark a controversy. Amherst is ranked near the top, Midd and W&L are right next to each other, and Conn is another level behind. That said, each school has its own approach toward the parameters for recruiting "student athletes".
https://www.usnews.com/best-colleges/rankings/national-liberal-arts-colleges?_sort=rank&_sortDirection=asc
https://www.usnews.com/best-colleges/rankings/national-liberal-arts-colleges?_sort=rank&_sortDirection=asc