I think a bigger reason for the comparatively small scale of college baseball is the success of minor league baseball. MiLB is a giant compared to the D-League, and the NFL has no minor league to speak of.
In my opinion, it's minor league baseball that takes up a lot of the market the college baseball could otherwise exploit.