This is the worst part about losing a coach and the subsequent search for a new one. You basically lose a recruiting class. Look at the last 2 times this happened. If memory serves, Jirsa didn't have 1 player in his first class that stayed over 2 years. The only one that survived Money Jones' first class was Tirrell Baines (thankfully).
Also, another advantage is that MJ was already recruiting CUSA talent, so the transition is easy. I am completely in favor of hiring a head coach like Buzz or Lutz, but that transition will not be as smooth. I would think different conferences attract different recruits/styles.