The pilgrimage will not return to the days of smaller crowds. Unless you have a time machine, you will have to accept the conditions as they exist today, and it has become very popular. Keep in mind that the statistics are generally for arrivals in Santiago, so the the August numbers are for pilgrims who probably started in July. July numbers are for those who started in June. June numbers are for those who started in May. August of last year had over 2000 per day almost every day, with a peak of 2748 on August 9. July averaged 1,444 per day with fewer in early July and more in late July (only one day in July had fewer than 1000 arrivals, and that was July 1 with 920).
I think it is time to be less sanguine about the results of spontaneity. Pilgrims will not be able to start late, walk until evening, then easily find a bed. Those who start predawn and stop a 2 p.m. will get the beds. They probably will have an attitude toward the pilgrims who interrupt their afternoon nap! Pilgrims arriving at
albergues that take reservations probably will be greeted with a stack of backpacks that have been sent ahead.
To those who are thinking "I should have done this ten years ago," you are right.