I have biked the camino several times, never with paniers.
My first camino I used a 30L backpack, it was too heavy and I suffered a bit on the lower back and backside.
But I saw my friends using paniers on mountainbikes and having bolts falling, we had to canibalize from other parts of the bike...