I arrived in Calais 3 weeks ago
No problems, yes there were several groups of young men walking around, eating at the same food stall as I, chatting...
Not sure where you're going , but if on Via Francigena...I just followed the canal out of town to Guines so you're only in Calais a couple of hours