Dave,
I wonder if you could make some kind of sweeper that you could run in front of an engine to dislodge all the junk from the rails. Something with a rotating brush sort of thing. I just saw something like this at the CTA shops in Skokie, IL. I'll see if I can get a picture of it next time I drive that way.
Or maybe a small leaf blower with a reduced nozzle on it to blow away the debris.
I use Titebond II /water mix on all my ballast, no problem with loose gtit after rains.
Bud
The Dixie D Short Line "Lux Lucet In Tenebris Nihil Igitur Mors Est Ad Nos 2001"
Get the Garden Railways newsletter delivered to your inbox twice a month