24th May 2015, 08:30 AM
I don't think you're being paranoid, it's something archaeologists need to be aware of. There are really good guidelines available for how to deal with asbestos, though, and if they're followed the risk is minimal.
http://www.hse.gov.uk/asbestos/
http://www.hse.gov.uk/asbestos/