The driver replaced the backing buffer object of a host mapped memory object causing random faults and inconsistency issues.
Sadly the way mapping memory in OpenCL works is pretty annoying. I fear I'll have to rework those bits in #rusticl as well, because I'm way to optimistic on some assumptions. And I'll also have to fix contexts with multiple devices while at it.