The Transformer Refuge Construction