Modulation of dephasing due to a spin boson environment