Study of the B 0 → ρ(770)°K * (892) 0 decay with an amplitude analysis of B 0 → (π + π − )(K + π − ) decays