The VIMOS Public Extragalactic Redshift Survey (VIPERS): The complexity of galaxy populations at 0.4 < z < 1.3 revealed with unsupervised machine-learning algorithms