Safe and Effective Learning: a Case Study