Is Being Curious Always Fine?