Is it normal to have some white or yellow discharge in between periods?

Yes, it is normal to have a whitish or yellowish discharge while not on your period. If the discharge starts to smell sour or turn brownish or reddish consult your doctor.