Do I have to remove Silky Cup while using the toilet?

No, although you may feel it travel down slightly if using your abdominal muscles more than usual. All you need to do is readjust it if this were to happen.