Usage of having said that

It's a holiday tomorrow. having said that, the special classes will be contracted for higher classes.

Prarota teast is really good. Having said that, it's not good for health.

He remembers everything. having said that, he forgets my birthday