It is still not usable completely...
I get less garbage with 80MHz SPI Speed. But the serial connection drops after a while for no apparent reason... It behaves similarly with 20MHz.
wifi.connect() makes it disconnect and not possible to connect anymore.
It almost looks like some kind of thermal watchdog resetting after a while. It is fairly warm when I touch it in just a few seconds of plugging in.