Yes, even with the new firmware.
I've tried it with 7pF caps on (the closest I have at the moment) with the same result.
Espruino 1v87 (using the binary from the website) has started up fine so far after numerous unpluggings etc. It reverts to start up problems when 1v88 is flashed on again.
Also, with 1v88 loaded the web ide has trouble connecting:
something like "Can't find STM bootloader"
Edit: An Espruino 1.3 without a crystal works fine with 1v88.