I've had similar with Chromium on Ubuntu Studio 20.04. It usually connects fine the first time but if I keep disconnecting and reconnecting it starts to misbehave and struggle to connect. Shutting down Chromium and leaving it for a while seems to help. I do have quite an old laptop, mind, so could be a dodgy Bluetooth. Never get those issues on Android or my work Windows machine.