Ok I now have the answer, decentralizing WebRTC signaling is already a WIP for js-libp2p:
The only question remaining is, when will we have a stable implementation of it?