Would you believe that my ISP, Comcast, is blocking the connection?
I'm currently using my phone to hotspot the connection. My ISP blocks it, but Verizon has no issue with it. It's not the first time Comcast has blocked sites they shouldn't. They blocked Github before. I'm going to see if a VPN will allow me to download the blocks and wanted to ask for a feature request of a built in anti-block feature. Thanks!
Edit: So, the VPN does work, but it doesn't seem to like IPv6. I did try yggdrasil only mode and while the traffic from my side did show up on the tun adapter, but I never got any response. I am able to access yggdrasil only sites though. So, I'm not sure if I have ygg misconfigured for accessing "regular" sites (from what I can tell, ygg routes regular sites through my normal connection and ygg sites through the tun adapter).

So, I ended up renting a VM that allows crypto mining which can let me generate the keys I need and apparently the connection just decided nope, no matter if I use VPN, hotspot, or anything (when testing locally to eliminate reasons why the VM can't connect).

I plan to publish 0.6.0 release tomorrow. It will use strong ECDH encryption for P2P-connections.
@alexis-evelyn, did you try version 0.6.0? Does Comcast block its P2P connections?