proxyman-windows-linux icon indicating copy to clipboard operation
proxyman-windows-linux copied to clipboard

Proxyman cannot handle HTTPS traffic whose CONNECT request HOST is IP instead of server name.

Open cesaryuan opened this issue 2 years ago โ€ข 13 comments

Description

Hi, thanks for you excellant product!

I'm trying to capture traffic from Android application. Here is my procedures:

  1. Root the android device
  2. install the proxyman cert to system CA
  3. install Proxydroid app to phone
  4. set Proxydroid to transfer the traffic to [ProxymanIp]:9090
  5. open android chrome and then check capture on Proxyman

image

We can see that all HTTPS capture cannot get domain but only ip. It causes that proxyman cannot capture HTTPS correctly.

However, other alternative proxy software on Windows such as Fiddler Classic and Mitmproxy can handle this correctly (Fiddler need additional settings). As far as I know, they obtain the server name indicator from the client's TLS handshake instead of using the HOST field from the CONNECT. (Reference https://groups.google.com/g/httpfiddler/c/hvsDR14j1Lg/m/P02zBzIYCE4J)

It seems there is an similar issue. But I'm not sure. Proxyman does not use SNI when generating certificates for use with SSL Proxying ยท Issue #1581 ยท ProxymanApp/Proxyman

Therefore, it will be wonderful if you can fix this issue.

Steps to Reproduce

  1. Root the android device
  2. install the Proxyman cert to android system CA
  3. install Proxydroid app to phone
  4. set Proxydroid to transfer the traffic to <Proxyman's IP>:9090
  5. open android chrome and then check capture on Proxyman

Current Behavior

image

Expected Behavior

image

Environment

  • App version: Proxyman Windows 2.2.0
  • Windows version: 22H2

cesaryuan avatar Aug 13 '23 09:08 cesaryuan

Thanks @cesaryuan for the detailed feedback. Our team is going to fix it asap ๐Ÿ‘

NghiaTranUIT avatar Aug 14 '23 01:08 NghiaTranUIT

@cesaryuan I've confirmed that we can reproduce the bug with Android Emulator too. Gonna fix it now.

NghiaTranUIT avatar Aug 14 '23 01:08 NghiaTranUIT

@cesaryuan I've confirmed that we can reproduce the bug with Android Emulator too. Gonna fix it now.

Thank you for your quick response! ๐Ÿ˜˜

cesaryuan avatar Aug 14 '23 02:08 cesaryuan

@cesaryuan can you try to Disable the Private DNS in Android Settings -> Network & internet -> Advanced -> Private DNS

From what I know, it can fix the bug.

Ref: https://stackoverflow.com/questions/68819088/fiddler-ip-address-being-captured-instead-of-url-from-android-emulator

NghiaTranUIT avatar Aug 14 '23 13:08 NghiaTranUIT

@cesaryuan can you try to Disable the Private DNS in Android Settings -> Network & internet -> Advanced -> Private DNS

From what I know, it can fix the bug.

Ref: https://stackoverflow.com/questions/68819088/fiddler-ip-address-being-captured-instead-of-url-from-android-emulator

Thanks! I checked that this option has been disabled already. image

cesaryuan avatar Aug 14 '23 14:08 cesaryuan

Hi, is there any progress on it?

cesaryuan avatar Sep 22 '23 10:09 cesaryuan

Hi, this bug will continue to be fixed after we finish updating new UI for Proxyman Windows. For now, I haven't found a solution or workaround for this.

kics223w1 avatar Sep 22 '23 10:09 kics223w1

Hi, is there any progress on it?

cesaryuan avatar Jun 12 '24 02:06 cesaryuan

@kics223w1 can you share the progress? I guess we should try to reproduce this issue again on the latest build. Maybe it's already fixed

NghiaTranUIT avatar Jun 12 '24 02:06 NghiaTranUIT

I think so, I'll reproduce this issue on version 2.15.0 and if it's not fixed, I'll fix this ๐Ÿ‘๐Ÿป

kics223w1 avatar Jun 12 '24 02:06 kics223w1

Hi @cesaryuan , this issue is fixed on version 2.15.0

kics223w1 avatar Jun 12 '24 11:06 kics223w1

this issue is fixed on version 2.15.0

Hello, I tried it on my own computer and found that there is still a problem

cesaryuan avatar Jun 15 '24 10:06 cesaryuan

@cesaryuan Can you walk me through how you reproduce this? I used the reproduced steps in the pull request and I can see the hostname perfectly

kics223w1 avatar Jun 21 '24 02:06 kics223w1