spring-chatting-server icon indicating copy to clipboard operation
spring-chatting-server copied to clipboard

[Performance] ๐Ÿ”ด MTTFB[p99] - 31.13% ์„ฑ๋Šฅ๊ฐ์†Œ by Lettuce Connection Pool ์ฆ๊ฐ€ - `POST /api-chat/chat`

Open ghkdqhrbals opened this issue 1 year ago โ€ข 1 comments

  • Implements
    • Redis Lettuce CP ์ตœ์ ํ™”
  • ๊ธฐ์กด(max-active:8, max-idle: 8, min-idle: 0) = Original

    TPS ํ‰๊ท : 362.60 TPS p95: 438.80 TPS p99: 494.42 MTTFB ํ‰๊ท : 590.52 ms MTTFB p95: 875.44 ms MTTFB p99: 1167.77 ms MTTFB ์ฐจ์ด ํ‰๊ท  : 78.26 ms MTTFB ํ‰๊ท ์ ์ธ ๋ณ€๋™๋ฅ : 11.81%

  • ๋ณ€๊ฒฝ(max-active:100, max-idle: 50, min-idle: 10) = Change1

    TPS ํ‰๊ท : 342.94 TPS p95: 450.15 TPS p99: 502.65 MTTFB ํ‰๊ท : 599.58 ms MTTFB p95: 1131.07 ms MTTFB p99: 1531.29 ms MTTFB ์ฐจ์ด ํ‰๊ท  : 122.83 ms MTTFB ํ‰๊ท ์ ์ธ ๋ณ€๋™๋ฅ : 19.00%

  • ๋ณ€๊ฒฝ(max-active:150, max-idle: 70, min-idle: 50) = Change2

    TPS ํ‰๊ท : 338.45 TPS p95: 433.25 TPS p99: 491.85 MTTFB ํ‰๊ท : 600.22 ms MTTFB p95: 1012.68 ms MTTFB p99: 1241.76 ms MTTFB ์ฐจ์ด ํ‰๊ท  : 104.21 ms MTTFB ํ‰๊ท ์ ์ธ ๋ณ€๋™๋ฅ : 16.47%

Metric Change1 (%) Change2 (%)
TPS_Average -5.42%๐Ÿ”ด -6.66%๐Ÿ”ด
TPS_p95 2.59% ๐Ÿ”ด -1.26% ๐Ÿ”ด
TPS_p99 1.66% ๐Ÿ”ด -0.52% ๐Ÿ”ด
MTTFB_Average -1.53% ๐Ÿ”ด -1.64% ๐Ÿ”ด
MTTFB_p95 -29.20% ๐Ÿ”ด -15.68% ๐Ÿ”ด
MTTFB_p99 -31.13% ๐Ÿ”ด -6.34% ๐Ÿ”ด

image

๊ฒฐ๊ณผ๋ถ€ํ„ฐ ๋ง์”€๋“œ๋ฆฌ๋ฉด ๋‚ฎ์€ CP ๊ฐ€ ์˜คํžˆ๋ ค ์„ฑ๋Šฅ์ง€ํ‘œ๊ฐ€ ๋” ์ข‹๊ฒŒ ๋‚˜์™”์Šต๋‹ˆ๋‹ค.

์—ฌ์ „ํžˆ Redis Repository Latency ๊ฐ€ ๋‹ค๋ฅธ RDB Latency ๋ณด๋‹ค ๋†’์Šต๋‹ˆ๋‹ค ใ…œใ…œ ๐Ÿ˜‚ ๊ทธ๋ž˜๋„ ์‚ด์ง ๊ฐ์†Œํ•œ ๋ชจ์Šต์€ ํ™•์ธํ•  ์ˆ˜ ์žˆ์—ˆ์Šต๋‹ˆ๋‹ค! ํ•˜์ง€๋งŒ ์˜ค์ฐจ๋ฒ”์œ„ ๋‚ด๋ผ๊ณ  ์ƒ๊ฐํ•ฉ๋‹ˆ๋‹ค.

refreshToken ํ™•์ธํ•˜๋Š” interceptor ์ง€์—ฐ์‹œ๊ฐ„ ์ด์ „๊ณผ ์ดํ›„

image

image

Repository ์ง€์—ฐ์‹œ๊ฐ„ ์ด์ „๊ณผ ์ดํ›„

image

image

Repository ์ง€์—ฐ์‹œ๊ฐ„ max time ์ด์ „๊ณผ ์ดํ›„

image

image
  • CP ์ฆ๊ฐ€ ์ดํ›„
image

ghkdqhrbals avatar Jan 04 '24 07:01 ghkdqhrbals

์™œ ์˜คํžˆ๋ ค ๊ฐ์†Œํ•˜์ง€? :(

  • [x] ๋„คํŠธ์›Œํฌ bandwidth X โ†’ ๋„คํŠธ์›Œํฌ 1.5Mbps ๋งŒ ์จ์„œ ๋งค์šฐ ์ถฉ๋ถ„ ๐Ÿ˜Ÿ
  • [x] cpu usage X image โ†’ cpu usage ๊ทธ๋ž˜ํ”„ ํ™•์ธํ•ด๋ณด๋ฉด ๊ฑฐ์˜ ์‚ฌ์šฉ๋Ÿ‰์ด ๋งค์šฐ ๋‚ฎ์Œ
  • [x] ๋ฉ”๋ชจ๋ฆฌ fragementation ? X ์•„๋‹ˆ๋ฉด ๋ฉ”๋ชจ๋ฆฌ ์‚ฌ์šฉ๋Ÿ‰์ด ๋„ˆ๋ฌด ๋†’์€๊ฐ€? image โ†’ ์ž”์—ฌ ๋ฉ”๋ชจ๋ฆฌ๊ฐ€ 40% ์ด์ƒ ๋‚จ์•„์žˆ์Œ. ๊ทธ๋ž˜์„œ ๋‹จํŽธํ™”๋Š” ์ œ์™ธ
  • [x] Key indexing ์ด ์ œ๋Œ€๋กœ ์•ˆ๋˜์–ด์žˆ์–ด์„œ ์ฐพ๊ธฐ๊ฐ€ ํž˜๋“ ๊ฐ€? image Redis HASH search O(1) ๋กœ ๋น ๋ฅด๊ฒŒ ์ฐพ์Œโ€ฆ ๊ทธ๋Ÿฌ๋‹ˆ๊นŒ indexing ์€ ์ œ๋Œ€๋กœ ๋˜์–ด์žˆ์–ด์š”

์–ด๋–ค ๋ฌธ์ œ์ผ๊นŒ์š”?

ghkdqhrbals avatar Jan 05 '24 07:01 ghkdqhrbals