websocket-benchmark

NodeJS 的 ws 综合表现最好，latency ~7ms 左右，轻松上到 5000 个 client 连接，TypeScript 的成熟同样给程序的编写提供了保障，同时也能利用弱类型语言本身的便利进行快速开发。

给定一定 clients 的数量，在不 drop 任何 client 连接的前提下：

• 单机服务器每秒能发送多少消息
• 客户端收到消息的延迟是多少 (ms)

• Host

MacBook Pro (13-inch, 2020, Four Thunderbolt 3 ports)
2 GHz Quad-Core Intel Core i5
16 GB 3733 MHz LPDDR4X
Intel Iris Plus Graphics 1536 MB

• 5000个node client连接，每个client每500ms发一次小时到服务器

Server: - CPU 100% - completed in seconds - send message to client per 50ms

clients: 0, tps: 0
clients: 1522, tps: 13406.5
clients: 2731, tps: 41965.01749125437
clients: 3618, tps: 62558.603491271824
clients: 4221, tps: 75828.58570714643
clients: 4572, tps: 80643.14115308151
clients: 4844, tps: 86410.76769690926
clients: 5000, tps: 89313.71571072319
clients: 5000, tps: 91170.90184354757
clients: 5000, tps: 72340.14598540145
clients: 5000, tps: 82267.92828685259
clients: 5000, tps: 88514.94023904382
clients: 5000, tps: 87901.93164933135
clients: 5000, tps: 88450.0998003992
clients: 5000, tps: 89606.9825436409
clients: 5000, tps: 84441.67497507477

Client (via NodeJS): - CPU: 100%

TPS: 9828.009828009828
Average latency: 9.525885550821567 ms
TPS: 9893.44672336168
Average latency: 5.686742775410783 ms
TPS: 9980.49024512256
Average latency: 3.5819713877053916 ms
TPS: 9539.269634817409
Average latency: 2.258685693852696 ms
TPS: 9990.009990009989
Average latency: 1.637942846926348 ms
TPS: 7245.835026412028
Average latency: 14.647771423463173 ms
TPS: 10005.002501250625
Average latency: 7.350285711731586 ms
TPS: 10005.002501250625
Average latency: 3.697042855865793 ms

Server: - CPU 130% - send message to client per 100ms (as 50ms it makes my computer die) - takes more than 3mins (each log is under 2 seconds interval), dropped then

clients: 0, tps: 0.0
clients: 0, tps: 0.0
clients: 0, tps: 0.0
clients: 0, tps: 0.0
clients: 0, tps: 0.0
clients: 0, tps: 0.0
clients: 0, tps: 0.0
clients: 377, tps: 874.1887169246131
clients: 993, tps: 5707.730673316708
clients: 1769, tps: 13499.750374438343
clients: 2593, tps: 21835.164835164836
clients: 3003, tps: 27957.04295704296
clients: 3008, tps: 28956.54345654346
clients: 3166, tps: 30418.6626746507
clients: 3263, tps: 31657.51372940589
clients: 3453, tps: 33087.86819770344
clients: 3543, tps: 34520.718921617576
clients: 3620, tps: 35061.0
clients: 3656, tps: 35845.30938123753
clients: 3678, tps: 36177.41129435282
clients: 3707, tps: 36575.5
clients: 3730, tps: 36724.637681159424
clients: 3749, tps: 36628.18590704648
clients: 3769, tps: 35519.96007984032
clients: 3789, tps: 37355.322338830585
clients: 3807, tps: 36828.67132867133
clients: 3823, tps: 36764.0
clients: 3840, tps: 37955.0
clients: 3859, tps: 38223.0
clients: 3878, tps: 37930.5
clients: 3889, tps: 38040.979510244884
clients: 3902, tps: 38278.582126809786
clients: 3907, tps: 38161.5
clients: 3911, tps: 38794.10294852574 // line 34
...
clients: 3951, tps: 37222.27772227772
clients: 3952, tps: 38845.23215177235
clients: 3952, tps: 37233.033932135724 //line 78

Client (via NodeJS): - CPU: 151%

TPS: 9055.944055944055
Average latency: 33895.241751952984 ms
TPS: 9043.5
Average latency: 34512.603531743174 ms
TPS: 9054.5
Average latency: 35110.37179017024 ms
TPS: 9053.5
Average latency: 35783.786292699435 ms
TPS: 9056
Average latency: 36455.58598929206 ms
TPS: 9058
Average latency: 37053.6221686743 ms
TPS: 9058
Average latency: 37630.76835023821 ms
TPS: 9059.5
Average latency: 38157.07903049557 ms

node cpu: >120%, die after 20s

clients: 200, tx/second: 3160.2962255136167
clients: 200, tx/second: 2765.8108500145054
clients: 200, tx/second: 4459.919839679359

node cpu: 100%

clients: 200, tx/second: 7340
clients: 400, tx/second: 10720
clients: 400, tx/second: 8712.28771228771
clients: 400, tx/second: 7911.08891108891

• https://colobu.com/2015/07/14/performance-comparison-of-7-websocket-frameworks/
• https://www.jianshu.com/p/1edea2f6fd4d
• https://blog.jayway.com/2015/04/13/600k-concurrent-websocket-connections-on-aws-using-node-js/
• https://nodejs.org/api/cli.html#cli_max_old_space_size_size_in_megabytes