Re: [boost] ASIO TCP socket scalability for large scale connections

Thanks Richard for the detailed response, very much appreciated it. - jhh On 12/24/18, Richard Hodges via Boost wrote:

On Mon, 24 Dec 2018 at 03:36, hh h wrote:

...

That is fabulous, I have been contemplating two connection models:

(1) Keep and maintain each session connection in client lift time.

(2) Open / close the session connection frequently on demand of each data transfer.

While (1) is my preference, it'll depend on the performance, which connection model do you use?

It completely depends on the use case. The project I am currently working on accepts connections from: 1. rest clients, who tend to disconnect and reconnect often 2. websocket clients, who tend to upgrade snd stay connected. 3. a debug connection which tends to stay open idle for some time 4. a "firehose" connection, which allows us to pump data in quickly for testing purposes. This tends to connect and stay connected.

1 & 2 are internet-facing, so also have authentication, fair-scheduling and DDoS protection to worry about.

Re security etc a common model these days is to put your server behind a reverse proxy. I can't do that in my case because I need to measure and respond to network back-pressure from each client.

For performance reasons, I have template hooks to change the threading, memory allocation and object lifetime models. I default to std allocator, shared_ptr and multiple threads per io_context because this is the most easy to get wrong, but the framework I have written will support thread-per-io_context and static memory management (i.e. a maximum number of connections) without changing the code in the various io-aware objects.

...

Thanks Richard and Vinnie.

- jhh

On 12/24/18, Richard Hodges via Boost wrote:

...

I've managed 100,000 simultaneous tcp connections to a c++ server using boost::beast/asio on an appropriately configured fedora linux host.

ASIO's memory overhead is minimal if written nicely.

On Sun, 23 Dec 2018 at 01:06, Vinnie Falco via Boost wrote:

...

On Sat, Dec 22, 2018 at 3:01 PM hh h via Boost wrote:

...

What will be the maximum connections a single ASIO TCP socket server can handle?

Asio doesn't contain magic or reinvent the wheel here, `basic_socket` is a very thin abstraction over a file handle representing a socket. You need to look to the limits of your operating system and configuration to know the baseline limit. And of course subtract from that any additional per-connection resources that your application uses.

Regards

_______________________________________________ Unsubscribe & other changes: http://lists.boost.org/mailman/listinfo.cgi/boost

-- Richard Hodges hodges.r@gmail.com office: +442032898513 home: +376841522 mobile: +376380212 (this will be *expensive* outside Andorra!) skype: madmongo facebook: hodges.r

_______________________________________________ Unsubscribe & other changes: http://lists.boost.org/mailman/listinfo.cgi/boost

-- Richard Hodges hodges.r@gmail.com office: +442032898513 home: +376841522 mobile: +376380212 (this will be *expensive* outside Andorra!) skype: madmongo facebook: hodges.r

_______________________________________________ Unsubscribe & other changes: http://lists.boost.org/mailman/listinfo.cgi/boost