boost::asio memory buffers and persistent connections.

newer
[Date_Time] compile errors with...

Alejandro Martinez

25 Mar 2009 25 Mar '09

9:12 p.m.

I have a server running with asio. At any time i have 5000+ persistent connections from clients, but not all of them are sending/receiving data at all times. In fact, they only do requests once in a while. The problem is (with my current approach) that i need to have 5000+ memory buffers ready to receive that requests of very varying length. How could i make it so i can set the buffer to use at the exact moment in which data for a new request in an already open connection begins to arrive? And maybe have those buffers in some memory pool. I've been studying http://www.boost.org/doc/libs/1_38_0/doc/html/boost_asio/example/allocation/... without understanding it completely, but it doesn't look like what im looking for. Any ideas? Thanks a lot in advance. Alejandro

Show replies by date

Igor R

25 Mar 25 Mar

9:51 p.m.

New subject: boost::asio memory buffers and persistent connections.

...

How could i make it so i can set the buffer to use at the exact moment in which data for a new request in an already open connection begins to arrive?

You can make initial calls to async_read (or whatever read function you use) with buffer of 1 byte. When the handler is called, i.e. some data is available, you can perform "speculative" read (even synchronous) of all the data available - into any buffer you wish.

Matthieu Brucher

10:01 p.m.

New subject: boost::asio memory buffers and persistent connections.

Perhaps you could use streambuffers ? Matthieu 2009/3/25 Igor R :

...

...
How could i make it so i can set the buffer to use at the exact moment in which data for a new request in an already open connection begins to arrive?

You can make initial calls to async_read (or whatever read function you use) with buffer of 1 byte. When the handler is called, i.e. some data is available, you can perform "speculative" read (even synchronous) of all the data available - into any buffer you wish. _______________________________________________ Boost-users mailing list Boost-users@lists.boost.org http://lists.boost.org/mailman/listinfo.cgi/boost-users

-- Information System Engineer, Ph.D. Website: http://matthieu-brucher.developpez.com/ Blogs: http://matt.eifelle.com and http://blog.developpez.com/?blog=92 LinkedIn: http://www.linkedin.com/in/matthieubrucher

Alejandro Martinez

26 Mar 26 Mar

12:34 p.m.

New subject: boost::asio memory buffers and persistentconnections.

how? "Matthieu Brucher" escribió en el mensaje news:e76aa17f0903251501o1a59c517la77b4a4338d0c684@mail.gmail.com...

...

Perhaps you could use streambuffers ?

Matthieu

2009/3/25 Igor R :

...
...
How could i make it so i can set the buffer to use at the exact moment in which data for a new request in an already open connection begins to arrive?

You can make initial calls to async_read (or whatever read function you use) with buffer of 1 byte. When the handler is called, i.e. some data is available, you can perform "speculative" read (even synchronous) of all the data available - into any buffer you wish. _______________________________________________ Boost-users mailing list Boost-users@lists.boost.org http://lists.boost.org/mailman/listinfo.cgi/boost-users

-- Information System Engineer, Ph.D. Website: http://matthieu-brucher.developpez.com/ Blogs: http://matt.eifelle.com and http://blog.developpez.com/?blog=92 LinkedIn: http://www.linkedin.com/in/matthieubrucher

Alejandro Martinez

12:32 p.m.

New subject: boost::asio memory buffers and persistentconnections.

"Igor R" escribió en el mensaje news:cfe0a3cf0903251451xbcc4cddtfac5824c3c280ad8@mail.gmail.com...

...

...
How could i make it so i can set the buffer to use at the exact moment in which data for a new request in an already open connection begins to arrive?

You can make initial calls to async_read (or whatever read function you use) with buffer of 1 byte. When the handler is called, i.e. some data is available, you can perform "speculative" read (even synchronous) of all the data available - into any buffer you wish.

And wouldn't that affect performance in some way? I've read somewhere, that i will not be able to get just the first byte, that i would probably get some more, and so i would have to copy that extra part to the real destination buffer and then read from there on. Am i correct? Thank you for your time.

Igor R

1:29 p.m.

New subject: boost::asio memory buffers and persistentconnections.

...

And wouldn't that affect performance in some way?

I can't see how it would affect performance, but the real answer you will get from performance tests.

...

I've read somewhere, that i will not be able to get just the first byte, that i would probably get some more

boost::array buff_;// member //... socket_.async_receive(boost::asio::buffer(buff), handler); //... When the handler() is called, buff_ can't contain more that 1 byte, as its size is 1 byte. Of course, you can supply asio::streambuf as a buffer. It's built on top of std::vector, and it auto-resizes as needed during data receiving. See asio examples for details. (Eg., http://www.boost.org/doc/libs/1_38_0/doc/html/boost_asio/example/http/client...)

Juraj Ivančić

2:53 p.m.

New subject: boost::asio memory buffers and persistent connections.

Igor R wrote:

...

...
How could i make it so i can set the buffer to use at the exact moment in which data for a new request in an already open connection begins to arrive?

You can make initial calls to async_read (or whatever read function you use) with buffer of 1 byte. When the handler is called, i.e. some data is available, you can perform "speculative" read (even synchronous) of all the data available - into any buffer you wish.

There is no need for a 1 byte buffer - ASIO provides null_buffers() for this purpose. See e.g. http://www.boost.org/doc/libs/1_38_0/doc/html/boost_asio/overview/core/react... HTH, Juraj

Igor R

3:38 p.m.

New subject: boost::asio memory buffers and persistent connections.

...

There is no need for a 1 byte buffer - ASIO provides null_buffers() for this purpose. See e.g.

http://www.boost.org/doc/libs/1_38_0/doc/html/boost_asio/overview/core/react...

Ah, right, I'm not updated with these latest features :)

5813

Age (days ago)

5814

Last active (days ago)

List overview

Download

7 comments

4 participants

participants (4)

Alejandro Martinez
Igor R
Juraj Ivančić
Matthieu Brucher