- Boost - lists.preview.boost.org

Implemented support for recvmmsg / sendmmsg (on supported operating systems: Linux / *BSD / AIX / QNX)
by Virgilio Fornazin 17 Jan '23

17 Jan '23

As stated on asio-users mailing list ( https://sourceforge.net/p/asio/mailman/asio-users/thread/CADfydx%2BDF1kvqch… ), I wrote a patch that enables sendmmsg / recvmmsg on supported operating systems (Linux, [Free/Net/Open]BDS, AIX, Blackberry QNXNeutrino). The syscalls are implemented in reactive_socket_service backend (the io_uring backend on Linux does not support sendmmsg / recvmmsg yet, so no recvmmsg / sendmmsg when using newest support for io_uring on asio). The config.hpp has macros for forcible disable those calls, and detect supported operating system compiler macros. New methods were developed for (send/send_to/receive/receive_from) suffixed with '_multiple_buffer_sequence' that accepts a multiple_buffer_sequence class (backed by asio::detail::array<multiple_buffer_sequence_op, N> or std::vector<multiple_buffer_sequence_op>) and a multiple_buffer_sequence_adapter that convert ops to struct mmsghdr* for sendmmsg/recvmmsg. The multiple_buffer_sequence implementations are basically a collection of multiple_buffer_sequence_op instances that represents each socket operation . It defines the objects needed to perform fill on mmsghdr structures buffer_sequence_type buffer_sequence_; buffer_sequence_adapter_type buffer_sequence_adapter_; endpoint_type endpoint_; bool completed_; socket_base::message_flags flags_; std::size_t bytes_transferred_; asio::error_code error_code_; The multiple_buffer_sequence implementations has full container support, iterators, and support Mutable and Const buffer sequences. I finished the first version of the patch. It's able to send and receive 1million packet / second on my box at same time (an intel i9 9900k / ubuntu 22.04 lts low latency kernel) using packet sizes of 64 / 1430 bytes without packet loss (using 64mb udp socket buffers) A little running demo is able to being watched at https://www.youtube.com/watch?v=Q3hqe6ntM3w. I need to write some automatic tests for (async_)[send/receive]_multiple_buffer_sequence calls[_to/_from] and push a pure ASIO example in examples repository I made the code available for review, scrutiny and suggestions. The source code is in my github repo ( https://github.com/virgiliofornazin/asio ),on branch feature/multiple_datagram_buffers_sequence-io-sendmmsg-recvmmsg ( the full URL of patch diff is https://github.com/chriskohlhoff/asio/compare/master...virgiliofornazin:asi… ).

2 7

Regression Results Not Updating
by Tom Kent 15 Jan '23

15 Jan '23

The results from the pages at: https://www.boost.org/development/tests/develop/developer/summary.html https://www.boost.org/development/tests/master/developer/summary.html Have not updated in almost a month. Can someone check on the process that manages this? Thanks, Tom

4 10

delayed_forward: good, bad, ugly?
by Hans Dembinski 12 Jan '23

12 Jan '23

Dear all, a user noticed that some classes in Boost.Histogram do not provide a strong exception guarantee, although with a few changes they could. I never promised that guarantee for those classes, but I am inclined to support it. To that end, I am considering use a type called delayed_forward to the public interface of that class. I would like to get a mini-review on the concept. The change is backward-compatible and it offers some advantages, so it seems like a good solution to me, but maybe I am missing some caveats. The constructor of my class, let’s call it Foo, accepts some potentially non-trivial parameters by value, because I didn’t want to write an interface with a templated forward reference. Passing non-trivial parameters by value is cheap if the compiler can do RVO or if the user calls the move constructor via std::move. Not using a forward reference saves a few template instantiations and thus reduces compile time. I think I got that from Herb Sutter in a GotW entry, but I cannot find it right now. With delayed_forward one can efficiently pass values to Foo with a single ctor. The trade-off is a tiny runtime cost, but that’s ok if we know that Foos are not created en mass in a hot loop. That already guided my choice of passing by value. A minimal demo is here: https://godbolt.org/z/z71E1jno1 The design of delayed_forward is so simple that it probably already exists somewhere, likely under another name. Maybe even in Boost. What do you think? Hans

5 13

Upcoming aedis review
by Klemens Morgenstern 10 Jan '23

10 Jan '23

The aedis review will start in less than a week, on the 15th and last until the 24th of this month. Aedis is a Redis client library built on top of Boost.Asio that implements the latest version of the Redis communication protocol RESP3. Some of its distinctive features are * A connection class that provides high-level functions to execute Redis commands and receive server pushes concurrently. * Automatic pipelining of commands. * Support for STL containers and serialization of user-defined data types. * Low-latency: Responses can be read in their final data-structure without creating copies. Aedis links Github: https://github.com/mzimbres/aedis Documentation: https://mzimbres.github.io/aedis/ Git tag: v1.4.1 Tarball: https://github.com/mzimbres/aedis/archive/refs/tags/v1.4.1.tar.gz Redis Links: Redis: https://redis.io/ RESP3: https://github.com/redis/redis-specifications/blob/master/protocol/RESP3.md Pipelines: https://redis.io/docs/manual/pipelining/ Redis commands: https://redis.io/commands/ Running Redis: Redis can be also easily installed on your local machine, for example, on Debian run "apt install redis". You might also want to use docker https://www.docker.com/blog/how-to-use-the-redis-docker-official-image/ Please consider writing a review next week.

1 0

CMake documentation (mostly) available
by Peter Dimov 07 Jan '23

07 Jan '23

I've written a document that explains how to use CMake to build or consume Boost, at https://github.com/boostorg/cmake/blob/develop/README.md This targets users of Boost. Developer-centric documentation is also available at https://github.com/boostorg/cmake/blob/develop/developer.md This is still unfinished, but I decided to "publish" it because the portions that are present are still (hopefully) valuable.

1 0

Fwd: CircleCI Security Alert - 4 Jan 2023 - Rotate any secrets stored in CircleCI
by Marshall Clow 05 Jan '23

05 Jan '23

I received this today….. — Marshall > Begin forwarded message: > > From: CircleCI <security(a)circleci.com> > Subject: CircleCI Security Alert - 4 Jan 2023 - Rotate any secrets stored in CircleCI > Date: January 4, 2023 at 6:30:49 PM PST > To: marshall(a)idio.com > Reply-To: security(a)circleci.com > > <https://go.circleci.com/NDg1LVpNSC02MjYAAAGJHrz8WLiocAliTEINy0V4BGCeC4xesDl…> > We wanted to make you aware that we are currently investigating a security incident, and that our investigation is ongoing. We will provide you updates about this incident, and our response, as they become available. At this point, we are confident that there are no unauthorized actors active in our systems; however, out of an abundance of caution, we want to ensure that all customers take certain preventative measures to protect your data as well. > > Action request: > > Out of an abundance of caution, we strongly recommend that all customers take the following actions: > Immediately rotate any and all secrets stored in CircleCI. These may be stored in project environment variables or in contexts. > We also recommend customers review internal logs for their systems for any unauthorized access starting from December 21, 2022 through today, January 4, 2023, or upon completion of your secrets rotation. > Additionally, if your project uses Project API tokens, we have invalidated those and you will need to replace them. You can find more information on how to do that in our documentation here. <https://go.circleci.com/NDg1LVpNSC02MjYAAAGJHrz8WBmOiXzPovREibkXKh8Iqcsacum…> > > We apologize for any disruption to your work. We take the security of our systems and our customers’ systems extremely seriously. While we are actively investigating this incident, we are committed to sharing more details with customers in the coming days. > > Thank you for your urgent attention to rotating your secrets.

1 0

Aedis scheduled for review
by Mateusz Loskot 04 Jan '23

04 Jan '23

Folks, I'd like to thank Klemens Morgenstern for stepping forward and volunteering as a review manager of the Aedis library. The Aedis review will take place between the dates of January 15, 2023 - January 24, 2023 https://www.boost.org/community/review_schedule.html Please, polish your guns and look forward to receiving the start of the review announcement from Klemens. Best regards, -- Mateusz Loskot on behalf of Boost Review Wizards

4 8

Mustache scheduled for review
by Mateusz Loskot 04 Jan '23

04 Jan '23

Folks, I'd like to thank Klemens Morgenstern for volunteering as a review manager of the Mustache library, and Peter Dimov for submitting the library. The Mustache review will take place between the dates of February 5, 2023 - February 14, 2023 https://www.boost.org/community/review_schedule.html As usual, the review manager will announce the beginning of the review with details. Best regards, -- Mateusz Loskot on behalf of Boost Review Wizards

1 0

Updating Review Schedule
by Mateusz Loskot 03 Jan '23

03 Jan '23

Happy New Year Everyone! On behalf of the Review Wizards Team, I'm updating the review schedule. It looks like we will be enjoying two reviews this month yet: - Aedis by Marcelo Zimbres Silva (start planned for Jan, 15) - Mustache by Peter Dimov (start planned not too long after aedis review) Before I issue official announcements, if there are any objections to this plan, then please express them now. Best regards, Mateusz Loskot

2 2

New Boost library proposal, Mustache
by Peter Dimov 30 Dec '22

30 Dec '22

I'm looking for endorsements and a review manager volunteer for a new library, Boost.Mustache. It's an implementation of Mustache templates (http://mustache.github.io/) in C++11 and at the moment supports the mandatory portions of the Mustache spec (https://github.com/mustache/spec) The repository is https://github.com/pdimov/mustache. Mustache is a simple templating language in which tags of the form {{something}} are replaced with the value of the entity `something`, which typically means with the member "something" of the JSON object passed when rendering the template. Boost.Mustache can take a Boost.JSON object as the context against which data references are resolved, but it can also take arbitrary values that can be converted to boost::json::value by using boost::json::value_from. This allows, for instance, described classes (structs and classes annotated with Boost.Describe) to be passed as the data context, such that references to e.g. {{title}} in the template are resolved to the corresponding `title` member of the class. A simple usage example demonstrating the above is: ``` #include <boost/mustache.hpp> #include <boost/describe.hpp> #include <iostream> struct item { std::string title; std::string author; std::string link; }; BOOST_DESCRIBE_STRUCT(item, (), (title, author, link)) struct reference { std::string heading; std::vector<item> items; }; BOOST_DESCRIBE_STRUCT(reference, (), (heading, items)) int main() { reference ref = { "Reference", { { "Better Bit Mixing - Improving on MurmurHash3's 64-bit Finalizer", "David Stafford", "https://zimbry.blogspot.com/2011/09/better-bit-mixing-improving-on.html" }, { "Stronger, better, morer, Moremur; a better Murmur3-type mixer", "Pelle Evensen", "https://mostlymangling.blogspot.com/2019/12/stronger-better-morer-moremur-b…" }, { "Improved mx3 and the RRC test", "Jon Maiga", "http://jonkagstrom.com/mx3/mx3_rev2.html" } } }; std::string tmpl = R"(<html> <body> <h1>{{heading}}</h1> <ul> {{#items}} <li> {{title}} {{author}} <a href="{{link}}">{{link}}</a> {{/items}} </ul> </body> </html>)"; boost::mustache::render( tmpl, std::cout, ref, {} ); } ``` The resulting output is <html> <body> <h1>Reference</h1> <ul> <li> Better Bit Mixing - Improving on MurmurHash3's 64-bit Finalizer David Stafford <a href="https://zimbry.blogspot.com/2011/09/better-bit-mixing-improving-on.html">https://zimbry.blogspot.com/2011/09/better-bit-mixing-improving-on.html</a> <li> Stronger, better, morer, Moremur; a better Murmur3-type mixer Pelle Evensen <a href="https://mostlymangling.blogspot.com/2019/12/stronger-better-morer-moremur-b…">https://mostlymangling.blogspot.com/2019/12/stronger-better-morer-moremur-b…</a> <li> Improved mx3 and the RRC test Jon Maiga <a href="http://jonkagstrom.com/mx3/mx3_rev2.html">http://jonkagstrom.com/mx3/mx3_rev2.html</a> </ul> </body> </html>

5 5

Tribute to John Kalb
by Robert Ramey 27 Dec '22

27 Dec '22

It's the end of 2022. I wanted to take a moment to recognize the contributions to Boost over the last dozen years or so by Jon Kalb. I first met Jon at a Microsoft Meeting named "Going Native" which was promoting a "resurgence" of C++ over Languages like Java and C#. It seems that this was related to the C++ committee incorporating large parts of Boost into the standard library and Microsofts renewed commitment to C++. This is my take, I'm sure someone else could provide more details on this. My view that was that there wasn't much more for Boost to do. Dave Abrahams was moving on to bigger things which reinforced this impression. Jon was enthusiastic about taking the lead on Boost. It was clear that he and I had a different visions. I sort of cringed - it looked to me like he got suckered. He asked me if I planned to attend C++Now - I weaseled out of actually answering. Of course he turned out to be right and I was wrong. The C++ committee hasn't really been able to replace Boost. It's too slow and cumbersome. Working as a design committee isolated from actual implementation doesn't seem to conducive to designing good, clean, elegant software. And it takes forever. It's odd to me that the committee adopted a large part of Boost software, but failed to learn anything from Boost about how to make this kind of stuff. So in this environment Jon led Boost. He worked from top to bottom on all the stuff that needs to be done - finances, legal, C++Now planning, recruitment of collaborators, etcetra . Very successful and, like many successful people, made it look easy. Hence he has not been appreciated to the extent he should be. Now he as moved on from Boost - he will be missed. Apparently this was in the works for some time but was pushed along by complaint about his handling about an alleged code of conduct violation which in my view was blown way out of proportion. I think the Boost BOD has treated Jon shabbily regarding this incident. My aim here is to correct that. Boost has had a large role in saving C++ from decline into obscurity. David Abrahams and Beman Dawes were the primary promoters at Boost at it's start. I don't think it's too much to say that these two persons saved C++. To this list, I'd like to add the name of Jon Kalb, without whom Boost would likely have wound down with C++11. -- Robert Ramey www.rrsd.com (805)569-3793

4 3

Why do Predef and Config exist?
by Hans Dembinski 27 Dec '22

27 Dec '22

Hi all, since there were concerns that the email list is so quiet, here is some noise. Is someone willing to explain to me why we have Predef and Config? It looks like these two libraries have a strong overlap in scope. Shouldn’t they be merged? Best regards, Hans

10 15

Proposing a Redis client library for inclusion in Boost
by Marcelo Zimbres Silva 22 Dec '22

22 Dec '22

Hi, I would like to propose my Redis client library for inclusion in Boost Github: https://github.com/mzimbres/aedis Homepage: https://mzimbres.github.io/aedis Redis: https://redis.io Aedis implements asynchronous communication with a Redis server using the RESP3 protocol [1] and is built on top of Boost.Asio, which makes it similar to Boost.Beast and Boost.MySql. For more information, please, refer to the project homepage. I am looking for someone who would like to endorse the library and also for a review manager. Thanks, Marcelo [1] https://github.com/redis/redis-specifications/blob/master/protocol/RESP3.md

5 5

[Test] How to make test framework create Core dump in case of any unhandled exceptions?
by Sergey P 21 Dec '22

21 Dec '22

Dear developers, Is it possible to force Boost.Test framework to create Core dump in case of catching any kind of unhandled exception from code that is being tested? We tried to use parameter: *--catch_system_error=no* but it creates core dump for system signals only, while we need core dump for any exceptions, even custom ones. We would appreciate any suggestions or hints. Thank you very much! Best regards, Sergey Podolyan

1 0

[release] Boost 1.81.0
by Marshall Clow 17 Dec '22

17 Dec '22

Release 1.81.0 of the Boost C++ Libraries is now available. These open-source libraries work well with the C++ Standard Library, and are usable across a broad spectrum of applications. The Boost license encourages both commercial and non-commercial use. This release contains one new library and numerous enhancements and bug fixes for existing libraries. * URL: A library for parsing, modifying, and printing URLs using only C++11, from Vinnie Falco and Alan de Freitas. For details, including download links, see <http://www.boost.org/users/news/version_1.81.0> You can also download directly from: <https://boostorg.jfrog.io/artifactory/main/release/1.81.0/> To install this release on your system, see <http://www.boost.org/doc/libs/release/more/getting_started/index.html> Thanks to everyone who participated in this release. -- The Boost Release Team Marshall Clow, Glen Fernandes, Michael Caisse

3 2

Master is open for merges
by Glen Fernandes 15 Dec '22

15 Dec '22

Master is open again, with no restrictions. Boost version numbers bumped (boost, config, more), and new release notes stubbed (website). Glen

1 0

[release] Boost 1.81.0 Release Candidate 1 is available
by Marshall Clow 14 Dec '22

14 Dec '22

The first release candidates for the 1.81.0 release are now available at: <https://boostorg.jfrog.io/artifactory/main/release/1.81.0/source/> The SHA256 checksums are as follows: 205666dea9f6a7cfed87c7a6dfbeb52a2c1b9de55712c9c1a87735d7181452b6 boost_1_81_0_rc1.tar.gz 6e689b266b27d4db57f648b1e5c905c8acd6716b46716a12f6fc73fc80af842e boost_1_81_0_rc1.zip d7bc4e2a2aee374a8c24832cacfed1265680c1e824d09fab3e00f87508155353 boost_1_81_0_rc1.7z 71feeed900fbccca04a3b4f2f84a7c217186f28a940ed8b7ed4725986baf99fa boost_1_81_0_rc1.tar.bz2 As always, the release managers would appreciate it if you download the candidate of your choice and give building it a try. Please report both success and failure, and anything else that is noteworthy. -- The Release managers

10 15

Revitalization
by David Sankel 09 Dec '22

09 Dec '22

Hi all, At C++Now this year I gave a talk on the status of Boost and presented this graph which illustrated the trend of Boost mailing list participation. https://docs.google.com/presentation/d/1ocX8Dh4B98gxfXJTWOriaEU1tmJN61M4Rfj… I'm interested to hear your opinions as to what happened over that time period to cause such a trend. There's truth to the claim that this question is being asked of the wrong people; those who left, stopped participating, or would otherwise start probably have good insight. Nevertheless, I think it would be interesting for us to brainstorm on this. Thanks in advance for your thoughts. -- David

26 62

[ASIO] boos::asio::basic_streambuf does not accept user defined size during construction. Still defaults to 128
by Aniket Pugaonkar 09 Dec '22

09 Dec '22

Hello, I was checking the implementation of boost streambuf and noticed that buffer_delta value is defaulted to 128, which results in the capacity of the container to 128 bytes by default, and based on that, there is no way to change it even if we provide max size as some custom number (say 9000 for receiving an encapsulated packet on socket). The initial allocation (buffer_.resize is done with 128. But when we call *buf.prepare(9000)*, it again results in resize(n) operation (through reserve(n) function call. Is there any other way to change this other than modifying the constructor in our codebase to provide a user defined value of buffer_delta Not sure if this needs to be enhanced. the maximum_size argument seems to be of no use in this case. Kindly advise for the same. For time being, I modified the library code to the following to ensure it does not break the default argument, but accepts user defined value. Alternatively, I can change buffer delta to be of larger value, but don't want to end up with a large buffer for no reason. if (max_size_ == std::numeric_limits<std::size_t>::max()) pend = (std::min<std::size_t>)(max_size_, buffer_delta); else pend = std::max<std::size_t>(max_size_, buffer_delta); Regards Aniket. -------------------- original code ---------------- enum { buffer_delta = 128 }; /// Construct a basic_streambuf object. /** * Constructs a streambuf with the specified maximum size. The initial size * of the streambuf's input sequence is 0. */ explicit basic_streambuf( std::size_t maximum_size = (std::numeric_limits<std::size_t>::max)(), const Allocator& allocator = Allocator()) : max_size_(maximum_size), buffer_(allocator) { *std::size_t pend = (std::min<std::size_t>)(max_size_, buffer_delta);* *buffer_.resize((std::max<std::size_t>)(pend, 1));* setg(&buffer_[0], &buffer_[0], &buffer_[0]); setp(&buffer_[0], &buffer_[0] + pend); }

1 0

Biuld boost with MSVC
by Mauro Ziliani 09 Dec '22

09 Dec '22

Hi all. My name's Mauro. I need to build boost 1.80.0 against v141_xp MSVC toolset. Which is the correct syntax for bootstrap ot b2? Best regards, MZ -- https://www.linkedin.com/in/mauroziliani

1 0

[release] Master Branch is closed for all changes
by Marshall Clow 08 Dec '22

08 Dec '22

The master branch is closed for all changes. Release expected on 14-Dec-2022 - Release Managers

1 0

missing patch
by Gero Peterhoff 07 Dec '22

07 Dec '22

Hi Matt, i'm missing patch #871/#872 (https://github.com/boostorg/math/issues/871) in 1.81rc2. thx Gero

2 3

Master branch is now open for bug fixes
by Marshall Clow 07 Dec '22

07 Dec '22

The master branch is now open for bug fixes and documentation changes. Other changes by release manager permission, as described in https://github.com/boostorg/wiki/wiki/Releases%3A-Beta-Merge-Policy The next deadline: On December 7th, master closes for all changes. As always, the calendar is at https://www.boost.org/development/ <https://www.boost.org/development/> — Marshall

12 27

Boost.Text is looking for a (mini-)review manager
by Zach Laine 07 Dec '22

07 Dec '22

I've made all the recommended changes to Boost.Text that came up in the review. Glen, the previous review manager, recommended a mini review of Boost.Text once I'd made those changes. If you'd like to manage the mini-review, please let me know. For everyone, including potential reviewers and review managers, here are the major changes: * All the specific review feedback issues have been addressed. * The string layer is now gone. * The text layer got a major re-work. It is now a set of template-based adaptors (basic_text<>, vs. a text typedef. etc.), which lets everyone get what they want. You can change the underlying storage type (including whatever allocator you prefer), select UTF-8 or UTF-16, and change the normalization form. Glen recommended I drop this layer, but the library is way less useful without this stuff, and these changes address all the concerns raised about the text layer in the review. The updated docs can be found here: https://tzlaine.github.io/text/doc/html/index.html Oh yeah, and I added concept constraints to the whole library when you build in C++20 mode. Zach

17 46

Re: [boost] Revitalization
by William Linkmeyer 07 Dec '22

07 Dec '22

For bringing up new talent, I agree with Niall. For Boost’s usage, I maintain that new libraries in the hardware space are useful — audio, visual, libraries. No great ones exist. For C++ as a whole, I’m not sure I would recommend this language to newcomers until we break ABI and more of the cppfront syntax & safety is introduced. Our hashing and regex performance is embarrassing. Our syntax is cluttered. We can and should solve those problems. WL > On Dec 6, 2022, at 6:44 PM, Gavin Lambert via Boost <boost(a)lists.boost.org> wrote: > > On 7/12/2022 10:42, Robert Ramey wrote: >> c) use the boost tool (I forget the name) to scan my code and list the required source modules >> d) include those source files in my b2 or CMake file. > > These steps are atypical. Most users will run b2 to build binaries (static or dynamic) and then link with these, or will use the prebuilt bintray or whatever binaries, or the prebuilt Linux distro binaries. > > While it's possible to import individual .cpp files, that's never the encouraged method to depend on any C++ libraries, Boost or otherwise. > > > _______________________________________________ > Unsubscribe & other changes: http://lists.boost.org/mailman/listinfo.cgi/boost

1 0