Inter pod communication using shared memory

Murali Bathina

28 Aug 2024 28 Aug '24

9:15 a.m.

Hi all, Is Boost supports inter pod communication using shared memory or other ways like boost interprocess communication. Looking inputs on this. Regards, Murali ________________________________ This e-mail message may contain confidential or proprietary information of Mavenir Systems, Inc. or its affiliates and is intended solely for the use of the intended recipient(s). If you are not the intended recipient of this message, you are hereby notified that any review, use or distribution of this information is absolutely prohibited and we request that you delete all copies in your control and contact us by e-mailing to security@mavenir.com. This message contains the views of its author and may not necessarily reflect the views of Mavenir Systems, Inc. or its affiliates, who employ systems to monitor email messages, but make no representation that such messages are authorized, secure, uncompromised, or free from computer viruses, malware, or other defects. Thank You

Show replies by date

Ion Gaztañaga

28 Aug 28 Aug

11:11 a.m.

El 28/08/2024 a las 11:15, Murali Bathina via Boost escribió:

...

Hi all,

Is Boost supports inter pod communication using shared memory or other ways like boost interprocess communication. Looking inputs on this.

Regards, Murali

I don't fully understand your question. Are you are talking about Kubernetes pods? In this case any network communication stack will work and Boost has tools for that (Asio, Beast, etc.) Best, Ion

Murali Bathina

11:54 a.m.

New subject: [E] Re: Inter pod communication using shared memory

Yes Ion, like boost inter process, is it possible to use boost library for using shared memory between Kubernetes pods? Regards, Murali -----Original Message----- From: Boost On Behalf Of Ion Gaztañaga via Boost Sent: Wednesday, August 28, 2024 4:42 PM To: Murali Bathina via Boost Cc: Ion Gaztañaga Subject: [E] Re: [boost] Inter pod communication using shared memory [EXTERNAL EMAIL] DO NOT CLICK links or attachments unless you recognize the sender and know the content is safe. El 28/08/2024 a las 11:15, Murali Bathina via Boost escribió:

...

Hi all,

Is Boost supports inter pod communication using shared memory or other ways like boost interprocess communication. Looking inputs on this.

Regards, Murali

I don't fully understand your question. Are you are talking about Kubernetes pods? In this case any network communication stack will work and Boost has tools for that (Asio, Beast, etc.) Best, Ion _______________________________________________ Unsubscribe & other changes: http://lists.boost.org/mailman/listinfo.cgi/boost ________________________________ This e-mail message may contain confidential or proprietary information of Mavenir Systems, Inc. or its affiliates and is intended solely for the use of the intended recipient(s). If you are not the intended recipient of this message, you are hereby notified that any review, use or distribution of this information is absolutely prohibited and we request that you delete all copies in your control and contact us by e-mailing to security@mavenir.com. This message contains the views of its author and may not necessarily reflect the views of Mavenir Systems, Inc. or its affiliates, who employ systems to monitor email messages, but make no representation that such messages are authorized, secure, uncompromised, or free from computer viruses, malware, or other defects. Thank You

Ion Gaztañaga

12:20 p.m.

New subject: [E] Re: Inter pod communication using shared memory

El 28/08/2024 a las 13:54, Murali Bathina escribió:

...

Yes Ion, like boost inter process, is it possible to use boost library for using shared memory between Kubernetes pods?

No, I'm not aware of any library that can do that. I don't know if that is even possible, as you need to share memory and guarantee atomic operations on memory between pods that can be in different nodes (which implies network traffic). Best, Ion

Murali Kishore

29 Aug 29 Aug

10:40 a.m.

New subject: [E] Re: Inter pod communication using shared memory

Hi all, Adding to above question, scenario details: if kubernetes pods are created in the same machine with enabling shared memory so that both pods can access this shared area. In this case, if we run one process in pod 1 and another process in pod2, and these processes are using boost interprocess to create/find class objects, STL containers. I am able to create the above scenario and run 2 pods and verified class object sharing using boost interprocess library, want to check with you all if there are any risks in using this way w.r.t performance and stability (unexpected behaviour). Are there any limitations/ design aspects that need to be taken care while using boost library ? Regards, Murali Kishore On Thu, Aug 29, 2024 at 3:55 PM Murali Bathina via Boost < boost@lists.boost.org> wrote:

...

Yes Ion, like boost inter process, is it possible to use boost library for using shared memory between Kubernetes pods?

Regards, Murali

-----Original Message----- From: Boost On Behalf Of Ion Gaztañaga via Boost Sent: Wednesday, August 28, 2024 4:42 PM To: Murali Bathina via Boost Cc: Ion Gaztañaga Subject: [E] Re: [boost] Inter pod communication using shared memory

[EXTERNAL EMAIL] DO NOT CLICK links or attachments unless you recognize the sender and know the content is safe.

El 28/08/2024 a las 11:15, Murali Bathina via Boost escribió:

...
Hi all,

Is Boost supports inter pod communication using shared memory or other ways like boost interprocess communication. Looking inputs on this.

Regards, Murali

I don't fully understand your question. Are you are talking about Kubernetes pods? In this case any network communication stack will work and Boost has tools for that (Asio, Beast, etc.)

Best,

Ion

_______________________________________________ Unsubscribe & other changes: http://lists.boost.org/mailman/listinfo.cgi/boost ________________________________ This e-mail message may contain confidential or proprietary information of Mavenir Systems, Inc. or its affiliates and is intended solely for the use of the intended recipient(s). If you are not the intended recipient of this message, you are hereby notified that any review, use or distribution of this information is absolutely prohibited and we request that you delete all copies in your control and contact us by e-mailing to security@mavenir.com. This message contains the views of its author and may not necessarily reflect the views of Mavenir Systems, Inc. or its affiliates, who employ systems to monitor email messages, but make no representation that such messages are authorized, secure, uncompromised, or free from computer viruses, malware, or other defects. Thank You

_______________________________________________ Unsubscribe & other changes: http://lists.boost.org/mailman/listinfo.cgi/boost

-- Regards, Murali Kishore

Ion Gaztañaga

12:26 p.m.

New subject: [E] Re: Inter pod communication using shared memory

El 29/08/2024 a las 12:40, Murali Kishore escribió:

...

Hi all, Adding to above question,

scenario details: if kubernetes pods are created in the same machine with enabling shared memory so that both pods can access this shared area. In this case, if we run one process in pod 1 and another process in pod2, and these processes are using boost interprocess to create/find class objects, STL containers.

I am able to create the above scenario and run 2 pods and verified class object sharing using boost interprocess library, want to check with you all if there are any risks in using this way w.r.t performance and stability (unexpected behaviour).

Are there any limitations/ design aspects that need to be taken care while using boost library ?

Regards, Murali Kishore

Hi, Glad to hear Boost.Interprocess is being used in innovative ways. If usual shared memory (/dev/shm) between Linux containers is used, then I don't expect any problem and/or performance issue because there is no kubernetes/docker software layer between Boost.Interprocess accesses to mapped memory. Usual linux kernel is managing those accesses. In any case, I've never tried using Boost.Interprocess between linux containers so I can't 100% guarantee everything will work fine. We'll try to help if something unexpected happens ;-) Best, Ion

René Eng

30 Aug 30 Aug

8:13 a.m.

New subject: [E] Re: Inter pod communication using shared memory

Hi all You should not store STL containers in shared memory. Shared memory pages may be mapped to different addresses in different processes. If the STL container uses pointers to nodes (like list, map etc. do), these pointers are only valid for processes that mapped the shared memory to the address. And it is not possible to always map the shared memory to the same address. You should use the containers from Boost.Interprocess, because they store address offsets instead of pointers == addresses. Best regards René Am Fr., 30. Aug. 2024 um 02:56 Uhr schrieb Murali Kishore via Boost < boost@lists.boost.org>:

...

Hi all, Adding to above question,

scenario details: if kubernetes pods are created in the same machine with enabling shared memory so that both pods can access this shared area. In this case, if we run one process in pod 1 and another process in pod2, and these processes are using boost interprocess to create/find class objects, STL containers.

I am able to create the above scenario and run 2 pods and verified class object sharing using boost interprocess library, want to check with you all if there are any risks in using this way w.r.t performance and stability (unexpected behaviour).

Are there any limitations/ design aspects that need to be taken care while using boost library ?

Regards, Murali Kishore

On Thu, Aug 29, 2024 at 3:55 PM Murali Bathina via Boost < boost@lists.boost.org> wrote:

...
Yes Ion, like boost inter process, is it possible to use boost library for using shared memory between Kubernetes pods?

Regards, Murali

-----Original Message----- From: Boost On Behalf Of Ion Gaztañaga via Boost Sent: Wednesday, August 28, 2024 4:42 PM To: Murali Bathina via Boost Cc: Ion Gaztañaga Subject: [E] Re: [boost] Inter pod communication using shared memory

[EXTERNAL EMAIL] DO NOT CLICK links or attachments unless you recognize the sender and know the content is safe.

El 28/08/2024 a las 11:15, Murali Bathina via Boost escribió:

...
Hi all,

Is Boost supports inter pod communication using shared memory or other ways like boost interprocess communication. Looking inputs on this.

Regards, Murali

I don't fully understand your question. Are you are talking about Kubernetes pods? In this case any network communication stack will work and Boost has tools for that (Asio, Beast, etc.)

Best,

Ion

_______________________________________________ Unsubscribe & other changes: http://lists.boost.org/mailman/listinfo.cgi/boost ________________________________ This e-mail message may contain confidential or proprietary information of Mavenir Systems, Inc. or its affiliates and is intended solely for the use of the intended recipient(s). If you are not the intended recipient of this message, you are hereby notified that any review, use or distribution of this information is absolutely prohibited and we request that you delete all copies in your control and contact us by e-mailing to security@mavenir.com. This message contains the views of its author and may not necessarily reflect the views of Mavenir Systems, Inc. or its affiliates, who employ systems to monitor email messages, but make no representation that such messages are authorized, secure, uncompromised, or free from computer viruses, malware, or other defects. Thank You

_______________________________________________ Unsubscribe & other changes: http://lists.boost.org/mailman/listinfo.cgi/boost

-- Regards, Murali Kishore

_______________________________________________ Unsubscribe & other changes: http://lists.boost.org/mailman/listinfo.cgi/boost

-- “Dubito ergo cogito; cogito ergo sum. (I doubt, therefore I think; I think therefore I am)” René Descartes

Age (days ago)

Last active (days ago)

List overview

Download

6 comments

4 participants

participants (4)

Ion Gaztañaga
Murali Bathina
Murali Kishore
René Eng