Posts under General Category
General In RDMA there are two options for establishing a connection between two sides: Changing the QP state explicitly in the application by calling ibv_modify_qp() Using librdmacm (in iWARP this is the only way to do it) In this post,...
The Linux kernel networking stack is dynamic and growing steadily in afast-paced progress; during the last years, there were a lot ofchanges and updates. Many features were added and a lot of developmentwas done. However, for almost a decade, there...
What is Fence? In the Send Queue there are operations that only send data from a local host to a remote one and there are operations that read data from a remote host and store it locally. Sometimes, there is...
Since in RDMA any UD QP can send/receive a packet to/from any other UD QP in the subnet, there is a need for a protection mechanism to allow a UD QP to specify from which other UD QPs it wishes...
The InfiniBand spec defines several features and verbs that the verbs implementation (i.e. RDMA stack in the Linux kernel and libibverbs) didn't implement or implemented in a different way. In this post I will cover missing verbs and functionality that...
Hi all. There is an OpenSHMEM conference on March 4-6, 2014 at Annapolis, Maryland. Conference URL: http://www.csm.ornl.gov/workshops/openshmem2013/index.html At this conference, I'll lecture about Verbs programming on March 4th, at 13:00. (yes, I know that I should have sent a better...
RDMA supports zero byte messages, and this can be done by posting a Send Request without a scatter/gather list (i.e. a list with zero entries). Zero byte messages can be done with the following opcodes: Send Send with immediate RDMA...
Let's start with the bottom line: the verbs API is fully thread safe and verbs can be called from every thread in the process. Part of the thread safe is implemented at the libibverbs level and part of it is...
When one wishes to stop the outstanding Work Requests from being processed, flushing the Work Queues may be useful. The most common reason for doing this is to reclaim the memory buffers that the Work Requests refer to. Another reason...
There are many code samples on the internet that explain how to send messages using the SEND operation over Reliable Connected (RC) QP. In this post I will explain how to convert the code from this kind of example to...
Recent Comments