NFS over RMDA

[poma]

On 26.11.2014 11:34, Ian Chapman wrote:
> On 25/11/14 20:40, poma wrote:
> 
>>> Is svcrdma intentionally not built in the current kernels or has it been
>>> replaced by something else?
>>>
> 
>> $ find -name config* -exec grep -H CONFIG_SUNRPC_XPRT_RDMA_SERVER {} \;
>> ./kernel-3.15.0-0.rc0.git12.1.fc21.x86_64/boot/config-3.15.0-0.rc0.git12.1.fc21.x86_64:# CONFIG_SUNRPC_XPRT_RDMA_SERVER is not set
>>
> 
> OK, so it's probably not been enabled intentionally. Looks like I'll 
> have to compile up the module.
> 


$ uname -r
3.17.3-200.fc20.x86_64

$ su -c 'yum install kernel-devel'

$ yumdownloader --source kernel

$ rpm -ivh kernel-3.17.3-200.fc20.src.rpm

$ rpmbuild -bp ~/rpmbuild/SPECS/kernel.spec

$ cd ~/rpmbuild/BUILD/kernel-3.17.fc20/linux-$(uname -r)/net/sunrpc/xprtrdma/

$ cat Makefile 
obj-m += svcrdma.o

svcrdma-y := svc_rdma.o svc_rdma_transport.o \
	svc_rdma_marshal.o svc_rdma_sendto.o svc_rdma_recvfrom.o

KDIR  := /lib/modules/$(shell uname -r)/build
PWD   := $(shell pwd)

default:
	$(MAKE) -C $(KDIR) M=$(PWD) modules

$ make

$ find -name *.ko
./svcrdma.ko

$ su

# cp svcrdma.ko /lib/modules/$(uname -r)/updates/

# depmod

# modinfo svcrdma
filename:       /lib/modules/3.17.3-200.fc20.x86_64/updates/svcrdma.ko
license:        Dual BSD/GPL
description:    SVC RDMA Transport
author:         Tom Tucker <tom at opengridcomputing.com>
depends:        ib_core,sunrpc,rdma_cm
vermagic:       3.17.3-200.fc20.x86_64 SMP mod_unload 

# modprobe -v svcrdma
insmod /lib/modules/3.17.3-200.fc20.x86_64/kernel/drivers/infiniband/core/ib_addr.ko 
insmod /lib/modules/3.17.3-200.fc20.x86_64/kernel/drivers/infiniband/core/ib_core.ko 
insmod /lib/modules/3.17.3-200.fc20.x86_64/kernel/drivers/infiniband/core/ib_mad.ko 
insmod /lib/modules/3.17.3-200.fc20.x86_64/kernel/drivers/infiniband/core/ib_sa.ko 
insmod /lib/modules/3.17.3-200.fc20.x86_64/kernel/drivers/infiniband/core/ib_cm.ko 
insmod /lib/modules/3.17.3-200.fc20.x86_64/kernel/drivers/infiniband/core/iw_cm.ko 
insmod /lib/modules/3.17.3-200.fc20.x86_64/kernel/drivers/infiniband/core/rdma_cm.ko 
insmod /lib/modules/3.17.3-200.fc20.x86_64/updates/svcrdma.ko 

# dmesg -t | grep svcrdma
svcrdma: module verification failed: signature and/or  required key missing - tainting kernel

# lsmod | grep svcrdma
svcrdma                40547  0 
rdma_cm                42325  1 svcrdma
ib_core                79289  6 rdma_cm,ib_cm,ib_sa,iw_cm,svcrdma,ib_mad
sunrpc                279768  22 nfs,nfsd,rpcsec_gss_krb5,auth_rpcgss,lockd,nfsv4,svcrdma,nfs_acl


Is this method valid for you?


Ref.
https://fedoraproject.org/wiki/Building_a_custom_kernel#Building_Only_Kernel_Modules_.28Out_Of_Tree_Modules.29