Re: [Gluster-devel] [Gluster-users] Status of the SAMBA module

[haiwei.xie-soulinfo]

Hi,

Unfortunately, add the two params into smb.conf, nfs client OS will core dump 
with dd testing.
I reconfigure gluster vol, without any new params in smb.conf, performance 
looks good. Maybe 
former low performance result from error config.

address@hidden cifs]# dd if=/dev/zero of=t1 bs=64k count=100000
记录了100000+0 的读入
记录了100000+0 的写出
6553600000字节(6.6 GB)已复制，21.3123 秒，308 MB/秒


bugs:
1, dd bs > 128K,  glusterfs brick log shows client disconnect, I guess api 
caller crash.
in /var/log/samba/cores, may core files.

2, some times, nfs client OS core dump.

crash kernel log like:
Aug  6 11:06:36 infi131 kernel: INFO: task dd:3146 blocked for more than 120 
seconds.
Aug  6 11:06:36 infi131 kernel: "echo 0 > 
/proc/sys/kernel/hung_task_timeout_secs" disables this message.
Aug  6 11:06:36 infi131 kernel: dd            D 0000000000000000     0  3146   
2754 0x00000084
Aug  6 11:06:36 infi131 kernel: ffff880125b55cd8 0000000000000082 
0000000000000000 fff880123fc0<>ff802b5f ffff065fff802117 ff813fc3<>ff803c4f 
ff8155f8000000f8 ff819b58<>alTae
Aug  6 11:10:36 infi131 kernel: "echo 0 > 
/proc/sys/kernel/hung_task_timeout_secs" disables this message.
Aug  6 11:10:36 infi131 kernel: dd            D 0000000000000000     0  3146   
2754 0x00000084
Aug  6 11:10:36 infi131 kernel: ffff880125b55cd8 0000000000000082 
0000000000000000 ffff8801231f1c10
Aug  6 11:10:36 infi131 kernel: ffff880125b55cf8 ffffffffa046c50f 
ffff8801231f1c72 ffff8801231f1c73
Aug  6 11:10:36 infi131 kernel: ffff880139cb45f8 ffff880125b55fd8 
000000000000fb88 ffff880139cb45f8
Aug  6 11:10:36 infi131 kernel: Call Trace:
Aug  6 11:10:36 infi131 kernel: [<ffffffffa046c50f>]? ciswieae+x2/x8 
cf]<>[ffff819d>  ycpg+x/x0<>[ffff85d7> oshdl+x30c
Aug  6 11:14:21 infi131 kernel: ipmi device interface


Any advise? thx.

terrs.


> Hi,
> 
> 1. Please add in global section in smb.conf the following lines:
> 
> kernel oplocks = no
> stat cache      = no
> 
> 2. service smb restart
> 
> Please try the same test and let us know if that helps to increase the
> throughput.
> 
> 
> Raghavendra Talur
> 
> 
> 
> 
> 
> 
> On Tue, Aug 6, 2013 at 1:00 PM, haiwei.xie-soulinfo <address@hidden
> > wrote:
> 
> > hi, All
> >
> > samba vfs low performance, compare with non-vfs export dir.
> >
> > nonvfs:
> > address@hidden cifs]# dd if=/dev/zero of=test1 bs=64k
> > ^C记录了55548+1 的读入
> > 记录了55548+0 的写出
> > 3640393728字节(3.6 GB)已复制，17.192 秒，212 MB/秒
> >
> > vfs:
> > address@hidden cifs]# cd /mnt/cifs
> > address@hidden cifs]# dd if=/dev/zero of=test1 bs=64k count=10000
> > 记录了10000+0 的读入
> > 记录了10000+0 的写出
> > 655360000字节(655 MB)已复制，7.11406 秒，92.1 MB/秒
> >
> >
> > Any advise? Thanks
> >
> > terrs.
> >
> >
> > >
> > > hi, my testing:
> > >
> > > # glusterd -V
> > > glusterfs 3.4.0 built on Jul 25 2013 04:12:26
> > >
> > > # smbd -V
> > > Version 3.6.9-151.el6
> > >
> > > samba-gluster-vfs:
> > > git://forge.gluster.org/samba-glusterfs/samba-glusterfs-vfs.git
> > >
> > > smb.conf:
> > > [gvol]
> > >         comment = For samba export of volume  test
> > >         vfs objects = glusterfs
> > >         glusterfs:volfile_server = localhost
> > >         glusterfs:volume = two
> > >         path = /
> > >         read only = no
> > >         guest ok = yes
> > >
> > >
> > > On linux client, but dd testing will be pending.
> > >
> > > dd if=/dev/zero of=data bs=64k count=10000, successfully.
> > > dd if=/dev/zero of=data bs=128k count=10000, pending.
> > >
> > > Samba4.1 needed?  Thanks.
> > >
> > > -terrs
> > >
> > >
> > > On Mon, 29 Jul 2013 02:10:10 -0700
> > > Anand Avati <address@hidden> wrote:
> > >
> > > > On Mon, Jul 29, 2013 at 1:56 AM, Nux! <address@hidden> wrote:
> > > >
> > > > > On 29.07.2013 07:16, Daniel Müller wrote:
> > > > >
> > > > >> But you need to have gluster installed!? Which version?
> > > > >> Samba4.1 does not compile with the lates glusterfs 3.4 on CentOs
> > 6.4.
> > > > >>
> > > > >
> > > > > From what JM said, it builds against EL6 Samba (3.6) and it has also
> > been
> > > > > added to upstream.
> > > >
> > > >
> > > > You will need the latest Samba 4.1 release (or git HEAD),and
> > > > glusterfs-api-devel RPM (with its deps) installed at the time of
> > building
> > > > Samba to get the vfs module built.
> > > >
> > > > Avati
> > >
> > > _______________________________________________
> > > Gluster-users mailing list
> > > address@hidden
> > > http://supercolony.gluster.org/mailman/listinfo/gluster-users
> >
> > --
> > 谢海威
> > 软件项目经理
> > 电话:  +86 10-68920588
> > 手机:  +86 13911703586
> > Email:  address@hidden
> > _______________________________________________
> > Gluster-users mailing list
> > address@hidden
> > http://supercolony.gluster.org/mailman/listinfo/gluster-users
> >
> 
> 
> 
> -- 
> *Raghavendra Talur *


-- 
谢海威
软件项目经理
电话:  +86 10-68920588
手机:  +86 13911703586
Email:  address@hidden