[Gluster-devel] gluserfs 2.0.4: Text file busy error

[Dennis Michael]

Is this a bug, or does anyone have a suggestion on how to fix this error?

We have a job that runs across several compute nodes, and all but
the last process starts.  The last process (on the master node) fails 
with a "Text file busy" error on the program binary.

Our workaround is to run the program binary from a NFS partition mounted 
via GbE while continuing to access data files and doing MPI/IO in glusterfs.

All nodes run CentOS 5.2.  Glusterfs (ver 2.0.4) is mounted via 
Infiniband, and the job runs under bash via SGE.

Our config files:

# client config
volume pf1
  type protocol/client
  option transport-type ib-verbs
  option remote-port 699X
  option remote-host XXX.XXX.XXX.XXX
  option remote-subvolume brick
end-volume
#
volume pf2
  type protocol/client
  option transport-type ib-verbs
  option remote-port 699X
  option remote-host XXX.XXX.XXX.XXX
  option remote-subvolume brick
end-volume
#
volume distribute
  type cluster/distribute
  subvolumes pf1 pf2
end-volume
#



# server config pf1
volume posix
  type storage/posix
  option directory /data
end-volume
#
volume locks
  type features/locks
  subvolumes posix
end-volume
#
volume brick
  type performance/io-threads
  option thread-count 2
  subvolumes locks
end-volume
#
volume server
  type protocol/server
  option transport-type ib-verbs
  option transport.ib-verbs.listen-port 699X
  option client-volume-filename /usr/etc/glusterfs/glusterfs-client.vol
  option auth.addr.brick.allow *
  subvolumes brick
end-volume

--
Dennis Michael
Manager, High Productivity Technical Computing
Stanford Center for Computational Earth and Environmental Science (CEES)
School of Earth Sciences
Stanford University
397 Panama Mall Mitchell Building room 415
http://cees.stanford.edu/
phone # (650) 723 2014