[Bug 2064657] Re: Add support for CEPH ceph.file.layout and ceph.dir.layout xattr

[Peter Sabaini]

Fabio, can I ask you to provide some detail on the setup.

- Can you confirm which NFS client you are using?
- Would you be able to share logs. Ideally provide an sosreport, but if that is not feasible /v/l/kern.log and /v/l/syslog would be great 

Thank you.


** Changed in: nfs-ganesha (Ubuntu)
       Status: New => Incomplete

-- 
You received this bug notification because you are a member of Ubuntu
OpenStack, which is subscribed to nfs-ganesha in Ubuntu.
https://bugs.launchpad.net/bugs/2064657

Title:
  Add support for CEPH ceph.file.layout and ceph.dir.layout xattr

Status in nfs-ganesha package in Ubuntu:
  Incomplete

Bug description:
  Ceph supports using extended attributes (xattrs) to configure a file
  or directory layout, so as to tell Ceph which pool to place the
  objects related to that file or directory. This is mostly relevant for
  when you are using CephFS and have multiple pools in the Ceph volume,
  as documented here [1] and [2].

  However, if you have NFS-Ganesha serving the CephFS filesystem to NFS
  clients, it will fail if you try to setfattr

  ubuntu at jammy-183048:~$ sudo setfattr -n ceph.dir.layout.pool -v ceph-fs_ecdata /mnt/nfs1/ecpool
  setfattr: /mnt/nfs1/ecpool: Operation not supported

  So, it seems there's a limitation on what kind of Ceph xattr ganesha
  would support.

  In this bug, there are some discussions around some CEPH FSALs that
  were enabled.

  https://github.com/nfs-ganesha/nfs-ganesha/issues/526

  And we can see them at:

  https://github.com/nfs-ganesha/nfs-
  ganesha/blob/f495f2fd8a3529065cd5c7eef5276910e11abb1a/src/FSAL/FSAL_CEPH/internal.h#L201-L204

  However none of them are related to the xattr required by Ceph for
  disk layouts to work (i.e.: ceph.dir.layout.pool)

  Hence, although ceph-fs supports file-layouts, it doesn't seem that
  NFS Ganesha contains the necessary features to support it in a Ceph
  environment.

  It would be good to have implemented in NFS-Ganesha, so we can relay
  the CephFS requirements to configure file-layouts.

  
  [1] https://docs.ceph.com/en/latest/cephfs/file-layouts/#adding-a-data-pool-to-the-file-system
  [2] https://docs.ceph.com/en/latest/cephfs/file-layouts/#adding-a-data-pool-to-the-file-system

To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/nfs-ganesha/+bug/2064657/+subscriptions