[Bug 2064657] Re: Add support for CEPH ceph.file.layout and ceph.dir.layout xattr

[Fabio Augusto Miranda Martins]

** Attachment added: "sosreport-jammy-130612-2024-05-22-dnjwtoi.tar.xz"
   https://bugs.launchpad.net/ubuntu/+source/nfs-ganesha/+bug/2064657/+attachment/5781410/+files/sosreport-jammy-130612-2024-05-22-dnjwtoi.tar.xz

-- 
You received this bug notification because you are a member of Ubuntu
OpenStack, which is subscribed to nfs-ganesha in Ubuntu.
https://bugs.launchpad.net/bugs/2064657

Title:
  Add support for CEPH ceph.file.layout and ceph.dir.layout xattr

Status in nfs-ganesha package in Ubuntu:
  Incomplete

Bug description:
  Ceph supports using extended attributes (xattrs) to configure a file
  or directory layout, so as to tell Ceph which pool to place the
  objects related to that file or directory. This is mostly relevant for
  when you are using CephFS and have multiple pools in the Ceph volume,
  as documented here [1] and [2].

  However, if you have NFS-Ganesha serving the CephFS filesystem to NFS
  clients, it will fail if you try to setfattr

  ubuntu at jammy-183048:~$ sudo setfattr -n ceph.dir.layout.pool -v ceph-fs_ecdata /mnt/nfs1/ecpool
  setfattr: /mnt/nfs1/ecpool: Operation not supported

  So, it seems there's a limitation on what kind of Ceph xattr ganesha
  would support.

  In this bug, there are some discussions around some CEPH FSALs that
  were enabled.

  https://github.com/nfs-ganesha/nfs-ganesha/issues/526

  And we can see them at:

  https://github.com/nfs-ganesha/nfs-
  ganesha/blob/f495f2fd8a3529065cd5c7eef5276910e11abb1a/src/FSAL/FSAL_CEPH/internal.h#L201-L204

  However none of them are related to the xattr required by Ceph for
  disk layouts to work (i.e.: ceph.dir.layout.pool)

  Hence, although ceph-fs supports file-layouts, it doesn't seem that
  NFS Ganesha contains the necessary features to support it in a Ceph
  environment.

  It would be good to have implemented in NFS-Ganesha, so we can relay
  the CephFS requirements to configure file-layouts.

  
  [1] https://docs.ceph.com/en/latest/cephfs/file-layouts/#adding-a-data-pool-to-the-file-system
  [2] https://docs.ceph.com/en/latest/cephfs/file-layouts/#adding-a-data-pool-to-the-file-system

To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/nfs-ganesha/+bug/2064657/+subscriptions