Ceph / CephFS outage that in the initial investigation seems to be a result of the new updated version of Ceph introduced last week, when running a multiple MDS Ranks.
Ilifu operations have been restored. Although users should be able to access ilifu services again, the technical team is still working on the underlying issue.
We are currently still experiencing issues with our CephFS instance. Users may experience this as issues accessing ilifu services, accessing file system mounts on compute nodes and general file system performance issues. The technical team is investigating the issue.
Systems are back online, please check your slurm jobs as they may have been interrupted by the outage.
We are in the process of checking all nodes to ensure they are 100% working with all mounts
You may need to restart your Jupyter session.
