JupyterHub HPC Meeting - May 2022#

Welcome to the Meeting#

Hello! If you are joining the team video meeting, sign in below so we know who was here. Roll call:

  • name / institution / GitHub handle

  • Rollin Thomas / NERSC / @rcthomas

  • Félix-Antoine Fortin / Université Laval - The Alliance / @cmd-ntrf

  • Jens Henrik Göbbert / FZJ/JSC / @jhgoebbert

  • James Beal/ WTSI / @jbeal-work (github)

  • Michael Milligan / MSI @ UMN / @mbmilligan

  • Simon Li / University of Dundee / @manics

  • Monica Ihli / ORNL / @MonicaIhli

  • Sarah Bellemare / Universite Laval / @snoort

  • Young Milligan

Quick updates#

60 second updates on things you have been up to, questions you have, or developments you think people should know about. This is also a chance to suggest a future presentation if you’ve got work currently in progress you might want to share. Please add yourself, and if you do not have an update to share, you can pass.

  • Name: Your update

  • Félix-Antoine: Introducing new intern Sarah who might work on JupyterHub and HPC during the summer.

  • James Beal: I fixed the problem I had with splitting the proxy and the hub, it was to do with trying to use subclassing which I assumed would work. I have got the effect I want with javascript

    • James will write something up to post to Discourse

    • Maybe contribute as example to wrapspawner

  • Michael Milligan: center director has mandated OpenOndemand POC here, so we will get some direct comparison vs Jupyterhub

  • Jens Henrik Göbbert: Spawner development for YAML-defined compute resourcs (Kubernetes-manager, UNICORE, etc.) with single UI

    • Lots and lots of compute resources, external resources

    • Makes it easier to deploy

Reports and celebrations#

This is a place to make announcements (without a need for discussion). This is also a great place to give shout-outs to contributors! We’ll read through these at the beginning of the meeting.

  • Name: Your report or celebration

Agenda items#

Let’s collect all potential agenda items here before the start of the meeting. We will then attempt to create a coherent agenda that fits in the 60m meeting slot. If there are similar items try and group them together.

  • All: Standing project items:

    • Batchspawner check-in: Issues and PRs

      • need to check CI status, seems to be failing for PRs, from March:

        • pytest run for 3.9 against hub 0.9.6 fails

        • using a deprecated sqlalchemy maybe pinned by hub

        • Plan: drop that combo from the matrix, rerun

        • jupyterhub/batchspawner#229

        • Will probably unblock other failed PR tests

      • Worthwhile to do a sweep on batchspawner PRs

        • Which are worth keeping which to close?

        • Plan: Mike will take a look on PRs

      • Some new pull requests

      • Users have been breaking batchspawner by overwriting the script template

        • Created issue to not encourage users to do this

        • Documentation issue, not code issue

        • Some better config examples for README (they’re old)

    • Wrapspawner check-in: Issues and PRs

      • EPA team contribution PR - Michael did code review, would like to see some restructuring but support accepting with cleanup

        • Code review by MM yesterday

        • Some restructuring described in response

        • Derived from ProfileSpawner

  • Workshop/conference season:

    • ISC 22 Interactive HPC

    • SC 22 Urgent+Interactive HPC workshop accepted

    • PEARC news?

  • Elyra?

    • JSC is experimenting with Elyra, wonder if anyone else has taken a look

    • Some modifications to JupyterLab, may not be necessary

    • Can send workflows to e.g. indirectly, Slurm

  • June 1 meeting may need a volunteer to host, Rollin will update as we get closer