JupyterHub HPC Meeting - February 2023#
Date: 2023-02-01
Time: 8:30 AM PST
Where you can find these and past meeting notes: https://jupyterhub-team-compass.readthedocs.io/en/latest/meetings/hpc/
Calendar for future meetings: https://jupyterhub-team-compass.readthedocs.io/en/latest/meetings/
Welcome to the Meeting#
Hello! If you are joining the team video meeting, sign in below so we know who was here. Roll call:
name / institution / GitHub handle
Félix-Antoine Fortin / Université Laval / @cmd-ntrf
Ryan Lovett / UC Berkeley / @ryanlovett
Rollin Thomas / NERSC / @rcthomas
Michael Milligan / MSI @ UMN / @mbmilligan
Quick updates#
60 second updates on things you have been up to, questions you have, or developments you think people should know about. This is also a chance to suggest a future presentation if you’ve got work currently in progress you might want to share. Please add yourself, and if you do not have an update to share, you can pass.
Name: Your report or celebration
Reports and celebrations#
This is a place to make announcements (without a need for discussion). This is also a great place to give shout-outs to contributors! We’ll read through these at the beginning of the meeting.
Name: Your report or celebration
Ryan: portwrap and batchspawner-portwrap (sandbox for jupyterhub-singleuser including things launched by jupyter-server-proxy) are working in a couple of small SLURM clusters. I’d appreciate any feedback if you review the code, read the docs, and or try them out.
Agenda items#
Let’s collect all potential agenda items here before the start of the meeting. We will then attempt to create a coherent agenda that fits in the 60m meeting slot. If there are similar items try and group them together.
All: Standing project items:
Batchspawner check-in: Issues and PRs
Plan for coming month:
merge JHub 3 fixes e.g. jupyterhub/batchspawner#247
merge test matrix updates jupyterhub/batchspawner#252
some minor documentation fixes
new release bumping compatability versions
drops support for python 3.5
drops support for hubs < 1
Wrapspawner check-in: Issues and PRs
all quiet?
Todo: still lacks tests, investigate how e.g. dockerspawner does testing
Workshop/conference news:
JupyterCon 2023
Cite des Sciences, Paris
May 10-12
CfP ended December 20
PEARC 2023 CfP is out: https://pearc.acm.org/pearc23/call-for-participation/
papers/short papers due March/April
BoF and panel May 12 deadline
TrustedCI summit in end of October at Berkeley Lab coming together
Security-focused co-located event on Jupyter?
Community management
Should HPC be its own subproject or some kind of more official interest group?
Broadening beyond Hub is happening
Abandoned things to revive/decide fate of?
Other discussion#
Revisited January discussion about stopping a pending job
Relevant issue: jupyterhub/jupyterhub#2975
Discussion of logging / metrics
Rollin shows dashboard based on Slurm / papermill
Is anyone using Prometheus (yes)
Felix-Antoine shared: guilbaults/TrailblazingTurtle
and also: guilbaults/slurm-job-exporter
Splunk / log analysis approaches
Rollin links: https://hmdsa.github.io/hmdsa/pages/tools/ldms