I have worked it out. Adding an environment variable fixes things. This was never in the Action previously so something must have changed somewhere. Hopefully this helps people running into the same issue.
I borrowed this from the r-lib/actions examples.
env:
GITHUB_PAT: ${{ secrets.GITHUB_TOKEN }}