How to align multiline text annotation in ggplot

I just realized that hjust = 0 didn't just left-justify the text, it also shifted the invisible text box so its left edge is at x = 1. Do you think there a simple way to left justify text within the invisible text box without affecting the placement of the box itself?