confint does give you a 95% confidence interval by default.
Check out the docstring for confint. By default, the level parameter is set to a 95% confidence interval. A confidence interval is just that; an interval. By definition, intervals have two end points, and with the default endpoints, that means that your true parameter estimate will fall inside the interval given by confint 95% of the time. Check out this link for a more fully fleshed out explanation.