When the sidebar is collapsed, can I still open a settings section?

Yes. While collapsed, each Settings/Quick actions section shows just its heading icon; click that icon to reveal its items as a row of smaller icons, then click the one you want. Hovering any icon shows its name. You can also click the collapse chevron to expand the whole sidebar back to its labelled view.