How do I change or remove a due date?

Click the date chip on the to-do to reopen the calendar. Pick a different day to change it, or click "Clear date" to remove the date entirely.