It's absolutely fine to keep 'em, especially if you have a good sense of how you're going to fix them! Unassigning is for when you know you aren't going to get to them in the next month or so, or you're bored and don't want to do them anymore, or you're stuck and can't get anywhere on 'em.