"I prefer to rebase instead of merging, to make the history cleaner" is the VCS equivalent of retroactively rewriting ur life narrative to be untrue, but consistent; the messy history is more honest, but it gives us visceral discomfort, as we like to believe ourselves rational.
fight the urge to clean up the past; what happened happened, in all its messiness. use that discomfort as drive to clean up your future instead.