Serializers do the actual work of getting settings in and out of Umbraco, in general they do this in memory producing and consuming XML in the form of XElements.

In normal operation the Handlers manage the reading and writing of the xml to and from disk, and the serializers set and retreive the settings within Umbraco.