It is expected that plasmids are costly and therefore that selection is required to maintain them within bacterial populations. Here, Wein et al. show that plasmid stability can emerge even in the absence of positive selection and that loss may be determined by transcription-replication conflict.