The elimination of synapses, or the junctions that connect neurons to each other, if they are not active enough.