When some Si atoms are replaced by trivalent impurity, holes are created, which are equivalent to positive charge. These holes make the crystal conductor of electricity.
Since, the crystals as a whole are always electrically neutral, the obtained crystal is also electrically neutral.