The diamond industry is shifting its focus from size and sparkle to rarity and provenance, as discerning buyers seek out antique, colourful and scarce natural diamonds.