The most likely candidate for the silver and gold flakes are iron sulphides - also known as iron pyrites or, "fools gold". Lead sulphide (galena) also produces silvery inclusions that would fit the bill with what you describe. Where did you find the material in question? Often the geological context is the best giveaway as to the identity of the material.
This is some galena and calcite:
(https://upload.wikimedia.org/wikipedia/commons/d/d4/Calcite-Galena-207327.jpg)