Pergunta de entrevista da empresa ThousandEyes

Design a high-throughput streaming data pipeline that will deduplicate certain categories of messages under certain circumstances.