Pergunta de entrevista da empresa Databricks

How would you implement a web-crawler