Design question - Improve your performance and reliability in a given data pipeline.
Sigiloso
1. avoid data loss and store data in noSQL db. 2. improve your performance by adding redis service. 3. Apply concurrency in gateway application 4. Apply spark pipeline in data processing section