Batch vs. Streaming

Because everyone asks, in the battle between batch vs. streaming, there is no clear winner, but rather we should choose to do batch or streaming based on what makes sense in our use case.

There are many who will assert that "real time is always better". This is not true. If the use case requires real time (or near real time) data, such as GPS data for a fleet of vehicles or stock-trades/asset management, then it makes sense. On the contrary, a once-per-month report probably isn't worth the work (or the carbon footprint) or costs to make data available real-time.

The answer truly lies in pragmatism. And of course, knowing your consumers.