Reputation: 331
In my application all realtime data storing in a cassandra table, I have plan to analyze it using apache spark and put it into different tables which allows faster data fetch, I want to know which design approach I need to apply for it.
Analyze relatime table in a time-frame , then put in to hourly , then analyze later make it to daily , then weekly etc..., Then it is easy to achieve data in a date range. Is my logic is fine or any other approach with cassandra and spark?
Upvotes: 0
Views: 103
Reputation: 1319
I think your approach is good.It is similar to Lambda Architecture designed by Nathan Marz. For more information, follow this link .Hope this will help you.
Upvotes: 1