Discover more projects across a range of sectors and discipline — from AI to cleantech to social innovation.
High-volume online stream processing, also known as fast data processing, is becoming increasingly important in a number of different commercial sectors. Unlike big data processing in which data is processed asynchronously in batches, fast data processing performs synchronous data analysis that generates actionable results within a specified deadline. One of the key challenges in building a fast data processing system is in scaling with increasing volumes of data. In our proposed research, we plan to build a system to efficiently manage the available memory across the entire deployment. The system will determine which data blocks should remain in memory, where a data block should be placed, and what fault tolerance strategy the system should employ. The objective is to build a scalable processing system that can handle both current and future fast data processing demands. TO BE CONT’D
Information and communications technologies
University of Waterloo
Find the perfect opportunity to put your academic skills and knowledge into practice!Find Projects
The strong support from governments across Canada, international partners, universities, colleges, companies, and community organizations has enabled Mitacs to focus on the core idea that talent and partnerships power innovation — and innovation creates a better future.