Back to projects
Project overview
Massary - Scalable Big Data Architecture
A resilient distributed architecture capable of supporting 25,000 simultaneous users (compared to 10,000 in classical architecture) with separation of read/write flows using Kafka for asynchronous ingestion and Redis for high-performance caching.
Highlights
- 01Scalable Architecture Supporting 25,000+ Users
- 02Separation of read/write flows (CQRS/Kafka pattern)
- 03Ultra-fast and resilient asynchronous ingestion
- 04High-performance caching via Redis (response time < 2ms)
- 05Distributed HDFS storage and MongoDB persistence
- 06Horizontal scalability with NGINX/Docker load balancing
Technology stack
KafkaSparkSpark MLRedisHDFSFastAPIDockerMongoDBMySQL