With complex and numerous data entities updated daily, build a user-facing website to display various trends in the data.
Developed 3 data layers to collect and analyze data arrays. Implemented trend monitoring system. Designed modern user-facing website showing resulting information. Re-calculation performed on a daily basis.
- Research underlying data sources spread across many servers and stored in different data structures.
- Crawl data from distributed data sources, fail-resistant. Store in one unified structure.
- Design OLAP cube and automatically import source data.
- Compose pre-built reports based on OLAP data to achieve better response time.
- Implement automatic system to re-collect data and re-calculate stats on a daily basis.
- Develop modern user-facing website with graphs, tables and charts.