This engineering project puts Elasticsearch to work on a genuinely large dataset: simulating 100,000 users making a million store check-ins, then tracing their movements through search.
Building the Dataset
Starting from an open San Francisco stores dataset of over 140,000 locations, you use Python and Pandas to narrow it to 10,000 stores, generate 100,000 fictional user profiles, and produce a million check-in events, each user averaging ten visits.
Search and Visualization
- Uploading the prepared data to Elasticsearch and managing indexes with Kibana
- Building a Streamlit interface with maps, filters, and tables
- Searching by store name, ZIP code, business ID, or device ID to trace a specific user's path
The course, taught by Andreas Kretz, runs 19 lessons and recommends prior Elasticsearch and Pandas experience, plus a machine with at least 8 GB of RAM.