BACHLOG: Testing

BACHLOG was evaluated through three successive testing phases: a pilot study, moderated usability testing, and performance testing.

Pilot Study

The pilot study was conducted during the autumn 2025 semester of Introduction to Speciality, where two teaching assistants used the application to validate approximately 150 student-submitted curriculum plans. The results showed a 68% reduction in verification time compared to the traditional manual method. Observations from the pilot informed a round of improvements, including better CSV error handling, visual error indication, and expanded module composition checks.

Usability Testing

Usability testing involved eight participants — five students and three teaching assistants — completing role-specific tasks in one-on-one moderated sessions. SUS scores averaged 88.44 (grade B overall). Participant feedback led to further improvements: a sticky search panel, a semester dropdown in the course details panel, validation result summaries, and a redesigned logo.

Performance Testing

Performance testing confirmed that no BACHLOG operation takes too long to complete. For a standard 180 ECTS plan, CSV import averaged ~3.5s and validation checks under 600 ms.