Online Evaluation for Effective Web Service Development
It addresses the need for effective experimentation platforms in web service development, but is incremental as it reviews existing methods.
The tutorial overviews state-of-the-art methods for online evaluation pipelines used by leading internet companies to guide data-driven web service development, aiming to help professionals make development more effective.
Development of the majority of the leading web services and software products today is generally guided by data-driven decisions based on evaluation that ensures a steady stream of updates, both in terms of quality and quantity. Large internet companies use online evaluation on a day-to-day basis and at a large scale. The number of smaller companies using A/B testing in their development cycle is also growing. Web development across the board strongly depends on quality of experimentation platforms. In this tutorial, we overview state-of-the-art methods underlying everyday evaluation pipelines at some of the leading Internet companies. Software engineers, designers, analysts, service or product managers --- beginners, advanced specialists, and researchers --- can learn how to make web service development data-driven and do it effectively.