1. Photo Classification Evaluation Tool
Students: Keren Bercu & Idan Cohen
Supervisors : Tomer Shalev & Omer Geiger
Industrial Project (234313)

2. Team
Idan Cohen
Keren Bercu

3. definitions Ground Truth (GT) - tagged sets of photos
Dataset – A directory of images and a json file that contains the images path and set of tags
Instance – An image

4. Goals Implement a full-stack web-based GUI tool
The GUI will be used for:
Creating dataset by uploading images and inserting the set of relevant tags
Editing a dataset by labeling each instance
Evaluating a classification Algorithm by comparing it to the corresponding GT
Design a convenient friendly UI

5. Methodology
The tool was developed with the intent of allowing Shutterfly engineers to later integrate to a full web environment (i.e. AWS: EC2, S3).
Software development was based on short iterations with tight feedback loops (Agile concept).
The project was managed on the GitHub platform, in order to coordinate, track, and update our work in one place (using issues and milestones throughout the way).
The tool will be used to evaluate a variety of image classification algorithms.

6. achievements Web-based GUI with the following abilities:
Dataset Uploader
The Dataset Uploader allows the easy creation of a dataset with a set of tags and images
Dataset Manager:
The Dataset Manager allows to load and save a dataset with tagged instances
Evaluator:
The Evaluator compares between a GT set and the output of a classification algorithm. The Evaluator creates a confusion matrix as well as a display of the images along with the result of the comparison for each instance.

7. examples

15. Conclusions
Integration between backend and frontend seems hard but in reality it is straight forward.
Using Agile concept helped us achieve milestones in an efficient way.
Full-stack development requires knowledge and an understanding of several disciplines.

16. Questions?

17. Getting familiar with:
Week
Ramp-Up:
Getting familiar with:
Python & Flask framework, Javascript, CSS, Vue.JS & Vuetify framework, JSON
Setting up environment:
Ubuntu VM, installations, GitHub
01/04 – 07/04
08/04 – 14/04
Build simple “Hello world”:
Backend
Frontend
15/04 – 21/04
22/04 – 28/04
Photo classification evaluation tool:
Build a full dataset manager form
Build a full functioning frontend
29/04 – 05/05
06/05 – 12/05
13/05 – 19/05
Load/Save integration: Triggering a connection between the frontend and the backend by clicking Load/Save
20/05 – 26/05
Upload integration: Create and implement an option to upload a folder of images and a schema file from the client to the server
27/05 – 02/06
Algorithm evaluator UI: Adding an evaluating functionality to the frontend
03/06 – 09/06
Integration & Implementation of algorithm evaluator UI
10/06 – 16/06
17/06 – 23/06
Bug fixes & documentation
24/06 – 30/06