Skip to content
This repository was archived by the owner on Nov 15, 2019. It is now read-only.

1st evaluation 2017

Jump to bottom
Alin Stefanescu edited this page Oct 19, 2017 · 41 revisions

Dear evaluator,

Please find below the information needed for the first evaluation of the MEASURE Platform.

Your feedback is much appreciated!

About MEASURE project

The MEASURE Platform is a web application which allows to collect, compute, store, analyse, and visualize measurements by execution of software metrics. It is developed inside the MEASURE project (http://measure.softeam-rd.eu).

The project runs over several years [2016-2019] and in the first stage we developed the platform and also a module that allows to define measures (in SMM format). This is the scope of the evaluation.

In the last part of the project we will develop also a component for software metrics analytics. This is not in the scope of the current evaluation. However feedback on what kind of analytics you would be interested in, is very valuable.

Timeline of the 1st evaluation

  • September 1, 2017: MEASURE Platform ready for evaluation
  • September 12, 2017: two specific measuring tool (MMT and EMIT) ready for evaluation
  • September 30, 2017: end of evaluation by colleagues from industry
  • October 2-3, 2017: project meeting in Nantes to discuss the results of the evaluation
  • October 2017: writing a project report documenting the first evaluation (here is a first draft)

Evaluation procedure

The evaluation consists of 5 scenarios which cover the MEASURE tooling available now.

For each scenario we provide a short description, a link to a survey where you can provide feedback, expected outcome, suggested evaluator roles for each scenario, and an estimation on how much the evaluation may take. We need this feedback until the end of September.

Additionally, for very specific problems or suggestions, you can directly create an issue in GitHub or write an email to Alessandra Bagnato (alessandra.bagnato@softeam.fr).

Scenario 1. Evaluation of the local installation procedure of MEASURE Platform

Description: see wiki pages

Survey: please fill the questionnaire for scenario 1

Suggested evaluator roles: DevOps, software engineer

Expected result of the scenario: MEASURE Platform up and running on evaluator machine

Expected time required to run this scenario: 2 hours

Scenario 2. Evaluation of the MEASURE Platform

Description: see wiki pages

Survey: please fill the questionnaire for scenario 2

Suggested evaluator roles: software engineer, project manager

Expected result of the scenario: First MEASURE Platform project dashboard showing a simple measure and a complex measure running on evaluator machine (please send the screenshot by email or as a link to a shared file or uploaded file in the last two fields of the questionnaire)

Expected time required to run this scenario: 1 person-day

Scenario 3. Evaluation of specific measures provided by MEASURE partners

Description: In this scenario, you will integrate in the MEASURE platform some specific measures developed inside MEASURE project by different partners (Montimage, ICAM, IMT). For this, you may have to install certain tools from the monitoring and green computing areas (MMT, EMIT).

More precisely, you will evaluate three distinct subscenarios from different domains. Each subscenario has its own description in a wikipage and a separate survey:

Suggested evaluator roles: software engineer, DevOps

Expected result of the scenario: Integrate the measures in the three subscenarios in your installed MEASURE platform (this will involve also to install and run MMT and EMIT tools)

Expected time required to run this scenario: 2 person-days

Scenario 4. Evaluation of the extensibility of the MEASURE platform

Description: Some common metrics are already provided (we embedded all the SonarCube metrics catalogue), but you can develop specific metrics for your domain or needs. See the following wiki pages on how to do this:

Survey: please fill the questionnaire for scenario 4

Suggested evaluator roles: software engineer

Expected result of the scenario: Develop a couple of new measures (ideally one simple and one complex measure) and deploy them on the MEASURE Platform

Expected time required to run this scenario: 1-2 person-days

Scenario 5. Evaluation of management advantages provided by the MEASURE platform

Description: This is a business-oriented scenario. We would like to know if you think MEASURE platform has the potential to improve your work as a project manager and decision maker.

Moreover, it would be great if you could provide some business requirements from your domain that could improve the ROI of the MEASURE platform.

Last but not least, your ideas and needs on metrics analytics are also very helpful for our next development iteration.

Survey: please fill the questionnaire for scenario 5

Suggested evaluator roles: project manager, data scientist, quality engineer

Expected result of the scenario: The final complete MEASURE Platform project dashboard showing the measures running on evaluator machine (please send the screenshot by email or as a link to a shared file in the last field of the questionnaire). Please provide an interpretation of the data visualized in the dashboard and what decisions could be made based on this information and relate them to the feedback provided in the questionnaire.

Expected time required to run this scenario: 1-2 person-days

Thank you!

MEASURE team

Home

User Documentation

Developers Documentation

Clone this wiki locally