1. Help Center
  2. Using Swarmia
  3. Measure developer experience with Surveys

Viewing and sharing survey results

Survey results are available in CSV format for surveys that have ended

Results are available only from surveys that have ended. You can't view results from live surveys, but you can view their participation numbers.

To access a survey's results, click on the name of a survey that has ended, or select View results from the right-side menu.

Analyzing the results

Heatmap

The heatmap shows a color-coded overview of each team's average ratings across the survey.

You can see the number of responses from a particular team by hovering your mouse on the row.

The scores are aggregated on all levels of the team hierarchy. You can expand and collapse teams to view just the scores you're interested in.survey-results-team-controls

The main overview shows average scores across all the questions in a topic. You can expand the topics to see a more detailed breakdown by each question.

survey-heatmap-themes

survey-heatmap-questions

You can click any of the cells in the heatmap to see more details on the Questions & comments tab.

Comparisons

The "Compare with..." menu in the heatmap offers you three ways to compare survey results:

survey-compare

  • Survey average: Shows how much each team is above or below the survey’s average (all teams) in each topic and question.
  • Industry benchmarks: Shows how your results compare with average survey ratings for each question from 50+ companies using Swarmia. You can choose from three percentiles: p50 (median), p75, and p90.
    • The benchmarks are available for all of Swarmia’s 32 built-in questions.
    • The topic average benchmarks are calculated only based on the questions you have included in the survey.
    • Any custom questions you have created are ignored in the topic averages.
  • Another survey: Select any of your surveys and see the changes in scores between them.
    • If the two surveys have a different set of questions, the topic averages are calculated based on the overlapping questions. Questions available only for one of the surveys are ignored.
    • Each team is considered the same team across the two surveys, regardless of any changes to its members or sub-teams.
    • The ratings for the "All teams" row are calculated based on the teams that are included in both surveys. In other words, it's based on all the team scores visible in the heatmap, ignoring the scores not shown in the heatmap.

Questions & comments

On the Questions & comments tab, you can see all the comments and the detailed distribution of ratings by topic, question, and team.

On the left side, you have controls for topic and team filters.

On the right, you have options for sorting by

  • Original order
  • Highest score
  • Lowest score
  • Most comments
  • Most skips

Click any of the questions to see its comments.

You can hover on the distribution bar to see the detailed rating counts

questions-comments-tab

Participation

On the Participation tab, you can see the response rate in each team.

survey-reporting-participation

Related metrics

Some of the survey questions have related metrics to provide more context on the results. You can find them by expanding the questions on the Questions & comments tab. You can click the metrics to access the relevant Swarmia page filtered by the selected team.

The links work also the other way around. You can see the latest survey results for the selected team within the selected timeframe next to your pull request data, issue insights, and DORA metrics. To see the rating distribution and comments, simply click on the score to access the detailed survey report.

Publishing the results

After the survey ends, the results are first available only to the survey creator and admins. This allows you to review them before sharing them with your team.

🤬 If the results contain sensitive or offensive comments, contact Swarmia to get them removed.

When you're ready to show the results to others, select Publish results in the top-right corner. Everyone in your Swarmia organization will get access to the results. You'll also get a link to share them easily with the teams.

survey-publish-results

 

Unpublish survey results


👉 Published results can be unpublished by clicking the Published button.

Downloading the results

You can also export the results to use them elsewhere. Just click the Download survey results button in the top-right corner.

survey-export-results

You'll get a ZIP archive with three comma-separated values (CSV) files:

Scores

One row for each team-question pair:

  • question: The question the rating relates to
  • questionGroup: The topic the question belongs to
  • team: The team associated with this rating (selected as their primary team by the respondents)
  • rating: The average rating the team gave for the question on a scale from 1 to 5 (excluding skips)
    • If everyone in the team skipped the question, the value null is shown
  • numberOfSkips: The number of people in the team who skipped the question
  • totalNumberOfRespondents: The number of people in the team who selected it as their primary team and responded to the survey (= rated or skipped the question)

Comments

One row for each comment:

  • question: The question the comment relates to
  • questionGroup: The topic the question belongs to
  • team: The primary team the comment's author selected in the survey
  • comment: The contents of the comment
  • authorName: The name of the user who wrote the comment

Participation

One row for each team:

  • totalNumberOfRespondents: The number of people in the team who responded to the survey
  • totalNumberOfTeamMembers: The number of people in the team who had access to the survey