Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Provide users with ability to import/export an assessment as data (e.g. json)? #653

Closed
mmafe opened this issue May 6, 2019 · 27 comments
Closed
Assignees
Labels
feature request status: resolved This issue has been merged into main and deployed to canary.

Comments

@mmafe
Copy link

mmafe commented May 6, 2019

Currently I can only work on a single assessment at a time. If I want to start a new assessment, I'm forced to lose my previous work. I am also unable to edit a previously exported assessment once I've started a new one.

My Request

In addition, I would love to be able to:

  • export an assessment as data (e.g. json file)
  • re-import the data of that assessment

This would allow me to:

  • simultaneously work on multiple assessments
  • edit a previously exported assessment without having to redo the whole thing from scratch
@msft-github-bot msft-github-bot added the status: new This issue is new and requires triage by DRI. label May 6, 2019
@waabid waabid added the status: ready for triage This issue is ready to be triaged by the Accessibility Insights team. label May 8, 2019
@msft-github-bot
Copy link
Collaborator

This issue has been marked as ready for team triage; we will triage it in our weekly review and update the issue. Thank you for contributing to Accessibility Insights!

@waabid waabid removed the status: new This issue is new and requires triage by DRI. label May 8, 2019
@nschonni
Copy link

nschonni commented May 9, 2019

This may be applicable if you start to look at output formats https://w3c.github.io/wcag-act/act-rules-format.html#appendix-data-example

@scottsb
Copy link

scottsb commented May 21, 2019

Here is a more detailed explanation of the same approach @nschonni mentions. It would be amazing if this tool could generate interchangeable data files with the W3C's own (sadly poorly maintained) tool:
https://github.com/w3c/wcag-em-report-tool/blob/master/docs/EARL+JSON-LD.md

Edit: actually, it appears that the W3C's tool follows a similar high-level approach but quite different specific implementation than the ACT rule format.

@ferBonnin
Copy link
Contributor

Hey @mmafe, thanks for your interest in Accessibility Insights for Web!

This is a request that requires more discussion and investigation on our side, we will update here when we know more and we will keep checking for upvotes/reactions from the community on this request

@msft-github-bot
Copy link
Collaborator

This issue has been marked as requiring additional investigation by the Accessibility Insights team. When the issue is ready to be triaged again, please update the issue with the investigation result and add "status: ready for triage". Thank you for contributing to Accessibility Insights!

@ferBonnin ferBonnin added the status: needs investigation This issue requires investigation (PM, Design, or SWE) by the Accessibility Insights team. label May 31, 2019
@msft-github-bot msft-github-bot removed the status: ready for triage This issue is ready to be triaged by the Accessibility Insights team. label May 31, 2019
@adbajaj
Copy link

adbajaj commented Aug 14, 2019

This would be very helpful for my team as well! Would be interested to know ball park timings on when this is coming.
Thanks,
Aditya

@mgifford
Copy link

Just wanting to check in on the status of this. Love the idea of being able to take this data and just plug it into W3C's WCAG-EM Report Tool /c @scottsb @nschonni

@nitedog
Copy link

nitedog commented Mar 1, 2020

@ferBonnin I'd be happy to engage in such a discussion on interchangeable formats.

@mgifford
Copy link

mgifford commented Mar 2, 2020

@WilcoFiers let me know that you should be able to do this in axe with https://github.com/dequelabs/axe-reporter-earl

In which case, it should be possible with Accessibility Insights.

@ferBonnin
Copy link
Contributor

Hi Everyone, thanks for the additional inputs on this feature request! This last comments seem to be focused around the ability to export the assessment as data.

To help us understand better the requirements, can you share a little bit about:

  • the scenarios where having the assessment as data would be helpful / how would you use this data?
  • tell us a bit more about what formats would be helpful and why?

@mmafe
Copy link
Author

mmafe commented Mar 6, 2020

@ferBonnin Thanks for looking into this!

I'd find an export of the assessment as data helpful if I need to:

  • update the report (e.g. if I find a new issue)
  • have someone else review or edit the report before we finalize it
  • do multiple accessibility audits at the same time

I'm comfortable with JSON, however I think (for me) any format would work as long as I can import or export it specifically from accessibility insights. For others, it might be a different case.

@adbajaj
Copy link

adbajaj commented Mar 6, 2020

+1 mmafe's comments

@scottsb
Copy link

scottsb commented Mar 9, 2020

For me having the output as data would be ideal for transfer to other tools for generation of a final report that includes manual testing as well. For this purpose ACT/EARL would be the ideal format, ideally in the JSON-LD serialization, as suggested by others above.

@ferBonnin ferBonnin added the status: active This issue is currently being worked on by someone. label Apr 22, 2021
@ghost ghost removed the status: needs investigation This issue requires investigation (PM, Design, or SWE) by the Accessibility Insights team. label Apr 22, 2021
@ferBonnin
Copy link
Contributor

Marking this as active since we are working on the Save / load (Import/Export) part of this feature request.
The export to a JSON format will not be covered in this first part of the feature.

@ferBonnin
Copy link
Contributor

Thank you all for the insights on this feature request!
The Save and Load functionality is now available in Accessibility Insights for Web V2.27.0 (release notes) Please take a look and let us know what you think!

Command bar now has two additional buttons: Save assessment & Load Assessment

@ferBonnin ferBonnin added the status: needs author feedback This issue requires additional information from the issue author. label Jun 2, 2021
@ghost
Copy link

ghost commented Jun 2, 2021

The team requires additional author feedback; please review their replies and update this issue accordingly. Thank you for contributing to Accessibility Insights!

@ghost ghost removed the status: active This issue is currently being worked on by someone. label Jun 2, 2021
@mgifford
Copy link

mgifford commented Jun 2, 2021

Ok, that's really exciting.

What I see for Edge is still Version 2.26.1 - Updated 24 May 2021

On Brave though, after I deleted the extension & re-loaded it it worked fine. Is there no auto-update process?

Anyways, wow. So this now saves a JSON formatted file like SavedAssessment_20210602_HomeCivicActionsAcce.a11ywebassessment

With a title that would allow someone to pretty easily find it. Does your .a11ywebassessment format follow the EARL structure? It's all based on WCAG Accessibility Conformance Testing (ACT) & Evaluation and Report Language (EARL).

If so this would make it much easier to import into something that just leads nicely to a VPAT. I'm assuming that's part of the goal.

Edit:
I want to be able to just upload a page to WCAG-EM https://www.w3.org/WAI/eval/report-tool/#!/

@ferBonnin
Copy link
Contributor

Hey @mgifford glad you like it!

Is there no auto-update process?

We just released a few hours ago, both Edge and Chrome should auto-update after a few hours.

Does your .a11ywebassessment format follow the EARL structure?

No, we divided this feature request into two parts:

  1. allow users to save & load an assessment so you can do things like import the results back in Accessibility Insights, update the assessment if you find something later (or if you fix something), do multiple assessments at the same time and have someone else review/ complete an assessment.
  2. the second part would be a JSON file format to enable scenarios like uploading to a VPAT.

@adbajaj
Copy link

adbajaj commented Jun 2, 2021

Thank you all for the insights on this feature request!
The Save and Load functionality is now available in Accessibility Insights for Web V2.27.0 (release notes) Please take a look and let us know what you think!

Command bar now has two additional buttons: Save assessment & Load Assessment

I am doing the happy dance right now. Thank you and very excited! Here's to efficiency! =)

@mgifford
Copy link

mgifford commented Jun 3, 2021

@ferBonnin I'm especially interested in hearing about the 2nd part. Very interested in efforts to aggregate findings into VPAT documents.

@ghost ghost added the status: no recent activity This issue requires additional information from the author, but hasn't been updated recently. label Jun 7, 2021
@ghost
Copy link

ghost commented Jun 7, 2021

This issue has been automatically marked as stale because it is marked as requiring author feedback but has not had any activity for 4 days. It will be closed if no further activity occurs within 3 days of this comment. Thank you for contributing to Accessibility Insights!

@mgifford
Copy link

mgifford commented Jun 7, 2021

In looking at the original request, it looks like with V2.27.0 we can close this.

I am wondering about setting up a new issue though to focus on having a more standardized EARL report that could be part of a broader VPAT or WCAG-EM process.

@ferBonnin ferBonnin added the status: resolved This issue has been merged into main and deployed to canary. label Jun 9, 2021
@ghost ghost removed the status: needs author feedback This issue requires additional information from the issue author. label Jun 9, 2021
@ghost ghost closed this as completed Jun 12, 2021
@ferBonnin ferBonnin removed the status: no recent activity This issue requires additional information from the author, but hasn't been updated recently. label Jun 14, 2021
@ferBonnin
Copy link
Contributor

Keeping this open for the second part of this feature request

@mra11yx
Copy link

mra11yx commented Jun 23, 2021

Created a new feature request to specifically address the second part: #4398

@ferBonnin
Copy link
Contributor

closing this issue since there are two feature request for the second part:
#4398 and #4331

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
feature request status: resolved This issue has been merged into main and deployed to canary.
Projects
None yet
Development

No branches or pull requests