whatdotheyknow-theme icon indicating copy to clipboard operation
whatdotheyknow-theme copied to clipboard

Survey issues and feedback

Open RichardTaylor opened this issue 3 years ago • 19 comments

User feedback:

Sorry cant fill in your form. I have made several requests so I am not sure which one you refer to

This doesn't appear to be a completely unreasonable response given the text:

We would like to know more about you, and your experience making an Freedom of Information request through the site.

Also I note "an Freedom of Information request" should be "a Freedom of Information request".

This survey invite was sent to someone who has made many tens of requests over three years.

cc @ajparsons

RichardTaylor avatar Aug 04 '21 12:08 RichardTaylor

I've amended to the title description to tell people to answer with their most recent request in mind.

I've also adjusted the wording for some of the earlier questions to fit more easily for batch requests.

The email template looks like it says:

Four weeks ago you made a Freedom of Information request to ' '{{public_body_name}} using {{site_name}}.

If we get more of this confusion, could include the request name here.

ajparsons avatar Aug 04 '21 14:08 ajparsons

The email template looks like it says:

Four weeks ago you made a Freedom of Information request to ' '{{public_body_name}} using {{site_name}}.

Presumably the {{public_body_name}} shouldn't be outside of the quotes? Is that a typo here or a bug that needs fixing?

garethrees avatar Aug 04 '21 15:08 garethrees

Further feedback:

As we make many such requests we would need to know which one this refers to. Perhaps you could include a url to the actual request.

Previously on this thread we have:

I've amended to the title description to tell people to answer with their most recent request in mind.

Presumably the outgoing email needs updating similarly?

RichardTaylor avatar Aug 06 '21 11:08 RichardTaylor

Presumably the {{public_body_name}} shouldn't be outside of the quotes? Is that a typo here

Typo. There are no quotes in the app source or Transifex

gbp avatar Aug 06 '21 11:08 gbp

A user has written:

I've just received an email from you 'Whatdotheyknow' asking me to complete a survey. I'm not sure this email is from you

The survey link is to a URL on the domain:

https://survey.alchemer.com

which isn't a survey domain I recognise .. it's not the typical surveymonkey or a Google form, and the URL contains lots of characters which might raise concerns.

Hosting the survey on the whatdotheyknow.com domain might improve confidence in it.

RichardTaylor avatar Aug 13 '21 13:08 RichardTaylor

I'm blaming Alchemer for rebranding to a less clear name (but also if you google it is a survey platform).

In the past, I have sometimes used a redirect under mysociety.org to tidy up long survey urls. Could explore something similar here, or possibly Alaveteli itself could redirect.

ajparsons avatar Aug 13 '21 16:08 ajparsons

Could explore something similar here, or possibly Alaveteli itself could redirect.

I don't think we want to add the complexity to Alaveteli, and there's every chance we'd get the same correspondence after an internal redirect has happened.

I'm blaming Alchemer for rebranding to a less clear name (but also if you google it is a survey platform).

Alchemer supports custom DNS, so that could be worth a look in to, but I don't think this warrants any action unless we receive lots of correspondence along the same lines.

garethrees avatar Aug 16 '21 08:08 garethrees

A perfectly reasonable response from a user to the survey invite, but one I thought I'd note here:

No, Thank You.

RichardTaylor avatar Oct 06 '21 15:10 RichardTaylor

User feedback:

survey is far too long.

FOIMonkey avatar Sep 13 '22 14:09 FOIMonkey

Is there a copy of the survey questions we can review?

WilliamWDTK avatar Sep 13 '22 20:09 WilliamWDTK

User feedback:

survey is far too long.

The same user has also said that:

It took 7 minutes to do the survey.

that:

that should be mentioned in the email.

And that there are:

Some odd and probing questions in there.

WilliamWDTK avatar Sep 13 '22 21:09 WilliamWDTK

Survey survey attached here: survey_5715101.pdf

I'm fairly happy with the number of responses we are getting - 1,400 responses in the just over a year it's been up - which feels good for it's length (and is double the survey we replaced last year). Also happy to schedule in a review given it's now been up a year.

I'd like to work towards getting the same monthly reports going for this survey we have for a similar survey on the climate website.

ajparsons avatar Sep 14 '22 09:09 ajparsons

I'm fairly happy with the number of responses we are getting

Nice!

Also happy to schedule in a review given it's now been up a year.

At the same time, don't let a handful of negative comments push us into doing work we don't need to do. We'll never make everyone happy. Just incorporate the feedback into the next natural round of updates.

garethrees avatar Sep 14 '22 09:09 garethrees

~~This is probably more about the email notification for the survey, but a user said that they didn't see why they needed to [complete it].~~

~~Our email just says it's to:~~

~~it will help us make the site better.~~

~~That doesn't really provide much detail, but maybe its not practical to put more…~~

~~They also said they weren't comfortable giving out personal information.~~

edit: I think this was giving personal information to the authority, not related to the survey.

WilliamWDTK avatar Sep 30 '22 19:09 WilliamWDTK

We've been contacted by a user who was confused when they got the survey link before a response was due from the authority, meaning there was no substantive response for them to give feedback on.

HelenWDTK avatar Jan 17 '23 08:01 HelenWDTK

got the survey link before a response was due

The survey alert doesn't imply that a response from the authority is necessary to answer the survey, but I do recall that being a common comment with the previous iteration of the survey.

We do want to survey people who haven't had a response, but I agree that maybe waiting until after the due date would be better.

garethrees avatar Jan 17 '23 09:01 garethrees

Didn't we push it back last year or is it still at 2 weeks? I've no objection to a longer wait.

ajparsons avatar Jan 17 '23 09:01 ajparsons

A user reported today that the survey was too long and that they abandoned part way through.

confirmordeny avatar Jun 19 '23 12:06 confirmordeny

+1

A user reported recently that they didn't know which request the survey pertained to, as they had made several requests, to the same body, within a similar period of time.

For ease of use, it would probably be helpful if a link to the request was in the email, even if we don't want to include it in the survey url itself.

mdeuk avatar Jan 06 '24 11:01 mdeuk