AdvisoryCommittee/member survey items

From W3C Wiki

This wiki collects and develops the items that should be asked in the W3C Member Survey 2023.

Reference: Member Value Survey 2020 created by the Advisory Board, and the WBS

IETF Community Survey 2021 (from Wendy Reid)

Membership committee and survey, 20240130 AB f2f discussion

Notes

  • Ask as few questions as possible
  • Start with questions that are easy to answer
  • Be anonymous, not using WBS
  • Invite W3C account holders from member organizations to respond, not just AC Reps
  • Collect input from all members, not just AC Reps
  • Separate business side from technical side
  • No questions for those involving budget
  • Don't forget - what we want to hear from members
  • Interview each individual?

Target

The target will vary depending on "what" W3C wants to hear about. The significance of existence may diverge between members and the general community, and the results of the same survey items may confuse the measures that W3C should take. Should we start with member survey first?

  • AC Rep
  • All participants from member orgs
  • CG participants?
  • Web communities?
  • Individual?

Survey Format

Survey Monkey

  • Pros
    • The paid plan allows us to place an unlimited number of questions per survey.
    • The results of the collected survey responses can be tabulated and graphed directly on Survey Monkey. From this, we can smoothly proceed from the collection of answers to the analysis of the results.
    • You can easily create a survey in a few minutes. Depending on the purpose of the survey, the questions need to be set up in advance to some extent.
    • Numerous survey templates and questions are available.
    • Because of the high level of security, the contents of the survey will not be leaked in advance, nor will the collected survey results be leaked. Communications are also highly encrypted so that the source of respondent access cannot be identified. The international advanced security standard ISO27001 has also been acquired.
    • Can be linked to GEM in the future and used to build relationships with members.
    • Email support is available.
  • Cons
    • You can set up to 10 questions per survey with the free plan but the number of responses that can be displayed is limited to 40.
    • The free plan has a very low degree of design flexibility. No customization of design, such as placing your own logo on the survey form.
  • Price
    • about USD 41 / month (about USD 492 annually)
    • 1,000 responses per month
    • Unlimited number of collectors
    • Mobile apps for iOS and Android
    • 24/7 email support + expedited email support
    • Add logo

Google Form

  • Pros
    • Free of charge
    • No limit on the number of forms created or answered
  • Cons
    • Less flexibility in design and response format customization.
    • Aggregate function is not available.

W3C WBS

  • Pros
    • Free of charge
    • Team already has knowledge of creation and operation
  • Cons
    • Cannot post without name
    • Aggregate results cannot be viewed in visualized graphs, etc.

Typeform https://www.typeform.com/

Qualtrics https://www.qualtrics.com/au/

Question Items

General questions (In no particular order at this time) The questions will vary depending on the goal. We might want to first target members only, and the goal would be "Are members satisfied with W3C's initiatives, processes, and tools?" We can ask from specific items, and consequently identify "what" members are satisfied with and "what" they are not satisfied with in W3C. Based on the results, W3C would like to take measures to improve member satisfaction.

  • Why did your organization join W3C?
  • From which region are you participating?
  • How many years have you been participating in W3C?
  • Which W3C groups have you participated in so far? (WG, Advisory Committee, IG, BG, CG)
  • Have you ever been unable to attend a conference call due to timezone issue?
  • There are currently 3 separate conference AB-led calls: Asia Friendly, North America Friendly, and UTC Friendly. However, there is a possibility of splitting the members into only specific regions. Would it be better to rotate the conference calls and provide an opportunity for global members to come together?
  • Are you satisfied with W3C?
  • Are you satisfied with your involvement?
  • Does W3C provide technical information at the best time for you?
  • Does W3C provide membership administrative information and tools at the best time for you?
  • Are there any barriers to participating in group activities?
  • Are you getting constructive feedback from W3C discussions?
  • Is W3C technology the standard of excellence in the market?
  • Does the W3C discussion lead to innovative solutions?
  • Are you getting a return on your membership fees?
  • Do you think W3C standards are important to society?
  • Do you think W3C is recognized by society?
  • Do you communicate with members in your country?
  • Do you want to communicate with members in your country?
  • Would you recommend W3C membership to your customers?
  • What do you expect from W3C? [Global standardization of technology, Information acquisition, Member community networking, Support in timely manner, Consulting for your business, Human resource development, Social standing for participation in W3C, Improvement of technical capabilities, Gain knowledge...]
  • Do you have easy access to the W3C administrative team?
  • Would you like to have local member meeting?
    • Interaction with other members
    • Getting information
    • @@
    • @@
  • Please tell us about the health rule for W3C events (AC meeting, TPAC)
  • OSS projects outside W3C?

Questions for technical side

  • Is the Working Group's output valuable?
  • Does W3C's work benefit your business?
  • Do you want more opportunities to interact with the web developer community outside of CG?
  • Do you have easy access to the W3C technical team?

Things not need to ask

  • W3C Strategy
  • W3C mission, goals
  • Vision
  • CoC