I am really proud of my government colleagues for getting the data together to enable us to publish the very first report on the costs, quality and usage of central government websites. You can find it, along with all the data, on www.coi.gov.uk/websitemetrics2009-10

 Local government has been comparing like for like to benchmark for many years.  It is more difficult in central government as the audiences and functions of websites vary considerably.  Some are for the public (Diectgov, NHS Choices), for businesses (businesslink.gov.uk) and for public sector workforces (civil servants, teachers, armed forces).  And others are for people to engage with a particular organisation in policy formation (corporate websites).  While yet others have a regulatory function (Ofgem).

It’s made harder by some public bodies doing lots of syndication, placing information onto other websites where people regularly go, and early adoption of re-usable information and data, so that people can present it in new ways.  Both these result in people using the information, but not being recorded as visiting the website to do so. So the cost per visit is not related in any way to the cost per use, nor indeed the value to the user.

The data makes for interesting reading if not immediate analysis.  The notes that reporting public bodies have attached should be read in conjunction with the data.  However, some things do jump out.

One that struck me was the variation in cost for hosting and infrastructure compared to usage.  One wouldn’t expect a bell-shaped curve, as some sites need to have much more resilience and security than others, but if a free competitive market was really in operation, then one would expect more clustering around a few price points.

The other areas of expenditure will vary more according to the stage of development.  This year you might spend a lot on design and build to bring it up to what people expect, next year perhaps very little. Per year websites tell you something, but are not the whole picture – but how much better than not having anything!  Having knowledge of the order of the cost is really helpful and, even taking out all those who didn’t get anything from their visit, the cost for each reach is very low compared to any alternative.

And we can begin to look at some other interesting aspects.  Does the spending made on testing and evaluation result in an increase in user satisfaction?  By releasing the data, we’re keen to see what use people make of it and how they can add insight into the variety of questions that arise. Ross Ferguson, for example,  has done a visualisation of the number of yearly unique visitors/browsers (a figure that not everyone could provide as it requires deduplicating across all the monthly data).

We know people are interested.  In the three and a bit days since publication, there have been 14,534 downloads of the PDF and 1,034 downloads of the CSV.  It’s been interesting too to follow the use of the official bit.ly tag that we tweeted and discover where people find where the data is.  We’re looking forward to seeing what people do with it.

In terms of numbers, 46 is a very small sample.  Next year all the open central government websites are due to report and it doesn’t seem sensible to issue a report simply listing the data as we have done this year.  (We will of course issue the data as a dataset.)  How people analyse the data will help shape the human-readable report.

Let us know what you’re doing, and what you’d like to see.

Read 8 Comments »

The British Standard for Web Accessibility BS8878 has been published as a second draft and is available for comments until 30 June 2010.

As part of its ongoing involvement in the development of digital policies and standards, COI has worked with the likes of BBC, RNIB, IBM, Lloyds-TSB and Nomensa to develop this standard.

The Government has already adopted PAS 78, through TG102 Delivering inclusive websites, requiring websites to have and accessibility policy detailing the process for maintaining website accessibility over time. BS8878 builds on PAS 78 and provides a comprehensive approach to delivering web accessibility.

It’s not a technical standard with a strict set of criteria for compliance. It’s a process standard dealing with organisational responsibilities for ensuring web accessibility and looking at the entire production process including:

• Procurement
• Design and evaluation
• Maintenance
• Managing feedback

It also covers topics such as the UK Equality Act 2010 and the use of personalisation to deliver inclusive websites.

The standard is not a replacement of existing web standards, namely the W3C Web Content Accessibility Guidelines (WCAG). Rather, it is meant to work alongside WCAG 2.0 and link to it where appropriate.

There is still time to get your comments in on the BSI website, so please tell us what you think. We know there’s still room for improvement.

Be the first to comment »

Noun qualifiers of other nouns are ambiguous, especially when there are two or more.  Newspaper editors know this – they use them extensively in their headings, as research shows that people interpret them in different ways.  It helps persuade the headline skimmer to read, or at least start to read, the article.

The one that bugs me most is ‘content management system’ (CMS).  Two different noun qualifiers, but which qualifies which of the three?  From my experience they are content systems and management systems but rarely a system for managing the aggregated collection of content.  Let me explain.

Many of the larger CMS come from an enterprise background where the task was to get in control of the many documents wandering around.  They have a lot of functionality including nifty conversions from one format to another.  And good tracking of where these documents are.   They also often contain many tools for managing the workflow in their production, authoring, approving and publishing.  The last is usually done by moving to a pre-publication area with a publisher role making the final act of releasing to the intended audience.  Then Web came along and a functionality was added to send to a website.

There are also many content systems that store words, pictures and other media, in a structured way in a database and then publish to the Web by adding in (X)HTML coding and style sheets and, if the developer is smart, rules for displaying one or another type of content depending on the situation in the system or type of viewer.  These come from a background of Web publishing and although they do that well, they usually don’t offer tools that work across the database.

What we need in government though is the third – content management:

• ‘Give me all the content that does not contain an entry in a particular metadata field and list with the contact emails of the authors.’
• ‘List all the pages that have been viewed only by internal staff.’
• ‘Find all the content containing expression X and change to Y and add to a new metadata field’

And, most of all,

• ‘Extract out all the content according to these rules, structure them in this particular way and send to go off to another CMS’.

It’s all do-able but so much hard work at present.  We should have easy interfaces to manage content.  I care, because we have many talented digital media staff in government (maybe not enough, but they are certainly there), who waste much of their time and effort in struggling with getting content in and out and between CMS’s. Usually because there is so little functionality to manage content across the whole collection and because exchange between systems is so difficult.  There must be a much better way of doing this and so releasing government and public sector expertise to contribute to the public agenda.  I’m carrying a banner to all those providers of CMS and web publishing services to say ‘Free our digital media experts!’

By doing more information structuring and using common structures, as we’ve been introducing for jobs and consultations, and have been done for a long while in press releases and descriptions of documents, we should be able to build systems that easily exchange information when there are machinery of government changes and that make it easy to manage the content. (And, of course, add in semantic web coding in a supported way!)  Then we might be able to start describing systems as those that enable and facilitate content management.

Read 24 Comments »

A big thank you and well done to everyone who contributed to a great event last Thursday.

30 people from Government executive agencies and non-departmental public bodies (NDPBs) came to find out about website auditing.

Attendees were given an introduction by Alex Butler, COI’s Transformational Strategy Director. Alex told how this work came about as the result of the National Audit Office (NAO) report Government on the Internet (July 2007). The NAO report found that:

• a quarter of government organisations did not know the costs of their websites
• 16% had no data about how much their websites were being used
• quality standards had only improved slightly since 2002

Alex explained how the audits form part of a package of improvements offered by COI including standard measures for website quality, value for money and usability. These measures form part of the requirement by the Public Accounts Committee for greater accuracy and transparency in how the Government manages its investment in digital media.

Those present then watched a short clip of COI Chief Executive Mark Lund’s presentation at the Internet Advertising Bureau event IAB Engage 2009. Mark describes the work COI is doing with the Cabinet Office and other parts of Government in setting standards and evaluating the cost-effectiveness government websites.

Richard Foan, ABCe’s Managing Director, then talked through the details of website auditing. Richard emphasised the need for standards in an industry where there are so many different methods, metrics and tools to choose from. He explained that ABCe are an independent non-profit organisation, auditing to industry standards. ABCe certify that government websites comply with the standards and measure website usage in a consistent way.

The question and answer session that followed was lively and yielded some useful actions:

• We are planning an FAQ page on the COI website based on the questions asked
• Technical guidance will be available from the planned FAQ page but also from this page: TG116a ABCe Audit (PDF, 541 kB) and Guide to Google Analytics Mirror Method (PDF, 157 kB)
• Follow up meetings will be arranged with those who requested them
• Slides from the event are available from this page (PDF, 1.5 MB)
• Access to the Government Website Database is available by contacting graham.phillips@coi.gsi.gov.uk

Thanks to all those who attended, I hope you found it useful. And thanks particularly to Linda who worked the floor extremely well and made a star entrance!

For those who missed the event, we are planning to do similar events in the future. But in the meantime hopefully this blog article gives a flavour of what took place.

Read 6 Comments »

Some meanings of words change over time.  Take ‘scan’ for example.  That used to mean reading something systematically giving attention to every word in order.  Thus when people talk about scanning a newspaper in the 19^th Century, they mean someone read it all starting at the first word and going through to the last.  Yes, really, that’s what people used to do.  We still imply that version of the word when referring to ‘scanners’.

But there was deviation into another meaning.  The same task was used by sailors to scan the horizon – systematically looking around it for shipping or land.  This gradually shifted to the question being asked – is there anything interesting to see?  And that’s the meaning we generally attribute to the verb nowadays.  A quick glance or skim over something to see if there is anything that grabs our attention.

Well why is this relevant to the usual subject covered by this blog?  Because we sometimes mistake when people are scanning or scanning.  And it is important in getting people to the information or service quickly.

People quickly scan (in the second sense) and recognise something familiar in search results lists.  So seeing something in a search results list that says it is on Directgov, for example, should signal to the reader that they can trust it as authoritative, that it will be easy to read (because written for them) and that it will point people to other relevant content to their need.

Building brand is important to enable people to quickly skim over something and determine what they choose.  It is also important in memorability.  That’s why the guidance insists on avoiding sub-domains and using directory structure.  In plain words, avoiding URLs of the form YAA.website.gov.uk and instead using website.gov.uk/YAA.  The human brain does something different in the two cases.

In the former, one registers the YAA (standing for Yet Another Acronym) and then tends to forget the rest.  If that is what we want people to do, then using instructions such as ‘Search for Change4Life’ is a more effective means.  We’re increasingly using that to focus people on major campaigns.

However, if we want people to find it easily on the Web, then saying you’ll find it on Directgov, or wherever, is more effective – and the form direct.gov.uk/YAA does exactly this.  It both uses and builds the brand.  And if it is really current, it will be on the home page.

Sub-domains may be the technical means to delivering services and packaging content into useful and manageable chunks as part of internal processes, but for marketing the directory structure is much more helpful to get people to what they’re looking for.

Read 15 Comments »

COI guidance TG124 Structuring information on the Web for re-usability is now re-issued as version 1.2.  Diligent implementers have identified two small errors in version 1.1 and these have now been corrected.  They were correct in the examples on the Google Code website and only incorrect in the abstracted guidance.

The first correction is in paragraph 31.

Old version

<div about="#this"
  typeof="foaf:Document"
  rel="dc:type" resource="[argot:Consultation]"
  >
 ...
</div>

Correct code

<div about="#this" typeof="foaf:Document">
  <span rel="dc:type" resource="[argot:Consultation]"></span>
...
</div>

Notice how the @rel attribute is in a separate span element.

There is a similar correction in paragraph 34.

Old version

<div about="#this"
  typeof="foaf:Document"
  rel="dc:type" resource="[argot:Consultation]"
 >
  <span property="dc:publisher" content="Ministry of Justice"></span>
 ...
</div>

or even merged onto the first element:

<div
 about="#this"
 typeof="foaf:Document"
 rel="dc:type" resource="[argot:Consultation]"
 property="dc:publisher" content="Ministry of Justice"
>
...
</div>

Correct code

<div about="#this" typeof="foaf:Document">
 <span rel="dc:type" resource="[argot:Consultation]"></span>
 <span property="dc:publisher" content="Ministry of Justice"></span>
...
</div>

or even merged onto the first element:

<div about="#this" typeof="foaf:Document"
 property="dc:publisher" content="Ministry of Justice">
 <span rel="dc:type" resource="[argot:Consultation]"></span>
...
</div>

Apologies for the changes. If you have any questions, please contact me at adam.bailin@coi.gsi.gov.uk.

Read 1 Comment »

It’s a new year and here at COI the digital policy team have loads of exciting events and projects coming up.  I’ll tell you all about that in a minute.  My first priority is the government website audit project.  I’ll remind you  just in case you have forgotten what the project is all about. The Public Accounts Committee (PAC) in their Sixteenth Report recommended that Government develop a single set of reporting metrics for website usage. The Government agreed and made it mandatory for all government websites to be audited. Hence the Government Website Audit project.

We have an event coming up in London on the 21^st of January aptly named “Auditing Government Websites”.  Speaking at the event is our very own Alex Butler, COI Transformational Strategy Director, and ABCe’s Managing Director Richard Foan.  The event is aimed at government agencies (EAs) and non-departmental public bodies (NDPBs) and will cover the following topics:

• importance of auditing
• industry standards for measuring websites
• how to get ready for the audit
• the audit process (pre audit and post audit)

The event provides an opportunity for government agencies and NDPBs to audit their websites for approximately half the amount if procured independently. What better way to start the year? The event is free and registration for the event and the audits are pouring in, so register now and make your websites 2010 compliant.

Please email me at linda.morakinyo@coi.gsi.gov.uk if you would like to attend.

Hope to see you all at there.

Invitation to auditing government websites event 21 Jan 2010

Read 1 Comment »

 What is a URI?  This is the question a colleague asked me yesterday.  Of course, he knew what it stood for (Uniform Resource Identifier), but he was asking what it was for and why they are interesting to government.  The initial answer is that it is essential for the idea of Linked Data, it is the process through which one bit of information is linked to another bit.  But I wanted to dig a bit deeper and explain the kinds of use of Linked Data that the government has in mind.

The Web is basically a document standard – a description of what constitutes a Web page, together with a process for describing it’s location (the URL) and so of linking from one to another.  When you do a Web search, for example using Google or Bing, then you get a list of documents in which the information you seek might be in. 

A URI enables a unique way to identify a particular bit of data inside the Web page, and so link one bit to another.  Thus it might be useful to distinguish London-the-place from the other London-the-places and from the several authors with surname London.  We can get some way towards this by intelligent contextual analysis, the approach that Microsoft, for example, told me they are taking.  This involves heavyweight data crunching using search technologies.  The URI approach is to identify something as distinctive,  for example, London the place in this particular geospatial location, and then give it a URI that others can use to refer to it to disambiguate it from all other occurrences of the concept or word.

This is the core idea of a URI, that a place, event, person, concept, document, or whatever can be given a unique identifier that others can use.  Of course you need to do something more than that, as Sir Tim Berners-Lee describes in his four steps:

1.  Use URIs as names for things
2. Use http URIs so that people can look up those names
3. When someone looks up a URI, provide useful information using the W3C standards (RDF, SPARQL)
4. Include links to other URIs so that they can discover more things

 I usually add one more:

5.  the provider of a set of URIs provides a Lookup service to take the object being named and provide a URI for it (i.e. the converse of 2.)

 So what would be useful for government to do?  One fruitful area to explore are those things that come and go, or move around, or change.  For example MPs get appointed to serve in HM Government and then move around.  Giving each MP a URI so that every time a press release reports their activities would be helpful, particularly as they are often described in different ways.  Clicking on a URI link could take you to a page of information about them – for example their biography, committees they serve on etc, or, with a little macro on the side, a set of relevant links about them.  And then there might be URIs for Departments.  They come and go – when were they in existence?  What were their responsibilities?  Is there archived content about them?  What is the current list of Departments? That kind of information we know would be useful to provide, as we get asked for them

Those are two examples of sets of URIs that government could usefully run:  the MP names, and the list of Departments.  Another might be the roles that comprise HMGovernment, i.e. the Ministers.  Clearly at local government level the set of Local Authorities would be one that would be useful, so that one person referring to a public body would know it was the same one that another called by a different name or abbreviation. 

The government has developed a draft standard for designing sets of URIs and we are now exploring what core sets of URIs it would  be useful to provide.  Let us know and we’ll see if we can do so.

Read 4 Comments »

How do you evaluate the cost-benefit of the government’s digital engagement?  As a result of the Improving government online review of measurement standards, several interesting discussions were started around extending the work on valuing and evaluating websites to all digital media.

Evaluation is a key priority for Government communicators. Matt Tee, Permanent Secretary and Head of Profession Government Communications, has prioritised evaluation as a key area of focus, along with skills and behaviour change. This is not surprising given the current economic climate. Government has to account for every pound spent and that means evaluating our communications activity to demonstrate cost-effectiveness.

Matt Tee has also requested that every government department develop a digital engagement strategy by March 2010, alongside the Public Accounts Committee recommendation that every department has a channel strategy, – a sign that digital engagement is being taken seriously.

So, how do we measure it?

As with any marketing communications activity, that depends on what the communications objectives are. However, there are commonalities across different campaigns and across different digital engagement tools and it’s those that I want to explore.

Recently, I’ve been working with colleagues in COI on this problem and we’ve come up with three common measures that appear to work across all digital engagement or social media tools:

1. Number of relationships
2. Number of user-generated content items
3. Number of referrals/recommendations

1. Number of relationships

The number of relationships or connections within a network is a measure of power or influence. For example, it could be the number of followers on Twitter, number of friends in Facebook or the number of subscribers to a blog. In social network analysis, this is the basic measure of centrality within a network, which is called degree centrality.

There are other interesting measures of power within a network. For example betweenness centrality measures the degree to which a member lies between other members of a network. In the Facebook analogy, a person may have 1000 friends but have less influence than a person with 50 friends, each of whom have 1000 friends.

Betweenness centrality from red (lowest) to blue (highest)

2. Number of user-generated content items

The number of user-generated content items measures participation within the network. For example, it could be the number of comments on a blog or the number of videos uploaded to a Youtube channel. It measures the level of engagement of an audience, suggestive of active participation not simply passive interest.

3. Number of referrals/recommendations

The number of recommendations is what many seek. This measures virality, advocacy, recommendability. For example, it could be the number of retweets, the number of  ‘share this’ actions or the number of pingbacks. It goes beyond mere participation; it means your content or message is valued enough to be recommended to others inside and outside the network.

We would be very interested to hear any thoughts on this. Many people are starting to think through return on investment in this area and it would be useful to have some level of consensus before applying to the government’s use of digital media for engagement.     Let us know what you think.

Read 10 Comments »

The title comes from a recommendation of the Power of Information Taskforce.  They commissioned our team at COI to undertake a usability review of government websites, as our mission  is to improve the quality and consistency of government and the public sector online.  

The usability review found that there were many basic issues with the sites they looked at. Over 150 individual usability problems were identified including:

• Failure to let users know where they are in the site
• Inconsistency in page design putting undue stress on the user to recall rather than recognise (increasing cognitive load)
• Use of language that users couldn’t understand
• Linking to documents without clues to the content within

The Taskforce asked us to build a ‘usability toolkit’ setting out the basic usability criteria for government websites. Working with usability agency Bunnyfoot, we’ve developed a toolkit containing guidelines on best practice.  The toolkit has an emphasis on visual learning, making extensive use of graphics and video demonstrations and is designed around eight themes including page layout, navigation and writing content. Each theme has an interactive self-assessment exercise which tests knowledge and is intended to initiate discussion.

The toolkit is open to everyone to use, but there are advantages in registering as this helps users keep track what the content they’ve visited and the assessment tests they’ve completed.  So far 85 people have registered from over 20 different departments across government.

The most popular completed test to date is on page layout (123 completed tests).  It has guidelines about:

• Consistency between pages
• Devoting page space to content
• Screen resolution
• How to un-clutter content
• Styling text for readability
• Effective use of colour

It’s basic stuff but essential knowledge for anyone developing content for government, public sector, or inideed any other websites. There’s also a great video showing how we read text using eyetracking:

So, if you’re in the public sector, don’t waste another minute, register to use the toolkit! It’s easy, you just need to enter an email address and password and, if you work in central government, your department name.

Read 4 Comments »