From “relevance” to the KPIs that measure communication quality & impact

Summary: In the long run the concept of “relevance” will undoubtedly replace the attempt to provide intranets that users can customise or personalise. Relevance targeting is driven by purposeful communications and clear objectives on the sender’s side. Evaluating the actual effect of distinct communication will allow communicators to continuously improve their skills and organisation to improve their channel mix and effectiveness.

Attending one of my client’s internal communications conference I felt inspired to document a workshop session with a little drawing:

Sending and Receiving in DWP

It summarises important aspects of the sender/recipient relationship. It furthermore hints to where the long sought for KPIs for internal communications and the Digital Workplace can be found.

The beginning: a purpose.

I truly believe communications without purpose should simply be banned from internal digital channels. Actually, thinking about it again, it should be banned from all channels, no matter if analogue, digital, internal or outside facing. The purpose of communications is usually driven by an over spanning objective. Purpose and objective create the foundation for “relevance”, the “reason-why” for the creation of a message and delivery to a particular audience. The tonality has to resonate on both and make sure that the core of the message is clear and easy to understand.

Practical example

Objective: reduce the risk of legal liability caused by wrongful handling of presents from suppliers.

Purpose: create awareness of a changed compliance guideline to the purchasing employees in Eastern Europe, Middle East & Asia.

Tonality: clear, straight forward, call to action (= go to the policy, read it, implement it) as the core element; background & change tracking should be stored in the context of the policy, not the communication, so it can be found even if people simply search for the policy itself and not the connected communication around it.

KPI for success measuring (Examples)

Deliver on communication purpose
  1. Unique visitors = effective reach of the message
  2. Distinct & scaled rating of the message = feedback for the senders on quality, clarity & relevance
  3. Click through rate = “conversion” from communication recipient to policy recipient
  4. Time on (destination/reference) site = recipient involvement with the reference material
  5. Receipt confirmation (if possible) = communication read & understood
Deliver on communication objective
  1. Quantitative evaluation of the implementation through line managers (read, understood, implemented)
  2. Cases of non-compliance in purchasing after the communications

Measuring success beyond media KPI

For a few years I have been chasing best practice and lighthouse solutions for success measurement in the context of intranet/DWP. So far the subject hasn’t really gotten the right attention and the majority of KPI we see in the field are “volume” KPI such as

  • members of a community or group
  • number of conversations
  • number of likes & shares
  • number of comments

To continuously improve the quality of Enterprise Information Management we have to deliver more insight to authors and publishers. The ones in charge for the mechanics and design of internal digital channels have to enable the ones in charge of the content to deliver on the requirements of all stakeholders. To date way too much guess work is involved.

How to get there?

Let’s simply stop asking for “analytics”. Let’s ask for Communications Insight & Intelligence. If I were in charge I would refuse to implement any KPI without a concept on

  • why measure? (reason-why)
  • how to report on the insight? (reporting format/frequency)
  • who will be reported to? (audience)
  • who is in charge of executing on insight? (accountability)
  • how shall KPI be interpreted? (figures > insight)

The last is probably the most important because at the end pure numbers mean nothing. The interpretation (and therefore the commentary for the report) is key for the actual execution on the insight. For that we have to pre-determine what particular figures mean and what has to happen with the learning, for example:

  • Low click-through
    > recipients only now that the policy is there but they don’t know the detail
    > implementation might fail
    > actively research through line management
  • Low time-on-site at the reference material
    > recipients only go to the site but don’t get involved
    > implementation might fail
    > actively research through line management

Why to pay more attention Communications Insight & Intelligence?

I believe that by implementing a more serious quality and impact measurement for internal digital channels we will achieve three things:

  1. Provide support to the governing organisation and enable them to iteratively improve the channel effectiveness
  2. Increase awareness for the fact that people have to pay attention to the alternative to e-mail communications
  3. Establish intranet/DWP as a work critical and essential part of the people’s work: the Good Morning for every day that you don’t want to live without

Who to talk to in the field?

Probably Philip’s Dennis Agusi is one of the guys in the field that has one of the best ongoing cases in DWP analytics. You can find him on Twitter: @DennisAgusi

Check out the tweets about is presentation at the Intranet Reloaded 2015 at #intrelEU (add his twitter handle to your search query to filter out the distinct tweets). But be aware: they hired a data scientist to pull off their attempt…

//platform.twitter.com/widgets.js

One thought on “From “relevance” to the KPIs that measure communication quality & impact

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s