ICT Perspectives (an ICT Next Decade proposal)

Lead Research Organisation: Heriot-Watt University
Department Name: S of Mathematical and Computer Sciences

Abstract

This project will provide new ways of viewing EPSRC's ICT (Information and Communications Technology) portfolio to enable researchers, EPSRC staff and other stakeholders to better contribute to ICT strategy.

The project is divided into two main stages. The first will develop new 'Perspectives' on the current portfolio based on existing 'Grants on the Web' data, the second will use spinout workshops to kick-start the use of the Perspectives and provide feedback on best practice from cross-ICT meetings.
In the first phase we will use text mining and simple visualisation techniques to provide 'at a glance' overviews of the portfolio in the form of word-clouds or similar intuitive presentations. All terminology will be derived from the community, either from the grant summaries and titles or by canvassing the community directly. The 'at a glance' views will also provide the top level of an intuitive navigation system which will allow users to rapidly drilldown to project and investigator descriptions using the natural structure inherent in 'Grants on the Web' and derived using text mining.

As well as being viewable on the web these Perspectives will also be available as a set of standalone materials and associated tools for ICT strategy and Network workshops. They will provide an accessible overview of the portfolio and its natural structure. The latter will be presented in interactive dendrogram form to allow easy partitioning for scoping more detailed workshop breakout sessions.

The second phase of the project will focus on networking. Six 'spinout' workshops will be organised by open call that will make use of Perspectives' materials and tools to facilitate brainstorming and road-mapping type activities. Meetings that bring together two or more Networks will be especially sought.

Planned Impact

We believe that the most important impact will be on future ICT research as the project aim is to transform the way in which researchers, and other stakeholders, contribute to the formulation of strategy. The project will provide the type of structured overview, expressed in the community's own terms and derived from the community's own data, that will enable participants to contribute efficiently, collegiately and meaningfully to such processes.

Furthermore, we believe that the creation of snapshot Perspectives for other EPSRC, Research Council, and possibly EU Framework sectors, has significant potential both to promote ICT and allow the project to be of significant use to a much wider audience.

Publications

10 25 50
 
Description This project is developing novel data mining and meeting tools to help Research Council staff and researchers collaborate across councils and projects. The data mining is used to discover the latent structure of, connections between, research projects of projects funded by NSF and UK's Research Councils (EPSRC, ESRC, BBSRC, NERC, AHRC, MRC, and STFC).
Both of the major outputs are already having major impact.
ReseachPerspectives.org provides topic modelling, data mining and visualisation of 180,000 UK & US grants. This software is now being ported to EPSRC internal project and is viewed daily by many research organisations.
Well-sorted.org is a pre-meeting tool that helps experts suggest and remotely structure research ideas BEFORE the meeting. Since release in Jan 2014 it has been used twenty major meetings of 20-80 stakeholders and has had over 6000 items and over 1500 sorts submitted. Users include EPSRC, AHRC, MRC, ESRC, RCUK DE, BT, UKHDAN, and Innovate UK.
Exploitation Route Both ReseachPerspectives.org and Well-sorted.org are in constant use for a wide range of activities. The main mechanism for dissemination is attendance and/or use at Research Council network and strategy development meetings. In the last couple of months this increase has been exponential in nature, requiring us to automate some of the manual procedures.

These approaches solve generic problems and are applicable to almost all sectors.
Sectors Aerospace, Defence and Marine,Agriculture, Food and Drink,Chemicals,Creative Economy,Digital/Communication/Information Technologies (including Software),Electronics,Energy,Environment,Financial Services, and Management Consultancy,Healthcare,Government, Democracy and Justice,Manufacturing, including Industrial Biotechology,Culture, Heritage, Museums and Collections,Pharmaceuticals and Medical Biotechnology,Retail,Security and Diplomacy,Transport

URL http://researchperspectives.org/
 
Description The tools have been used by EPSRC, AHRC, MRC, ESRC, RCUK DE, BT, UKHDAN, and Innovate UK and many networks of academics. Continuing and expanding use by above.
First Year Of Impact 2016
Sector Digital/Communication/Information Technologies (including Software),Education,Government, Democracy and Justice
Impact Types Policy & public services

 
Title Research Perspectives 
Description Topic modelling, data mining and visualisation of 180,000 RCUK and NSF grants. 
Type Of Technology Webtool/Application 
Year Produced 2011 
Impact In use by many Resreach Councils and research organisations. 
URL http://www.researchperspectives.org
 
Title Well-sorted.org pre-meeting brain-storming and meeting organisation tool 
Description Online Card Sorting - specifically designed for support of strategy generation and other large meetings of experts. 
Type Of Technology Webtool/Application 
Year Produced 2014 
Impact In use by MRC, AHRC, EPSRC, ESRC, BT, InnovateUK 
URL http://www.well-sorted.org/
 
Description 'CRM...R.I.P.' Workshop (The Academy of Marketing's SIG in Customer Relationship Management and Services Marketing) 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Professional Practitioners
Results and Impact Approximately 30 people attended to discuss the role of Customer Relationship Management in an increasingly digitalised commercial environment, using our remote sorting tools to help structure thinking and discussion.

The attendees were able to build a better picture of their interest area and share information between academia and industry, while aiming to promote future workshops and collaborations.
Year(s) Of Engagement Activity 2013
URL http://www.researchperspectives.org/meetings/CRMRIP2013/
 
Description AHRC Digital Transformations Event 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Other academic audiences (collaborators, peers etc.)
Results and Impact Attendees from ARHC funded research attended the event to discuss how the AHRC could contribute to the Digital Transformations Theme in the future, prompted much debate and discussion on this, structured by our Well Sorted tool.

Both the output and input of the meeting has been documented for future use. The input which was structured using out Well Sorted tool is available as a PDF here:

http://www.well-sorted.org/explore/DigitalTransformations2014/documents/A4DelegateDocumentFinal.pdf

The groups from this were then used to for breakout discussion groups which fed back with 2 minute elevator pitches. These were recorded and hosted on Youtube, here: https://www.youtube.com/playlist?list=PLB-YaUclLgfMrZ2fpSmI3zS0Wu22CtkZj
Year(s) Of Engagement Activity 2014
URL http://www.well-sorted.org/explore/DigitalTransformations2014/
 
Description ARHC Seminar, London 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Professional Practitioners
Results and Impact Members of the AHRC attended a seminar to discuss the use of our Well Sorted and Research Perspectives tools at future AHRC organised meetings. This prompted many questions and discussion of future events.

The AHRC have now held an event using Well Sorted and others are planned.
Year(s) Of Engagement Activity 2014
URL http://www.well-sorted.org/explore/AHRCSeminarJuly2014/
 
Description Digital Economy Spring Strategy Meeting 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Other academic audiences (collaborators, peers etc.)
Results and Impact The Research Councils UK (RCUK) Digital Economy Theme was seeking to identify new priorities to help shape its future portfolio and strategic direction. Through the use of our tools, discussion about this complex topic was stimulated, structure and recorded.

The output of the meeting, including the pre-meeting and during meeting information submitted by the approximately 85 delegates was collected in a Digital Economy Strategy Meeting Landscape document, available here: http://www.well-sorted.org/explore/DESM2014/documents/DESMDocRelease1.0.pdf

In addition, there were several attendees who have expressed interest in using the tools in future.
Year(s) Of Engagement Activity 2014
URL http://www.well-sorted.org/explore/DESM2014/
 
Description EPSRC Healthcare Technologies Theme Workshop 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact Approximately 30 people from a variety of backgrounds (bluechips, SME, academic, independent) attended a workshop to discuss their structured answers to the question about the future of healthcare in relation to EPSRC research. Thanks to our work remotely sorting these answers, the organisers were able to get much more information and discussion our of their attendees.

Thanks to our tools, the organisers were able to use their attendees valuable time more fruitfully, getting more information about the important issues to industry and academia for use in future meetings and internal documentation.
Year(s) Of Engagement Activity 2014
 
Description EPSRC ICT Network of Networks Meeting 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Other academic audiences (collaborators, peers etc.)
Results and Impact The objective the meeting was to develop a conceptual map of research challenges addressed by the ICT Networks in order to aid the development of a better mutual understanding of:

a. the research coverage of the networks;
b. their research challenges and relationships;
c. potential inter-network collaborations; and
d. their coverage of the ICT research landscape.

The main impact from this meeting was the creation of an EPSRC Network of Networks Meeting Report which shed light on the coverage of the EPSRC networks in relation to their research and where possible overlaps might be.
The major items of the document are:
a. a structured challenge map;
b. an ICT topic map showing each network's research coverage;
c. a summarising chord diagram and individual network proformas that identify potential collaborations.
Year(s) Of Engagement Activity 2014
URL http://www.well-sorted.org/explore/NetworkOfNetworks2014/
 
Description EPSRC Impact Plan Topic Model analysis for EPSRC Council meeting 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Policymakers/politicians
Results and Impact Topic model analysis of the impact plans of 5,000 EPSRC research projects - in relation to the Healthy, Connected, Resilient and Prosperous Nation strategic themes.
Year(s) Of Engagement Activity 2017
 
Description EPSRC Network of Networks (NoN) and ICT Perspectives Meeting 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Other academic audiences (collaborators, peers etc.)
Results and Impact 30 academics and members of EPRSC met at a meeting we organised in conjunction with EPSRC to discuss the current research of the EPSRC ICT Networks, the progress of the Network of Networks meetings, and of Network 'best practice'. The day generated interesting dialogue and observations, as well as much discussion and questions about how best to present the Networks.

The awareness of the Networks of each other and of themselves to the outside world and EPSRC was increased, thanks to the attendance of approximately 20 of the Network leads. Plans for future Network of Network meetings were also decided. Finally, there was a increased awareness of possible data mining techniques which could be used on the EPSRC ICT portfolio
Year(s) Of Engagement Activity 2012
URL http://www.researchperspectives.org/meetings/meetingSeptember2012/
 
Description EPSRC Towards Intelligent Information Infrastructure (TI3) Meeting 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? Yes
Geographic Reach National
Primary Audience Other academic audiences (collaborators, peers etc.)
Results and Impact We were both an invited speaker to the EPSRC Towards Intelligent Information Infrastructure (TI3) meeting, and helped to organise the meeting via the use of our remote card sorting tools. This talk and sorting was used to help structure the meeting, resulting in improved networking opportunities and discussion.

The sorting we performed was an integral part of the meeting design, as attendees used the sorting as a starting point for discussions. In addition it helped form part of the EPSRC Workshop Report, available here: http://www.researchperspectives.org/meetings/meetingti3december2012/TI3WorkshopReport.pdf
Year(s) Of Engagement Activity 2012
URL http://www.researchperspectives.org/meetings/meetingti3december2012/
 
Description EPSRC Working Together in Information Communications Technology (ICT) Meeting 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Other academic audiences (collaborators, peers etc.)
Results and Impact Prof. Mike Chantler was invited by EPSRC to give a talk about the ICT Perspectives Project to approximately 200 academics and members of EPSRC staff. This generated many questions and much discussion about how to work out the subtopics in EPSRC ICT automatically.

The talk led to a much wider awareness of the ICT portfolio and the possible collaborations which were contained within. In addition, the talk led to important discussions which shaped the future of the ICT Perspectives Project.
Year(s) Of Engagement Activity 2012
URL http://www.researchperspectives.org/meetings/meetingMar2012/
 
Description First Digital Personhood Network Meeting 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Other academic audiences (collaborators, peers etc.)
Results and Impact The meeting was attended by a wide range of both project members and other stakeholders. Its purpose was to collectively generate a 'research landscape' for this area, identify potential joint impact activities, and have the funded sandpit projects report back their progress.

The resulting groups of challenges and impact activities were used to drive breakout sessions which generated the different sections of the Digital Personhood research landscape. In addition, the sandpit projects reporting was used to inform the Digital Economy of their progress.
Year(s) Of Engagement Activity 2014
URL http://www.well-sorted.org/explore/FirstDigitalPersonhood/
 
Description Further Well Sorted meetings (now over 100 meetings and approaching 10,000 ideas) 
Form Of Engagement Activity A formal working group, expert panel or dialogue
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Other audiences
Results and Impact Further Well Sorted meetings organised (@UK and Chinese universities, UK Research Councils and InnovateUK) see https://www.well-sorted.org/
Year(s) Of Engagement Activity 2015,2016,2017
URL https://www.well-sorted.org/
 
Description Further Well Sorted meetings - Used for over 200 meetings with over 15,000 ideas. Used by 5 research councils, InnovateUK, and 50 UK and international universities 
Form Of Engagement Activity A formal working group, expert panel or dialogue
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Other audiences
Results and Impact Well Sorted - support tools for strategy meetings of 20-100 senior stakeholders. It enables between 20 and 100 stakeholders to remotely contribute and jointly structure a research landscape or roadmap in an open, amicable, and democratic manner. The materials and groupings generated allow rapid organisation of focussed breakouts. We estimate that this tool improves the productivity of larger meetings by a factor of three and reduces the load on the organiser by a factor of 50. We engaged with EPSRC, ESRC, NERC, AHRC, MRC, InnovateUK, and 2 cross-research council funded projects (NEMODE and Digital Personhood under the Digital Engagement banner) in order to increase the use of Well Sorted to improve the stakeholder experience at meetings. In addition, we provided training (via two RCUK-wide seminars at Polaris House) to RCUK staff so they could hold their own meetings using the Well Sorted tool, and created new tools in order to help them in-meeting, as well as pre-meeting. We ran a RCUK-wide Well Sorted Meeting Owner's Workshop to discuss Well Sorted and get feedback on future developments and current best practice. In total Well Sorted has now been used for 205 studies, with over 3,800 sorts being performed on almost 15,000 items. It has also been used by over 50 universities (in the UK and internationally).
Year(s) Of Engagement Activity 2015,2016,2017,2018
URL http://www.well-sorted.org
 
Description ICT Early Career Researcher Workshop, Glasgow 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? Yes
Geographic Reach National
Primary Audience Other academic audiences (collaborators, peers etc.)
Results and Impact Around 50 early career academics attended a talk about how to present their research to those outside their immediate sphere and then performed networking events structured using our tools which helped them learn how best to explain/word their research to their peers.

Attendees got a chance to network with a wide variety of their peers and some reported a much improved knowledge of how to word and communicate their research to those not directly involved in their research area.
Year(s) Of Engagement Activity 2014
URL http://www.researchperspectives.org/meetings/ICTEarlyCareerGlasgow2014/
 
Description ICT Early Career Researcher Workshop, Oxford 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? Yes
Geographic Reach National
Primary Audience Other academic audiences (collaborators, peers etc.)
Results and Impact 60 early career academics attended a talk about how to present their research to those outside their immediate sphere and then performed networking events structured using our tools which helped them learn how best to explain/word their research to their peers.

Attendees got a chance to network with a wide variety of their peers and some reported a much improved knowledge of how to word and communicate their research to those not directly involved in their research area.
Year(s) Of Engagement Activity 2014
URL http://www.researchperspectives.org/meetings/ICTEarlyCareerOxford2014/index.php
 
Description ICT Perspectives and Network of Networks (NoN) Meeting 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Other academic audiences (collaborators, peers etc.)
Results and Impact 20 academics attended a meeting organised by us which encouraged discussion and dissemination of the EPSRC ICT Networks research. A round table discussion at the end of the day set the path for future activity both in our project and in how the Networks would meet and disseminate their research in the future.

This meeting increased awareness of the attendees of the EPSRC ICT Networks and the future plans for our Research Perspectives tool. In addition, this meeting directly shaped future Network of Network meetings and how they would disseminate their research in the future.
Year(s) Of Engagement Activity 2011
URL http://www.researchperspectives.org/meetings/meetingNov2011/
 
Description IT as a Utility: Network+ community conference 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Other academic audiences (collaborators, peers etc.)
Results and Impact We were invited to introduce our Well Sorted tool to the IT as a Utility Network+ members to engage them in discussion about possible future use.

We have had increased use of our tool, with members of the IT as a Utility Network both using it and coming to visit us to talk about possible future uses and collaboration.
Year(s) Of Engagement Activity 2014
URL http://www.itutility.ac.uk/ai1ec_event/it-as-autility-network-community-conference/
 
Description InnovateUK strategy development meetiing 
Form Of Engagement Activity A formal working group, expert panel or dialogue
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Professional Practitioners
Results and Impact Well Sorted event for InnovateUK
Year(s) Of Engagement Activity 2017
 
Description MRC Advisory Group Meeting 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Other academic audiences (collaborators, peers etc.)
Results and Impact A mixture of attendees from industry and academia attended an advisory group meeting which was structured with the help of our tools to discuss the issues surrounding maintaining health and independence in old age.

The organisers from the MRC were able to get a useful overview of what industry and academia thought were the main issues in this area, and they have expressed a desire to use the tools again in the future.
Year(s) Of Engagement Activity 2014
 
Description NEMODE Community Meeting 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Other academic audiences (collaborators, peers etc.)
Results and Impact Before the meeting, all attending delegates were invited to take part in a remote, online study where they arranged the themes submitted by their peers into groups. This grouping information, combined with some simple ICT techniques, allowed the planned breakout sessions to be structured and community led.

This activity lead to the creation of a NEMODE Research Landscape document, showing what the community thought the shape and interests of the NEMODE network were, and which could be used as input to future NEMODE community meetings.
Year(s) Of Engagement Activity 2013
URL http://www.researchperspectives.org/meetings/meetingJuly2013/index.php
 
Description Presentation to AberdeenStandard 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Industry/Business
Results and Impact Presentation to senior members of AberdeenStandard
Year(s) Of Engagement Activity 2018
URL http://strategicfutures.org/hexmaps/scotlandtopics/
 
Description Presentation to The Oil & Gas Authority 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach Regional
Primary Audience Policymakers/politicians
Results and Impact Presentation of topic model of OGA public facing material
Year(s) Of Engagement Activity 2018
URL http://strategicfutures.org/demos/OGAExample/
 
Description Presentation to the international oil and gas service company Expro 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Professional Practitioners
Results and Impact Presentation on the use of, and examples of Topic Modelling for diagnostics and summarisation of unstructured information.
Year(s) Of Engagement Activity 2018
URL http://strategicfutures.org/demos/OGAExample/
 
Description RCUK presentation: Chantler, Topic modelling and visualisation of national research portfolios 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? Yes
Geographic Reach National
Primary Audience Professional Practitioners
Results and Impact 50 Research Council staff attended the seminar which sparked considerable discussion and initiation of follow-up activities

This talk was presented last week - from the ensuing discussions I expect it to generate more use of ResearchPerspectives.org and will help stimulate the internal debate on the best way to provide a unified view of RCUK research.
Year(s) Of Engagement Activity 2014
URL http://www.researchperspectives.org/meetings/RCUKSeminar2014/
 
Description TSB Strategy Meeting 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Professional Practitioners
Results and Impact Attendees chose breakout groups created thanks to our Well Sorted tool and discussed the answers they'd submitted to two questions about how to increase the impact of TSB/InnovateUK.

The outputs from Well Sorted helped inform how the attendees thought the the impact of TSB/InovateUK could be increased and were used to influence future thinking.

In addition, members of the TSB have contacted us about use of it in future meetings.
Year(s) Of Engagement Activity 2014
 
Description Well Sorted Cited in Two National Funding Calls 
Form Of Engagement Activity A formal working group, expert panel or dialogue
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Policymakers/politicians
Results and Impact The Well Sorted tool and process has been cited in two national funding calls (Trust, Identity, Privacy and Security in the Digital Economy and New Approaches to Data Science) as it was used to help scope the area the calls included. Well Sorted's use in the two EPSRC consultations can be found here: https://www.epsrc.ac.uk/files/newsevents/events1/crosssatbigdataworkshopnotes/ and https://www.well-sorted.org/explore/DESM2014/documents/DESMDocRelease1.0.pdf The calls these lead to can be found here: https://www.epsrc.ac.uk/funding/calls/newapproachestodatascience/ and https://www.epsrc.ac.uk/funding/calls/trustidentityprivacysecurity/
Year(s) Of Engagement Activity 2014,2015
URL http://www.well-sorted.org