21st Century Prototyping: Improving product prototyping through the integration of physical and digital workflow
Lead Research Organisation:
University of Bristol
Department Name: Mechanical Engineering
Abstract
To design the future of products we need the future of prototyping tools. Across the £30Bn+ consumer product markets, priorities such as demand for non-technical user voice vie against advanced products and tough time/cost targets. These pressures are acutely felt in the prototyping process, where models often number in the 100s for a single product, and are inflexible, technically advanced, and resource-intensive to create. To succeed and evolve prototyping needs to do more, quicker, cheaper, with higher accessibility.
This project aims to enhance learning, accessibility, and efficiency during prototyping. It will explore feasibility and value of seamlessly integrating physical and digital prototyping into a single workflow.
Recent and rapidly emerging technologies such as mixed reality, haptic interfaces, and gesture control have revolutionised the way we interact with the digital world. It's predicted that this tech will be ubiquitous by 2025, will be disruptive for the next decade, and will drive the way we work and interact across the future digital workplace, with engineering a top-5 sector to realise value. In prototyping, they will break down the physical-digital divide and create seamless experiences, where the strengths of each domain are realised simultaneously.
This new physical-digital integrated workflow brings profound opportunities for both engineers and users, supporting technical activities and simplifying communication. Amongst many possibilities users may physically create and feel digital changes to prototypes in real-time, dynamically overlay advanced analyses onto physical models, and support early-stage decision-making with physical-digital, tactile, interactive prototypes. These capabilities will allow more learning per prototype, widen accessibility to technical design and streamline the prototyping process. However, we don't yet know how this exciting vision may be fulfilled, exactly what benefits, value or costs there may be, feasibility of implementation, or effective workflow approaches.
The project will explore physical-digital workflow by creating and investigating several demonstrator platforms that combine and apply haptic, mixed reality, and gesture control technologies in targeted prototyping scenarios. Technologies will be explored to understand capability in isolated sprints, before prioritisation and development into focused demonstrator tools that allow us to explore integrated workflow across real prototyping cases, spanning activities, types, and stakeholders. Demonstrators will be evaluated and verified with end-users, industry partners, and the public to establish learning, speed, cost, and usage characteristics.
Project outcomes will comprise workflows for integrated prototyping with knowledge of value, effectiveness, feasibility, and future opportunities. A 'toolkit' of implementations will also provide exemplars for industrial partners and academia and lead the effective use of integrated physical-digital workflow in engineering. All software and hardware will be open-sourced via Github and the project webpage, letting global researchers and the public create their own systems and build upon the work. Future work will extend capabilities in line with outcomes of the work, leading to the next generation of engineering design and prototyping tools.
Industrial Partners The Product Partnership (Amalgam, Realise Design, and Cubik) and AMRC will bring prototyping, engineers, and end-user expertise and benefit from the workflows and technologies that are developed. OEMs Ultraleap and Autodesk will bring immersive technology expertise and access to cutting edge design systems, and will benefit from case study implementations and studies and future application opportunities. Bristol Digital Futures Institute will facilitate collaboration across 20+ partner businesses and the public, with outputs supporting their mission for digital solutions that tackle global problems.
This project aims to enhance learning, accessibility, and efficiency during prototyping. It will explore feasibility and value of seamlessly integrating physical and digital prototyping into a single workflow.
Recent and rapidly emerging technologies such as mixed reality, haptic interfaces, and gesture control have revolutionised the way we interact with the digital world. It's predicted that this tech will be ubiquitous by 2025, will be disruptive for the next decade, and will drive the way we work and interact across the future digital workplace, with engineering a top-5 sector to realise value. In prototyping, they will break down the physical-digital divide and create seamless experiences, where the strengths of each domain are realised simultaneously.
This new physical-digital integrated workflow brings profound opportunities for both engineers and users, supporting technical activities and simplifying communication. Amongst many possibilities users may physically create and feel digital changes to prototypes in real-time, dynamically overlay advanced analyses onto physical models, and support early-stage decision-making with physical-digital, tactile, interactive prototypes. These capabilities will allow more learning per prototype, widen accessibility to technical design and streamline the prototyping process. However, we don't yet know how this exciting vision may be fulfilled, exactly what benefits, value or costs there may be, feasibility of implementation, or effective workflow approaches.
The project will explore physical-digital workflow by creating and investigating several demonstrator platforms that combine and apply haptic, mixed reality, and gesture control technologies in targeted prototyping scenarios. Technologies will be explored to understand capability in isolated sprints, before prioritisation and development into focused demonstrator tools that allow us to explore integrated workflow across real prototyping cases, spanning activities, types, and stakeholders. Demonstrators will be evaluated and verified with end-users, industry partners, and the public to establish learning, speed, cost, and usage characteristics.
Project outcomes will comprise workflows for integrated prototyping with knowledge of value, effectiveness, feasibility, and future opportunities. A 'toolkit' of implementations will also provide exemplars for industrial partners and academia and lead the effective use of integrated physical-digital workflow in engineering. All software and hardware will be open-sourced via Github and the project webpage, letting global researchers and the public create their own systems and build upon the work. Future work will extend capabilities in line with outcomes of the work, leading to the next generation of engineering design and prototyping tools.
Industrial Partners The Product Partnership (Amalgam, Realise Design, and Cubik) and AMRC will bring prototyping, engineers, and end-user expertise and benefit from the workflows and technologies that are developed. OEMs Ultraleap and Autodesk will bring immersive technology expertise and access to cutting edge design systems, and will benefit from case study implementations and studies and future application opportunities. Bristol Digital Futures Institute will facilitate collaboration across 20+ partner businesses and the public, with outputs supporting their mission for digital solutions that tackle global problems.
Publications
Goudswaard M
(2023)
Knowledge dimensions in prototyping: investigating the what, when and how of knowledge generation during product development
in Design Science
Giunta L
(2023)
A Living Lab Platform for Testing Additive Manufacturing Agent-Based Manufacturing Strategies
in Procedia CIRP
Snider C
(2023)
HOW SHOULD WE PROTOTYPE? ESTABLISHING THE AFFORDANCES OF PROTOTYPING MEDIA AND APPROACHES
in Proceedings of the Design Society
Cox C
(2023)
FROM HAPTIC INTERACTION TO DESIGN INSIGHT: AN EMPIRICAL COMPARISON OF COMMERCIAL HAND-TRACKING TECHNOLOGY
in Proceedings of the Design Society
Kent L
(2023)
A HIERARCHICAL MACHINE LEARNING WORKFLOW FOR OBJECT DETECTION OF ENGINEERING COMPONENTS
in Proceedings of the Design Society
Snider C
(2024)
Mixed reality prototyping: a framework to characterise simultaneous physical/virtual prototyping
in Proceedings of the Design Society
Wharton M
(2024)
Perception-centric design considerations for low-cost haptic emulation in prototypes
in Proceedings of the Design Society
Wyrley-Birch M
(2024)
6 degree of freedom positional object tracking for physical prototype digitisation
in Proceedings of the Design Society
Gopsill J
(2024)
Data mining prototyping knowledge graphs for design process insights
in Journal of Engineering Design
Cox C
(2024)
Investigating the influence and interplay of physical and virtual traits on the user perception of Mixed Reality prototypes
in Design Science
Kukreja A
(2024)
A comparative study of VR CAD modelling tools for design
in Proceedings of the Design Society
Gopsill J
(2024)
A low-cost non-intrusive spatial hand tracking pipeline for product-process interaction
in Proceedings of the Design Society
Gopsill J
(2024)
Optimal configurations of Minimally Intelligent additive manufacturing machines for Makerspace production environments
in Artificial Intelligence for Engineering Design, Analysis and Manufacturing
Ormerod I
(2024)
A proposed framework for data-driven human factors evaluation
in Proceedings of the Design Society
| Description | Innovation Launchpad Network+ Researchers in Residence Scheme |
| Amount | £49,963 (GBP) |
| Funding ID | RIR16A221129-1 |
| Organisation | Engineering and Physical Sciences Research Council (EPSRC) |
| Sector | Public |
| Country | United Kingdom |
| Start | 01/2024 |
| End | 04/2026 |
| Title | ML-calibrated low cost hand-tracking system |
| Description | Provides a pipeline for full 3D hand tracking using only low-cost commercial webcams. System config and calibration utilises a series of ML models tuned to a reference set created via a low cost 3D positional tracking system (Vive tracker). When running, gives full hand tracking to <1mm accuracy with no wearables or intrusive hardware. |
| Type Of Technology | New/Improved Technique/Technology |
| Year Produced | 2024 |
| Impact | Used currently to: - Enable data capture and analysis of 2 PhD students - Create a tech demo to be displayed at the Advanced Manufacturing Research Centre in Sheffield |
| Title | XR Design review system |
| Description | Mixed-reality design review system for direct-to-3D annotation and design exploration of CAD models and technical designs. |
| Type Of Technology | New/Improved Technique/Technology |
| Year Produced | 2025 |
| Impact | - Deployment in workflow of Kinneir-Dufort, a local engineering firm |
| Description | Exhibition and invited talk at TechFellows industry-facing event |
| Form Of Engagement Activity | A talk or presentation |
| Part Of Official Scheme? | No |
| Geographic Reach | National |
| Primary Audience | Industry/Business |
| Results and Impact | Approx. 200 business leaders associated with the high value manufacturing catapult attended. I presented the spatial computing paradigm as an industry tool, and exhibited developed technologies. Has led to several connections, primarily with PTC, AMRC Wales. The former has led to further conversations with American immersive technology development team. |
| Year(s) Of Engagement Activity | 2024 |
| Description | Exhibition at ICED 2023 |
| Form Of Engagement Activity | Participation in an activity, workshop or similar |
| Part Of Official Scheme? | No |
| Geographic Reach | International |
| Primary Audience | Professional Practitioners |
| Results and Impact | Exhibited initial project outputs as technical demonstrators at ICED 2023 conference in Bordeaux, France. Approx. 700 attendees. Sparked several discussions and international connections with TU Munich, Zagreb, Turkey, Strathclyde, ETH Zurich. |
| Year(s) Of Engagement Activity | 2023 |
| URL | https://dmf-lab.co.uk/blog/21st-century-prototyping-exhibit-at-iced-2023/ |
| Description | Exhibition at Pro2 Network launch |
| Form Of Engagement Activity | Participation in an activity, workshop or similar |
| Part Of Official Scheme? | No |
| Geographic Reach | National |
| Primary Audience | Industry/Business |
| Results and Impact | Presented project demonstrators to 100+ attendees from industry and academia at the launch of the ProSquared Network+ on Democratisation of Digital Devices. Also formally presented the project in a keynote and sat on the expert panel for Q&A. Several new connections made, including agreement for collaboration with Kinnier Dufort. |
| Year(s) Of Engagement Activity | 2023 |
| URL | https://dmf-lab.co.uk/blog/21st-century-prototyping-at-the-prosquared-network-launch/ |
| Description | Exhibition to Agratas |
| Form Of Engagement Activity | Participation in an open day or visit at my research institution |
| Part Of Official Scheme? | No |
| Geographic Reach | National |
| Primary Audience | Industry/Business |
| Results and Impact | Exhibition of technical demonstrators to Agratas, who are leading development of a major battery factory and skills centre in the SW of the UK. 10 C-suite level attendees + University APVC attendees. Led to interest in integration of technologies in the Agratas site, currently under discussion. |
| Year(s) Of Engagement Activity | 2025 |
