Member Login

ARTICLE: Integrating Vision-Guided Cobots into Steel Manufacturing

A cobot equipped with a laser-mounted end-effector points at a detected short bar. A green dot marks the identified short bar, providing a clear visual cue for operators.

A demonstration of vision-guided collaborative robotics has shown what the future of automation in steel product manufacturing could look like. As part of the Australian Cobotics Centre’s (ACC) Biomimic Cobots Program, this research initiative fosters university-industry partnerships to drive technological advancements.  Researchers from the Robotics Institute at UTS and the Research Engineering Facility at QUT, in collaboration with InfraBuild, deployed a custom AI-based “shorts” detection system integrated with a collaborative robot (cobot) that aims to enhance safety and maintain quality control in an active production environment.

The industry partner, InfraBuild, operates a manufacturing process that involves producing hot steel bars in various shapes and sizes. Quality control is maintained through a manual process where workers, operating in 12-hour rotating shifts, identify and remove defective short-length bars, known as “shorts”, from a conveyor. This task is both physically demanding and requires continuous focus to reduce errors and ensure workplace safety.

A key requirement for the solution was that it integrate seamlessly into existing operations without necessitating extensive modifications to plant, equipment, or processes. However, due to the wide variety of products that InfraBuild manufactures, off-the-shelf automation solutions were not suitable for accurately identifying and removing every type of bar produced. Given these requirements, a vision system consisting of various sensing modalities and a cobot were selected. This choice minimises the disruption to Infrabuild’s current workflow since cobots can operate safely alongside human workers without the need for extensive guarding and offers the flexibility and the option to revert to manual operation if needed.

A major milestone was achieved during the demonstration, successfully showcasing the “shorts” detection and cobot bar tracking system functioning in a live factory environment.  During the demonstration, the AI-based “shorts” detection system successfully detected short bars in real time. This information was communicated through a graphical user interface, displaying live video streams from two cameras mounted on InfraBuild’s conveyor line. The interface also featured coloured indicators: dots marking the detected start and end of a bar, its corresponding length displayed in the centre, and the average length per run. If a short bar was detected, a red bounding box highlighted it, and its corresponding length measurement changed from green to red, providing a clear visual cue for operators. The additional information provided from each production run, offers valuable insights for InfraBuild’s quality assurance processes. Additionally, InfraBuild noted that the vision system alone was a valuable addition, as it would enable operators on the factory floor to more quickly identify and remove defective bars when necessary.

By leveraging real-time detections from the vision system, the cobot dynamically adjusted its actions, indicating the bars identified as “shorts” by pointing at them. A laser mounted on the cobot’s end-effector highlighted these bars, allowing staff from the ACC and InfraBuild to clearly see the identified short bar. This milestone demonstrated the adaptability of vision-guided cobots, which, unlike traditional automation systems requiring structured environments, can respond dynamically to changing conditions in manufacturing processes.

This trial serves as a proof of concept for integrating robotic vision systems into InfraBuild’s broader production lines and offers valuable insights for other SME manufacturing companies looking to implement similar cobot-enabled automation solutions. By demonstrating the potential of vision-guided cobots, this initiative represents a step toward smarter, safer, and more flexible manufacturing systems. Showcasing a live cobot system in a factory was a first and major milestone for the ACC, proving that it is possible to address challenging problems found in industry. This achievement provides insight on the commercial viability of such technologies, marking a step for InfraBuild as they move toward the next phase of development.

Graphical user interface of the AI-based ’shorts’ detection system. The top image displays a run with no short bars detected. In the bottom image, a short bar is identified, highlighted by a red bounding box, and its length measurement in the centre of the interface changes from green to red, providing a clear visual indicator.

 

Meet Our Team at #HRI2025 in Melbourne!

Meet Our Team at HRI2025 in Melbourne! Researchers from 4 of our 5 programs will be at the ACM/IEEE Human-Robot Interaction Conference next week!

Workshop Presentations
* Virtual, Augmented, and Mixed Reality for Human-Robot Interaction Workshop (VAM-HRI) (3 March)
* QUT (Queensland University of Technology) PhD researcher, Jasper Vermeulen & postdoctoral Research Fellow, Dr Alan Burden will lead the in-person session, featuring guest speaker Associate Professor Wafa Johal
* Workshop Organisers: Selen Turkay, Maciej Woźniak, Gregory LeMasurier, Glenda Caldwell, Jasper Vermeulen, Alan Burden
* PhD researcher Yuan Liu will present: “Augmented Reality for Human Decision Making & Human-Robot Collaboration: A Case Study in Manufacturing.”

* Cultural Robotics: Diversified Sustainable Practices (3 March)
Organised by: Belinda Dunstan, Jeffrey TKV Koh, Hooman Samani, Müge Belek Fialho Teixeira

Demonstrations
* QUT PhD researcher James Dwyer (4-5 March)
* “What Would Jim Henson Do? Roleplaying Human-Robot Collaborations Through Puppeteering”, co-developed with Stine Johansen & Markus Rittenbruch

Paper Presentations
* University of Technology Sydney Postdoctoral Research Fellow, Dr Fouad Sukkar & A/Prof Teresa Vidal-Calleja (5 March, Trust & Safety session)
“Enabling Safe, Active, and Interactive Human-Robot Collaboration via Smooth Distance Fields.” by Usama Ali, Fouad (Fred) Sukkar, Adrian Müller, Lan Wu, Cédric Le Gentil, Dr Tobias Kaupp, Teresa Vidal Calleja

* Dr Stine Johansen & Prof Markus Rittenbruch (4 March, 1B: Sound, Voices, Smells session)
“Embodied Composition for Imagining Robotic Sound Space”, authored by Stine Johansen, Yanto Browning, Anthony Brumpton, Jasper Vermeulen, Wei Win Loy, Jared Donovan, Markus Rittenbruch

* Jasper Vermeulen & Dr Alan Burden (5 March, Late Breaking Report)
“Investigating Human Factors in Mako-Assisted Total Knee Arthroplasty Surgeries”, by Jasper Vermeulen; Alan Burden; Glenda Caldwell; Müge Belek Fialho Teixeira; Matthias Guertler

* Visiting PhD researcher from The Australian National University Amir Asadi (4 March, Late Breaking Paper)
“Redrawing Boundaries: Systemic Impacts of Rehabilitation Robots in Clinical Care Settings”, by Amirhossein Asadi, Damith Herath, Grant Shaw, Glenda Caldwell, Elizabeth Williams

* Prof Markus Rittenbruch & Dong An (Late Breaking Paper)
“The Design of Extended Reality-enabled Tangible Interaction to Enhance the Interaction with Collaborative Robots” by Dong An; Markus Rittenbruch; Leo Razayan

Lab Visit – Friday 7th March
* Intelligent Robotics Lab at Swinburne University of Technology
See our Swinburne team’s robots in action! Contact Prof Mats Isaksson to book.

Our Quality Assurance & Compliance researchers from Swinburne, Michelle Dunn and Chris McCarthy, will also be attending the conference!

Full program HERE.

Meet our E.P.I.C. Researcher, Valeria Macalupú


Valeria Macalupú is a Postdoctoral Research Fellow in the Human-Robot Interaction program (P2), sessional educator and interdisciplinary designer at Queensland University of Technology.

We interviewed Valeria recently to find out more about why she does what she does.

 

 

Tell us a bit about yourself and your research with the Centre? Include the long-term impact of what you are doing.

I am a Postdoctoral Research Fellow in the Human-Robot Interaction program (P2). I am also an industrial designer at heart, which was my bachelor’s degree in Peru. My research background is in co-designing social robots, particularly for aged care and service environments. Over the last 5 years, my research journey has focused on how design impacts robot acceptance, interaction, and integration in human spaces.

At the Centre, I contribute to shaping how cobots are designed for real-world use, ensuring they align with human needs, habits, workflows, and expectations. The long-term goal is to develop truly integrated robots into workplaces and society, making them more intuitive, accepted, and useful.

Why did you decide to be a part of the Australian Cobotics Centre?
I was drawn to the Centre because of its collaborative and interdisciplinary approach to robotics. My work sits at the intersection of design, robotics, and environment interaction, and the Centre provides a unique space to bridge these fields. The amazing work done at Program 2 allowed me to extend my knowledge across aged care and pedagogical areas to healthcare and manufacturing ones, which fills me with excitement.

Being part of a team that includes engineers, designers, and industry partners allows me to explore how we can design robots that truly work for people, not just technologically but socially and practically.

What project are you most proud of throughout your career and why?

One of my proudest projects is HELPII, where I contributed to researching and designing a social service robot for aged care. The fantastic team at the QUT Centre for Robotics (QCR) created this robot and developed the technology. We were invited to find a real market opportunity in aged care, and through multiple studies and visits to residential aged care facilities, we determined the best applications and tasks for the robot. I highlighted key design decisions that support understanding the real needs of staff and residents and ensuring the technology fits into their daily lives.

What made it meaningful was collaborating across disciplines and bringing the team together to see that robot design comes with many considerations, from colour and material theory to environmental systems and emotional design. Working with roboticists, architects, and aged care professionals to bridge gaps in communication and expectations was a brilliant experience. Particularly visiting and studying a facility with 10 robots in place! This project solidified my passion for HRI and showed me the real-world impact of thoughtful design.

What do you hope the long-term impact of your work will be?

I want to reshape how we design and implement robots in the home, workplaces and public spaces. Technological advancements often drive robotics, but thoughtful design plays a crucial role in ensuring robots are functional, intuitive, and widely accepted.

My goal is to establish better design, adoption, and co-habitation practices, ensuring robots are not just tools but seamlessly integrated into human environments. I hope my work lays the foundation for robots that feel as natural in our world as any other tool we use today.

Aside from your research, what topic could you give an hour-long presentation on with little to no preparation?

I could probably talk about design and decor in everyday life and how subtle decisions in design shape our interactions, experiences, and even behaviours. Design is everywhere, from how we intuitively use technology to how spaces influence our emotions. Otherwise, I could go on and on about Harry Potter and Lord of the Rings.

Exciting new collaborations are underway!

Quality Assurance and Compliance researchers, Dr. Mariadas Capsran Roshan (Swinburne University of Technology) and PhD researcher Munia Ahamed, visited Cook Medical in Brisbane to discuss upcoming projects as part of Munia’s PhD research.

They were joined by Dr. Valeria Macalupú (Human-Robot Interaction Postdoctoral Research Fellow at QUT), Gareth Keen (Cook Medical’s Manufacturing Engineering Manager), Kettina Materna (Cook Medical Continuous Improvement Lead), and Dr. Yuan Wang, contributing to an insightful and productive discussion.

A special thanks to Cook Medical for hosting—exciting developments lie ahead!

Learn more about the Quality Assurance and Compliance program and Munia’s project HERE.

2025 AIRAANZ Conference

In early February, our Human-Robot Workforce Program Co-Lead, Associate Professor Penny Williams and Postdoctoral Research Fellow, Dr Melinda Laundon were at the 2025 AIRAANZ conference co-hosted by Pasifika at Te Herenga Waka—Victoria University of Wellington and Massey University.

They presented their conference paper s on a range of work and technology research including labour shortages in manufacturing.

 

New Postdoctoral Research Fellow, Dr Valeria Macalupú

We are pleased to welcome Dr Valeria Macalupú as our newest Postdoctoral Research Fellow!

Valeria joins the QUT (Queensland University of Technology) team where she will be working within our Human Robot Interaction program under the supervision of Program co-Lead Associate Professor Jared Donovan!

Valeria will be researching the role of collaborative robots in enhancing manufacturing processes and enabling non-invasive manipulation in surgical settings. Her work aims to bridge the gap between innovative robotic technologies and their practical adoption in industry, with a focus on designing intuitive, user-centered systems.

With a PhD in Interaction Design from QUT and a strong foundation in Industrial Design, Valeria has led multidisciplinary research projects that co-design social and service robots through participatory design, co-design methods, and ethnographic studies. She has collaborated closely with partners in the aged care and robotics industries to create impactful solutions. Valeria’s research interests lie in human-robot collaboration, technology acceptance, and exploring the social dynamics of robotics in real-world environments.

Welcome to the team, Valeria!

Meet our E.P.I.C. Researcher, Danial Rizvi


Danial Rizvi is a PhD researcher based at the University of Technology Sydney supervised by Gavin Paul on Project 4.4 Data analytics and process validation of collaborative robots and automated processes.

We interviewed Danial recently to find out more about why he does what he does.

 

 

Tell us a bit about yourself and your research with the Centre? Include the long-term impact of what you are doing.

I’m a Robotics researcher working with Collaborative robots in the Quality Control and Quality Assurance Space.

Why did you decide to be a part of the Australian Cobotics Centre?
After completing my undergraduate degree in industrial robotics from Purdue University, I was eager to impact manufacturing. It is astounding how much manufacturing waste contributes to global emissions, and I felt the ACC’s goals closely aligned with mine.

What project are you most proud of throughout your career and why?

The fun thing with my PhD is that I’m constantly working with amazing people on new projects so it’s really hard to pick a favourite. Most notably I was able to improve manufacturing safety by enabling maintenance workers to engage with their tasks more using haptics.

What do you hope the long-term impact of your work will be?

I hope to improve our understanding of traditional manufacturing principles to better leverage robots in reducing manufacturing waste.

Aside from your research, what topic could you give an hour-long presentation on with little to no preparation?

I could talk about how Star Trek has consistently improved our understanding of technology and its capabilities while shedding light on what it means to be human.

ARTICLE: How Vocational Education and Training (VET) looks to meet the skills needs of the advanced Manufacturing Sector

As manufacturing moves to more advanced methods of production that utilises technologies such as cobots, vocational education and training (VET) providers are under increasing pressure to develop and deliver training that meets the evolving needs of the advanced manufacturing sector. This article uses the notion of employability to present three themes emerging from my research to unpack how skills are perceived and understood by those involved in provision and delivery of vocational education for advanced manufacturing.

Readiness: Laying the Groundwork for Success

In courses like Electrotechnology, higher-level math and literacy are prerequisites for success. VET providers look to support students with a range of programs including in class support to help bridge literacy, numeracy and digital abilities gaps of new students, ensuring they are better equipped to handle complex technical training.

Teachers are critical to ensuring readiness. As industries increasingly shift in the use and application of technology, trainers and training providers need to also keep pace but may lack familiarity with modern technologies such as robotics and automation. Investment in teacher development is essential to ensure they can deliver training that meets the current demands of industry.

VET providers must also ensure that their training equipment and facilities reflect the new technological landscape. This can be a significant hurdle, as systemic factors related to capital expenditure for public providers often restrict the ability to invest in advanced tools and machinery, requiring support from industry partners.

Adaptation: Responding to Changing Skills Needs

Adaptation underscores the importance of providers’ ability to respond to the changing skills needs of the workforce. While VET institutions recognize the need to evolve, the process of revising training packages is often slowed by conflicting industry interests and other stakeholder agendas.

To counter this, VET providers have increasingly turned to alternative forms of training. Microcredentials have emerged as flexible solutions to upskill or reskill workers in emerging areas like autonomous technologies and robotics. These shorter, more targeted programs can be developed quickly and are designed to address specific industry needs, even if they fall outside the scope of formal qualifications. Institutions are also offering hybrid courses that combine in-person and online elements, allowing workers to access training more flexibly. This adaptability is crucial as industries face rapid technological advancements and a need for workers with specialized skills.

Collaboration: Bridging the Gap Between Education and Industry

Collaboration emphasises the importance of partnerships between educational institutions, industry, and government to effectively meet the workforce’s evolving needs, and ensure that training is relevant and up to industry standards.

New initiatives like higher apprenticeships, which combine trade qualifications with university degrees, are emerging. These programs require careful coordination between VET and university sectors to ensure that students receive the necessary support and meet the varying requirements of both systems.

Industry partnerships also extend beyond course design to include equipment sharing and resource pooling. Industry partners help to overcome capital investment limitations of VET institutions by providing the latest equipment such as cobots. This reciprocal arrangement helps both parties. Industry partners gain access to skilled workers trained on the latest equipment, while VET providers can offer students hands-on experience with tools and equipment used in workplaces.

Moving Forward

Through readiness, adaptation, and collaboration VET providers can better prepare learners for the future workforce. Ensuring that learners enter training with the right foundational skills, adapting training offerings to meet the rapidly changing technological landscape, and fostering strong collaborations with industry and higher education institutions are all key steps in skilling a workforce capable of thriving in technologically complex workplaces. Ongoing collaboration between education providers, industry, and policymakers will be key to ensuring workers have the skills necessary to succeed in the advanced manufacturing industry.

ARTICLE: Beyond the Factory Floor: Cobots as the Ultimate Growth Hack for Small and Medium-sized Enterprises (SMEs)

Automation has long been the domain of large enterprises with deep pockets and extensive resources. However, the landscape is undergoing a transformation, with collaborative robots, often referred to as cobots, leading the way in driving this change. Designed to work seamlessly alongside humans, cobots are making automation accessible, even for Small and Medium-sized Enterprises (SMEs). According to a recent report[1], the global cobot market is projected to grow from $1.2 billion in 2023 to close to $3 billion by 2028, reflecting their rising adoption across industries.

For SMEs, staying competitive often requires overcoming unique challenges such as limited budgets, smaller teams, and the need for operational agility. According to the Australian Chamber of Commerce and Industry’s 2024 Small Business Condition Survey[2], labour shortages and rising costs are among the most significant obstacles that small businesses face. While traditional automation systems can help address labour shortages, they are often rigid, complex, and prohibitively expensive, making them unsuitable for many SMEs. Enter cobots, a revolutionary solution that combines affordability, flexibility, and ease of deployment.

  • What Are Cobots, and How Do They Differ from Traditional Robots?

Collaborative robots, or cobots, are a new generation of robotic systems designed to work directly with humans in shared workspaces. Unlike traditional industrial robots, which often require physical barriers for safety, cobots are equipped with advanced sensors and programming that allow them to detect and adapt to human presence. This makes them inherently safer and more versatile in environments where people and machines need to work side by side.

  • Why Cobots Are the Perfect Growth Hack for SMEs?

Cobots have the potential to transform SMEs by providing solutions that deliver a wide range of benefits. These include:

  • Cost-Effectiveness

Cobots are significantly more affordable than traditional industrial robots. Unlike industrial robots, which require heavy structures and safety cages, cobots can often be mounted with simple tools like a G-clamp, saving on installation costs and space. In contrast, industrial robots demand extensive safety measures and infrastructure, which not only consume space but also incur additional expenses. This cost difference is critical for SMEs operating on tight budgets.

  • Flexibility and Adaptability

Unlike traditional robots, which are designed to fully automate a task or leave it to manual labour, cobots offer a middle ground, semi-automation. This capability is invaluable for SMEs, where automating the complete workflows are complex or expensive.

For example, a furniture manufacturing SME can program a cobot to assist with sanding tasks. While the cobot performs the repetitive sanding, workers can focus on more intricate assembly tasks, significantly boosting overall productivity. This shared workspace model eliminates the rigidity of traditional automation, allowing SMEs to adapt quickly to changing demands.

  • Ease of Use

Cobots are designed with user-friendliness in mind, often featuring intuitive interfaces that require minimal training. Employees without technical expertise can quickly learn to program and operate these robots, reducing downtime. Blocky programming uses a drag-and-drop interface where users create workflows by connecting pre-designed blocks that represent commands or actions. This visual approach eliminates the need for complex coding knowledge, making it ideal for SMEs that may not have dedicated robotics experts on staff. For instance, programming a cobot to pick and place items can be as simple as dragging blocks for “move,” “grip,” and “release,” and arranging them in sequence.

  • Real-World Examples

Cobots have demonstrated significant value in real-world SME environments, offering practical solutions to common operational challenges. KUKA, a leading cobot manufacturer, has highlighted numerous cases[3] where SMEs have successfully implemented their collaborative robots. These include applications in quality inspection in plastics manufacturing, machine loading in metal industries, and assembly tasks in the automotive sector. Similarly, Universal Robots (UR), another leading cobot manufacturer, has documented a wide range of SME applications[4], such as palletizing in food production, welding in small-scale metal fabrication, and material handling in manufacturing environments. For example, the SME Bob’s Red Mill utilized UR cobots to automate palletizing tasks, effectively addressing labour shortages and boosting productivity. These examples illustrate how cobots are enabling SMEs to enhance their operations through flexible and scalable automation solutions tailored to their specific needs.

  • Start small, Scale smart !

By embracing cobots today, SMEs can secure the future of their operations and position themselves for sustained success in a world that is becoming more competitive. The key to successfully integrating cobots is to start with a focused approach by introducing them into one or two specific processes. As businesses gain confidence and expertise, they can gradually expand their use. This method helps organisations reduce risks, control costs, and tailor the technology to fit their specific requirements.

References

[1] T. Haworth, “Global cobot market exceeds $1bn in 2023, with strong growth forecast 2024-28,” Interact Analysis. Accessed: Nov. 21, 2024. [Online]. Available: https://interactanalysis.com/global-cobot-market-exceeds-1bn-in-2023-with-strong-growth-forecast-2024-28/

 [2] Australian Chamber of Commerce and Industry, Small Business Conditions Survey 2024, Australian Chamber of Commerce and Industry, Canberra, ACT, 2024. [Online]. Available: https://www.australianchamber.com.au/wp-content/uploads/2024/07/ACCI-Small-Business-Conditions-Survey-2024.pdf

[3] “Successful automation in small and medium-sized enterprises,” KUKA AG. Accessed: Nov. 21, 2024. [Online]. Available: https://www.kuka.com/en-de/company/iimagazine/2023/05/kmu-erfolgsgeschichten

[4] “Customer Success Stories – collaborative robots.” Accessed: Nov. 21, 2024. [Online]. Available: https://www.universal-robots.com/case-stories

 

 

 

Meet our E.P.I.C. Researcher, Bochao Xu

Bochao Xu is an Associate PhD researcher based at the University of Technology Sydney, and he is part of the Designing Socio-Technical Robotic Systems program at the Australian Cobotics Centre. We interviewed Bochao recently to find out more about why he does what he does.

  • Tell us a bit about yourself and your research with the Centre? Include the long-term impact of what you are doing.

I completed my undergraduate studies at UNSW in 2020 with a double degree in mechatronics engineering and commerce. Before I decided to do a PhD, I worked in an industrial robot research institute and an industrial AI company. I started my PhD in February 2023 at UTS and joined ACC in September 2023 as an associate researcher. My main research interest is in how small to medium-sized manufacturing enterprises (SMMEs) can be supported in adopting technologies. Since joining ACC, my research has also looked into how cobots can be adopted together with other technologies. SMMEs with restricted time, knowledge, and resources face many challenges in adopting not only cobots but also other technologies while focusing on their daily operations. However, adopting technology to raise competitive advantages should not only be a success story for large companies. Therefore, my research aims to address the difficulties and provide guidance for the best practices in technology adoption.

Why did you decide to be a part of the Australian Cobotics Centre?

I decided to join ACC after my supervisor and the centre offered me the opportunity. I am pleased to be part of the large research community to share and communicate my ideas. It is amazing how experts from different disciplines come together to push the research frontier of cobots. I am sure that ACC has made lots of contributions to not only cobotic research but also benefiting the Australian community, and I am glad to be part of the contribution.

  • What project are you most proud of throughout your career and why?

My current PhD project is certainly the project that I am most proud of. PhD has allowed me to conduct in-depth investigations of the topic I am interested in and make robust arguments on its importance. Progressing in the PhD project has given me the knowledge and rationales of how I can support the research and society in the field I am passionate about.

  • What do you hope the long-term impact of your work will be?

Supporting SMMEs in technology adoption has always been my first priority. One of the requirements that I know I have to fulfil in my PhD study is to create something practical and sustainable even after the completion of my study. As we are in an era of rapid technological developments, my research should not only support the adoption of contemporary technology but also any future technologies. I hope my research can set the baseline and provide equal opportunities to SMMEs who are keen on seeking growth opportunities through technology adoption.

  • Aside from your research, what topic could you give an hour-long presentation on with little to no preparation?

I usually prepare a script before going to any presentation, as I understand that every presentation is an opportunity for knowledge sharing, and I would not want to miss any important messages and details. I try to imagine how the audience might react while writing the script. Therefore, I have very limited experience with long presentations without preparation. However, I recently had a new experience without much preparation when giving a short talk about the culture of my hometown in celebration of the Moon Festival. I was happy that the audience liked my presentation and thought a presentation without preparation might be doable for me as well. If I were to give another presentation without preparation, it would be about food and cooking, time management, or personal and family accounting, which are my hobbies and interests.