Member Login

Project Wrap-up: Shorts project Phase 2

Our research team from UTS and QUT has wrapped up phase 2 of the “Shorts” project with Infrabuild which involved demonstrating steel bar removal using a lightweight collaborative robot. This was an important milestone in proving that a smaller and safer robot could carry out similar work to the current operators.

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

In addition, sensors placed along the bar production line in the Sydney Bar Mill have been capturing footage of short bars over several months. This comprehensive dataset of various bar types is being used to develop algorithms for automatic detection of defective short bars.

 

 

 

 

 

 

 

 

 

 

 

Members from Centre’s Biomimic Cobots program 1 visited Infrabuild’s Sydney Bar Mill in October last year to discuss findings from the study and to plan the next steps of the project.

 

 

 

 

 

 

 

 

 

 

 

 

 

The next phase of the project will see integration of the short bar detection and bar removal systems. Furthermore, key upgrades to the sensor system are underway in order to improve the detection of short bars and cover a wider range of scenarios that were learnt from the previous phase.

Another focus will be the human aspect. Understanding how a collaborative robot can integrate into existing workflows and how to best meet expectations. This will be an exciting opportunity to gain insights from workers and also for cross collaboration with other programs in the Centre.

Swinburne PhD Researchers win Peoples Choice award for ‘WeedoMate’

PhD researchers from Swinburne, Jagannatha Pyaraka and Kartik Choudhary, and their supervisor, A/Prof Mats Isaksson have invented WeedoMate, a revolution in weed management.

The solution was developed through their participation in Swinburne’s Venture Cup Program where they won the People’s Choice award for their pitch. The program supports emerging startups through a three-week journey of personalised coaching, masterclasses and mentoring. The competition reaches its climax as the 10 finalists present compelling startup pitches to an expert judging panel.

WeedoMate tackles the challenge of unwanted vegetation in urban landscapes.  Using an autonomous system to identify and eliminate weeds with precision, minimizing the need for manual labour and reducing reliance on harmful chemicals. Their innovation lies in their adaptable robotic arm, equipped to deploy various tools including targeted herbicide sprays – tailored to each weed’s specific needs.

Read more:

https://www.swinburne.edu.au/news/2024/01/swinburnes-venture-cup-unveils-pioneering-startups-as-entrepreneurs-take-centre-stage

* https://www.swinburne.edu.au/research/platforms-initiatives/innovation-studio/venture-cup/

 

Kartik during the pitch
Jagannatha during the pitch
Swinburne Venture Cup
Swinburne Venture Cup

2023 Symposium – PhD researcher posters

At our annual symposium each of students were asked to create a research poster. For most of our students, this was the first research poster they have created. Click the PhD researcher’s name to find out more about their project.

Nadimul Haque, UTS
Jagannatha Pyaraka, Swinburne
Nisar Ahmed Channa, QUT
Baris Balci, QUT
James Dwyer, QUT
Jacqueline Greentree, QUT
Phuong Anh Tran, QUT
Mia Bhambri, Swinburne
Fikre Gebremeskel, UTS
Yuan Liu, QUT
Eleonora Zodo, QUT
Jasper Vermeulen, QUT
Akash Hettiarachchi, QUT

Giving cobots the human touch through biomimicry

This is article written by Robyn Barden from UTS and originally published via the UTS website Giving cobots the human touch through biomimicry | University of Technology Sydney (uts.edu.au)

An Australian Cobotics Centre roboticist is raising awareness of collaborative robots and biomimic research in a mechatronic musical installation where the lead percussionist is a collaborative robot.

Dr Fred Sukkar stands outside the shopfront next to the mechatronic music ensemble
Dr Fred Sukkar (right) is developing algorithms to enable natural and safe human-robot collaborative environments in the manufacturing industry at the Australian Cobotics Centre (ACC). Pictured at the centre of the musical ensemble is a collaborative robot (cobot) holding a caxixi, flanked by six mechanised drums.

 

UTS robotics researcher, Dr Fred Sukkar, has taken his research out of the lab and onto the streets with a robotic percussion ensemble display in Sydney’s CBD, a collaborative installation with the University of Technology Sydney, Australian Cobotics Centre, Macquarie University and Aesop Sydney.

Based in Aesop Sydney store, the installation with an industrial edge responds autonomously to music played in the store.

Six mechanical drums play along to music while the leader of the ensemble, a collaborative robot (cobot), shakes a basket-woven caxixi or ‘dances’ to the beat.

“When the store plays music the system listens and extracts information, such as the rhythm and tempo, then the ensemble plays along in an interactive way to compliment the music,” said Dr Sukkar, an Australian Cobotics Centre postdoctoral research fellow based at the UTS Robotics Institute.

For the cobot to learn how to play the caxixi, Dr Sukkar used motion capture cameras and reflective markers to record a human percussionist, then the robot replicates this movement.

“My biomimic cobots research aims to transfer skills to robots through human demonstration,” he said.

“The idea of translating human motion to a cobot is useful in our industry projects for intuitively teaching new skills and ultimately integrating cobots more naturally into workplaces.” Dr Sukkar said, the mechanised ensemble was conceptualised and constructed by Dr Richard Savery, a developer of artificial intelligence and robotics and research fellow  at Macquarie University.

“Richard combines music with robotics in a creative way to evoke human emotion.”

The cobotic musical installation was at the Aesop Sydney store, located in Pitt St Mall and was on display for 3 weeks until 19 November 2023.

6 Reasons Why We Need a Prototyping Toolkit for Designing Human-Robot Collaboration

Written by Postdoctoral Research Fellow, Dr Stine S Johansen and PhD Researcher, James Dwyer

In this short article, we will share 6 benefits of having a prototyping toolkit for designing human-robot collaboration (HRC). We will lift the curtain on our planned activities to work towards this in Program 2 of the Australian Cobotics Centre.

What type of human-robot collaboration are we talking about?

The Australian Cobotics Centre focuses on cobots in manufacturing settings. In these settings, robots are most often big and locked away in cages for safety reasons. They are useful for highly defined and repeatable tasks that require strength. In contrast, cobots are typically smaller and allow for people to safely carry out a task by handing over items to the robot or even by physically handling the robot.

Cobots address an increasing need for more adaptable robotic systems for customised and bespoke products. These types of products still require people in the manufacturing line to accommodate changes from product to product.

So, what could a prototyping toolkit look like?

Imagine a toolbox with screwdrivers, a hammer, cutters, etc. Similar to that, we already have tools in our design toolbox that work at a generic level or are appropriated to suit particular problems. But a toolkit for prototyping human-robot collaboration is still left for us to investigate. In Program 2, James Dwyer (PhD student) will contribute to our knowledge about how different prototyping tools can facilitate design processes of HRC. The goal is to develop a practical and affordable toolkit that can be used to enable designers, engineers, and end-users to work together towards human-robot collaboration in manufacturing settings and beyond.

What are the benefits of having a prototyping toolkit?

Knowing how a cobot can fit into an existing or new manufacturing setting requires substantial research. What if we had a way to make that process easier and more efficient for designers and clients as well as more accommodating for the final end-users of the cobot? This is the broad aim of a HRC prototyping toolkit. Here are 6 concrete benefits that we aim to support through our work in Program 2.

1) Accessible end-user engagement

Manufacturers often lack the expertise to define how a cobot could be used. They are, however, experts in their respective domain. Domain knowledge is not always something that can be documented in written reports. It is also the tacit knowledge that workers build through years of experience. A prototyping toolkit can enable that knowledge to play a role very early in the design and development process by lowering the currently high technical barriers to understand how a robot works. In Program 2, we rely on principles from participatory design which is a design practice to produce tangible outcomes together with end-users.

2) Cost and time efficiency

Facilitating a cobot integration project can require substantial costs and time which makes it non-viable for some manufacturers. The hardware investments require committing to a particular setup, but there are risks associated with such investments if feasibility of the concept has not been investigated early on. Therefore, it will be beneficial to have prototyping tools to conduct such investigations without the necessity of actual hardware. Prototyping tools can furthermore allow for quick and cheap iterations. Subsequently, there is a need for tools that facilitate the transition from early concepts to implementation and testing.

3) Flexibility

Given the opportunity for cobots to assist in manufacturing of customised products, there is a high need for flexible solutions. Crucial to realising flexibility is the establishment of design processes that bridge the gap between early stage conceptual development and technical integration. For cobots to effectively contribute to customised production, they must follow a rich understanding of work practices, production methods, and customisation requirements entailed in the manufacturing. This understanding can be developed through iterative design and a holistic approach, covering all aspects from conceptualisation, prototyping, and implementation. This will ensure that the cobots are versatile, adaptable, and able to meet changing production needs.

4) Risk mitigation

Even though cobots are generally equipped with safety measures such as a safe stop button and sensors to detect and stop collisions with people, it is still possible to get hurt by a faulty cobot that has not been adapted to its environment. Prototyping tools allow us to mitigate this risk in two ways. First, it is possible to create virtual models of the environment and cobot, meaning that we can simulate tasks and clarify potential safety risks we might not otherwise have detected purely from prior experience and safety standards. This allows us to develop safety measures long before anyone gets hurt. Second, while engaging end-users in the design process has many benefits, people with non-technical backgrounds are not necessarily comfortable interacting with a robot – especially an unfinished robot solution. Therefore, prototyping tools can support our engagement with end-users by removing the potential fear of getting hurt.

5) Enhanced creativity

As design researchers, we often engage in generative ideation activities to address research questions. Prototypes enable us to see facets of an idea that were not previously obvious. This is sometimes referred to as ‘filtering’ (for further reading on this topic, see our list of references). It’s like putting on special glasses that highlight the specific qualities we want to explore further while still capturing the essence of the entire concept. In order to use prototypes as filters, it is necessary to have a holistic understanding of the context within which the cobot will operate and how that context can change with the introduction of the cobot. A prototyping toolkit can help give us different lenses to explore facets of the context in early prototypes, thereby becoming a creative extension for designers. This could include prototyping tools such as facilitating Wizard-of-Oz methods, video prototyping, or virtual simulations.

6) Facilitating internal communication

Prototyping is an activity that allows us to both internalise and externalise ideas. In other words, prototypes enable us to internally reflect on what works and what does not work as well as communicate ideas to team members, clients, or anyone interacting with them. Prototypes have always had that role in design research, but with the technical barriers to quick prototyping for human-robot collaboration, there is a need to identify new ways to facilitate this role of prototypes.

We look forward to sharing our progress throughout the next few years. Please reach to us for further discussion, questions, or other inquiries.

Further reading:

Lim, Y. K., Stolterman, E., & Tenenberg, J. (2008). The anatomy of prototypes: Prototypes as filters, prototypes as manifestations of design ideas. ACM Transactions on Computer-Human Interaction (TOCHI)15(2), 1-27.

Wensveen, S., & Matthews, B. (2014). Prototypes and prototyping in design research. In The routledge companion to design research (pp. 262-276). Routledge.

William Odom, Ron Wakkary, Youn-kyung Lim, Audrey Desjardins, Bart Hengeveld, and Richard Banks. 2016. From Research Prototype to Research Product. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI ’16). Association for Computing Machinery, New York, NY, USA, 2549–2561. https://doi.org/10.1145/2858036.2858447

Gopika Ajaykumar. 2023. Supporting End-Users in Programming Collaborative Robots. In Companion of the 2023 ACM/IEEE International Conference on Human-Robot Interaction (HRI ’23). Association for Computing Machinery, New York, NY, USA, 736–738. https://doi.org/10.1145/3568294.3579969

Two joint CSIRO & Australian Cobotics Centre scholarships now available!

We are currently recruiting for two PhD Scholarships funded by CSIRO’s Data61‘s Collaborative Intelligence (CINTEL) Future Science Platform.

Both scholarships are based at QUT in Brisbane and students will also be part of the Australian Cobotics Centre. They will receive a scholarship of $36,161 per annum (indexed annually) with additional funding for travel and collaboration available.

*** Interactive (and Collaborative) Robot Programming using Language ***

The first scholarship is working with our Human Robot Interaction team, supervised by Jared DonovanDonovan and Markus Rittenbruch and working with researchers from the CSIRO’s Data61 team, Dr Cécile Paris, Dr Stephen Wan and Dr Pavan Sikka.

The Project, “Interactive (and Collaborative) Robot Programming using Language” focuses on collaborative and instructional dialogue agents to help human operators program robot tasks. The PhD candidate will research and develop methods to situate a collaborative dialogue agent, focusing on the core research question of how to tackle ambiguities in instruction-to-code translation within a grounded robotics scenario. The project will lead to the development of a system – tools, algorithms and data – that allows a human operator to interactively program a robot using language.

Find our more: Project 2.5: Interactive (and Collaborative) Robot Programming using Language

*** Collaborative robot adoption across industries ***

The second scholarship is based with our Designing Socio-Technical Robotic System program, supervised by A/Prof Glenda Caldwell & Dr Matthias Guertler and CSIRO’s Data61‘s Dr Andrew Reeson.

The Project, “Collaborative robot adoption across industries” will examine other industries across Australia to identify to what extent they have adopted cobots. The project would identify:

  • The drivers of adoption, along with barriers to it, and how any such barriers were overcome.
  • To what extent have these various industries adapted their processes to accommodate cobot technology, and what was required for them to do this?
  • What (re)-training was required for workers? How specific or generalisable are the required skills?

Find our more: Project 3.7:  Collaborative robot adoption across industries

If you are interested in these scholarships, submit an expression of interest here:

PhD Expressions of Interest

 

 

Centre-wide mid-year meeting

On 18th July, we held our mid-year meeting. This year each university hosted an in-person event and we joined together via zoom.

It was fantastic to reflect on our achievements over the past 6months and look forward to what we want to get done by the end of the year.

So far, in 2023, our group has:

and much, much more.

For the QUT group, we combined the meeting with a tour of Stryker‘s R&D lab in Herston and finished off the afternoon with a game of mini golf!

Thank you all for coming along! We are now looking forward to the end of year symposium where we can all meet in person and share our progress!

Australian Manufacturing Week 2023

PhD researcher Jagannatha Pyaraka and research program co-lead, Dr Michelle Dunn

Australian Manufacturing Week was held in Melbourne from 9-12 May 2023.

It provided an incredible opportunity for me (PhD student, Jagannatha Pyaraka) to gain firsthand experience and insights into the world of cobotics in the manufacturing industry. Special thanks to Cornelius van Niekerk, Business Development Manager from Weld Australia for giving us the opportunity to share the stand. Representing the Australian Cobotics Centre (ACC) Jagannatha Pyaraka, Mats Isaksson, Michelle Dunn, Christopher McCarthy, and Anushani Bibile, showcased a demonstration featuring our new UFactory Xarm6 cobot.

Our demo aimed to demonstrate the potential of collaborative robots (cobots) in enhancing manufacturing processes. We highlighted how cobots, designed to work alongside humans, can improve productivity while ensuring safety. By employing the Media-pipe technology in conjunction with D435 RealSense camera, the cobots capability to accurately capture and follow the tip of presenter’s palm was
demonstrated.

Throughout the event, we had the opportunity to interact with a diverse audience. People were intrigued by the capabilities of cobots and had a keen interest in the ACC’s work. We engaged in discussions on various aspects, including safety, efficiency, integration, and the return on investments associated with implementing cobots in manufacturing processes. These conversations provided valuable insights into the practical challenges and applications of this emerging technology.

One particular highlight was the interaction with other exhibitors, who showcased their own advancements and trends in the industry. The most widely shown cobot application was welding. This exchange of ideas allowed us to broaden our perspectives and gain a better understanding of the future developments in cobotics.

The experience at Australian Manufacturing Week 2023 has not only provided exposure to practical applications but has also deepened my understanding of the challenges and opportunities that arise when implementing cobots. Witnessing the enthusiasm and interest of the audience reaffirmed the importance of the work carried out by the ACC and boosted my passion for further research in this field.

Looking ahead, it is evident that cobotics will continue to revolutionize the manufacturing industry. As we strive to improve safety, efficiency, and productivity, the ACC will play a vital role in driving innovation and shaping the future of cobotics. I am excited to be able pursue my research in this field and look forward to witnessing the continued growth and impact of collaborative robots in manufacturing
processes.

Overall, Australian Manufacturing Week 2023 was a remarkable experience that not only allowed us to showcase our demo but also provided valuable insights, connections, and inspiration for the future of cobotics and the ACC.

Weld Australia CEO Geoff Crittenden
PhD Researcher, Jagannatha Pyaraka & Postdoc, Dr Anushani Bibile
Swinburne University Lead, A/Prof Mats Isaksson

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

ACM/IEEE International Conference on Human-Robot Interaction March 13-16, 2023 Stockholm, SE

Postdoctoral Research Fellow, Dr Stine Johansen was at the IEEE Human Robot Interaction Conference this week where she presented her paper, Illustrating Robot Motions.

Stine created a video presentation of the paper which gives an overview of the survey and examples of findings relating to how robot movements are illustrated in the ACM/IEEE Conference on Human-Robot Interaction proceedings from 2016 to 2022.

Download the paper and Stine’s video here: Illustrating Robot Movements | Proceedings of the 2023 ACM/IEEE International Conference on Human-Robot Interaction

We congratulate Stine, Jared and Markus on their paper acceptance especially given the conference’s average acceptance rate of 24% (last 5 years 24%).

Dr Stine Johansen
Associate Professor Jared Donovan
Associate Professor Markus Rittenbruch

ARTICLE: Try-a-Trade, Gladstone

By Melinda Laundon, Postdoctoral Research Fellow, and Jacqueline Greentree, PhD Researcher, Human-Robot Workforce Program, Australian Cobotics Centre

Almost 200 Grade 9 and 10 girls from Gladstone and surrounds gathered at CQUniversity for Try-a-Trade on 15th March. This event brought together manufacturing, aerospace, energy, mining, engineering and construction industry businesses and stakeholders from government and education to encourage female high school students to learn about a range of careers in STEM and try out some practical activities that they might encounter in STEM jobs.

The event was organised by the Gladstone Engineering Alliance in partnership with the National Association of Women in Construction and the Queensland Government‘s Department of Employment, Small Business and Training and Gladstone Manufacturing Hub.

It is important to engage high school students early to consider careers in manufacturing. The lower numbers of women in manufacturing make it particularly important to provide female students with opportunities to consider and experience diverse manufacturing career options. In Queensland, 29% of the current manufacturing workforce are women. While the proportion of women employed in manufacturing has grown dramatically over the past decade, most are in clerical or administrative roles. Only 11% of women in manufacturing are technicians and trade workers[1].

Australian Cobotics Centre industry partner Weld Australia hosted a stall at Try-a-Trade with two Soldamatic welding simulators. This popular activity allows people to experience welding in a safe environment. It also provided a fun competition between girls to compare their welding accuracy. Weld Australia’s Regional Training Coordinator, Adam Coorey said:

“To address the skills shortage, we need to give a greater range of access to the full available workforce. By utilising augmented reality technology, students who would normally shy away from the heat and sparks of a welding bay can try welding in a safe environment.  This accessible technology gives students the opportunity to experience a career that they may thrive in”.

At the Cobotics Centre stall, we discussed the impact of cobots and other advanced technology on future work. We also asked students to think about the skills and attributes that would be required in the future to work with a cobot as a team member. They came up with many creative insights, including:

  • Problem solving skills
  • Patience
  • Understanding human interactions
  • Coding
  • Good communication
  • Independence
  • Curiosity
  • Designing
  • Digital technology education
  • To be able to build
  • Understanding of mechanics

[1] Queensland Department of Regional Development, Manufacturing and Water (2023) Women in Manufacturing Strategy.