Robots on earth help prepare for research on the moon

Robots on earth help prepare for research on the moon

By Scott Simmie

 

What could small robots on earth have to do with exploration on the moon?

Quite a lot, as it turns out. Professors and engineering students at Polytechnique Montréal have been busy writing algorithms and running experiments with robots and drones with one goal in mind: To enable them to explore unfamiliar and even hostile surroundings far beyond the reach of GPS or other forms of precision location technology.

“What we want to do is to explore environments including caves and surfaces on other planets or satellites using robotics,” explains Dr. Giovanni Beltrame (Ph.D.), a full professor at Polytechnique’s Departments of Computer Engineering and Software Engineering.

Before we get to the how, let’s address the why.

“Caves and lava tubes can be ideal places for settlement: They can be sealed and provide radiation shielding. There’s also a chance of finding water ice in them,” says Dr. Beltrame.

Of course, it’s also less risky – and less expensive – to send robots to other planets and moons rather than human beings. They don’t require life support, don’t get tired (with the exception of having to recharge), and they can gather and process data quickly.

Just think of all the data that’s been acquired on Mars by the twin Rovers and the Mars helicopter.

Below: A selfie taken by NASA’s Perseverance rover November 1, 2023, during the the 960th Martian day of its mission. The rover was built with a focus on astrobiology, searching for signs of ancient microbial life on the red planet. Image courtesy of NASA.

Mars rover Perseverance

PREPARE ON EARTH, DEPLOY IN SPACE

 

It’s a pretty ambitious vision. But for Beltrame and his team, it’s also very real. And it requires a lot of work and research here on earth.

“So to get there (space) and do this with multiple robots, we’ve developed all sorts of technologies – navigation, perception, communication, coordination between the robots, and human-robot interfaces,” he says.

“We’re doing all these things, because our goal is to use a swarm of robots to do planetary exploration. There’s more, but that’s it in a nutshell.”

When you go to the moon, there’s no equivalent of GPS. And environments like caves can be really tricky – both in terms of robots understanding where they are, and also communicating with other robots beyond line of sight.

With the right technologies and algorithms, that communication is possible. And much of Beltrame’s research has involved testing this on earth. In particular, he’s focusing on how groups of robots could take on such tasks collaboratively.

“So our primary activities focus on swarm robotics,” he says.

Generally that starts with simulation models. But there are limits to simulations – and real-world testing is a big part of what’s going on at Polytechnique.

“So we do have this deployment philosophy that we try our technologies in simulation, but then we want to go to deploying robots. You can have the best simulation in the world, but there’s still a reality gap and it’s very extremely important to try things on the real robots,” he says.

“We have a saying in the lab, which is: ‘Everything works in simulation’. You can always make your algorithm work in simulation, and then you get out in the field and things go wrong. So one thing we do in the lab is we always do the full stack. That’s why we need to have real robots. And we don’t only do experiments with real robots in the lab, we do them in the field.”

MIST

 

The lab he’s referring to is known as Polytechnique’s MIST, which stands for Making Innovative Space Technology. Dr. Beltrame is the director of the lab, which focuses on computer engineering targeted towards space technologies. In addition to the researchers, the lab is home to a *lot* of robots. There are big ones, small ones, wheeled ones, flying ones (drones) – literally “hundreds” of robots at the lab.

But as Dr. Beltrame emphasised, proving that something will truly work requires testing in environments that are similar to what might be found on the moon or elsewhere. Locations where he’s carried out fieldwork include:

  • Lava Beds National Monument in California (with NASA JPL)
  • The Kentucky mega-cave with the CoSTAR team
  • Tequixtepec in Mexico with SpéléoQuébec

Just check out the images below of field work, courtesy of Dr. Beltrame:

THE INDRO CONNECTION

 

Some of the robots used in the MIST lab – and perhaps eventually on the moon – arrived via InDro Robotics, a North American distributor for AgileX. In fact, Polytechnique has purchased a number of AgileX products, including platforms that InDro has modified to help speed the R&D process. These include:

  • 24 LIMOs and simulation table
  • AgileX Scout Mini
  • AgileX Scout 2.0
  • Two AgileX Bunker Mini platforms, with custom builds by InDro

We’ve written about the LIMO before – a small, affordable and versatile robot capable of perceiving its environment and even Simultaneous Localization and Mapping out of the box. It’s also an ideal size, particuarly when doing multi-agent/swarm robotics, for use in the lab. (You’d run out of space pretty fast with something much larger).

“The LIMOs are a very good platform for Simultaneous Localization and Mapping  – and perception in general,” says Beltrame.

He says they’re a good choice “because they have a 3D camera, they’re lighter, agile, and are sufficiently low in cost. So we can use them in large numbers. Another good thing about the LIMOs is that once you have a lot of similar robots that are reasonably agile, you can actually make a full deployment of software (across all robots).”

That makes them an ideal platform for multi-agent research and development.

“For example, we developed this tool called Swarm SLAM where many robots collaborate to have a better perception of the environment. We’re currently testing it with the full fleet of LIMOs. That’s something we would have believed impossible with larger robots for logistical reasons.”

Though the focus is firmly on space, the Polytechnique Montréal research has applications on earth. Swarms of robots could aid in disaster response, Search & Rescue, and more.

 

FAVOURITE ROBOT

 

The LIMO isn’t the only AgileX product in Polytechnique’s stable. And while Beltram likes all of them, he has a soft spot for one in particular.

“I would say that my favorite robot is the Scout Mini,” he says. “It’s fast, it’s agile and the control is extremely precise.”

In fact, Beltrame often takes the Scout Mini with him when doing school presentations. It’s small enough to be carried in the trunk of his car and hand-carried to classrooms. His team has also used the platform to test a new code for path planning and sophisticated energy calculations. It’s capable of tracking the additional energy required for climbing inclines, for example, then calculating when the robot needs to return home to wirelessly recharge.

As always, InDro works with clients to deliver precisely what they need. This saves time for those institutions and corporations on builds, allowing them to get on with the business of R&D.

“We’ve done quite a bit of integration for them,” says Luke Corbeth, InDro’s Head of R&D Sales.

“For example (see picture below), we provide a top plate with all required hardware mounted and integrated. They then add their own sensors, protective structure, etc. So this is a great example of how we work with clients on a case-by-case basis depending on their needs as robotics isn’t one-size-fits-all.”

Polytechnique mini bunkers

ONE SMALL STEP…

 

With all of this research, what comes next? Will the work being done today at Polytechnique eventually find its way off this planet?

“The answer is it’s going to happen very soon,” says Beltrame. Sometime later this year, a rocket will head toward the moon carrying three small robots. It’s called the Cadre mission.

A trio of small rovers will work as a team to explore the moon autonomously, mapping the subsurface in 3D, collecting distributed measurements, and showing the potential of multirobot missions,” says NASA’s JPL website. One of Beltrame’s students is working on that mission with JPL.

“This is one example of how the work that we’ve been doing in this lab, in the end – through students that were here – become real missions,” says Beltrame.

And that’s not all. As early as 2026, a Canadian-built rover could land on the moon in Canada’s first moon mission.

Its task? To explore the moon’s south polar region in search of “water ice.” This ice is critical to long-term human habitation on the moon – and can also be converted to fuel, both for energy on the moon and potentially to refuel other spacecraft with destinations further afield.

“I have an engineer from the Canadian Space Agency that’s a student of mine that’s developed the Mission Planner. So the idea is that we – our lab – developed the Mission Planner for the Canada rover that’s going to the moon.”

Here’s a look at that planned mission, from the CSA:

 
 
 

AND THERE’S MORE

 

There was some big news this week from Polytechnique Montréal. On January 24 it announced the formation of ASTROLITH, a body for “research in space resource and infrastructure engineering.”

It’s the first Canadian group dedicated to lunar engineering, according to a news release.

Comprising experts from all seven Polytechnique departments, ASTROLITH will pursue the mission of helping to develop next-generation technologies and training the engineers of tomorrow to ensure Canada’s presence in space and lunar exploration, as well as addressing critical needs on our planet within the context of climate change, resource management and sustainable development,” reads the release.

So while the emphasis is on the moon, ASTROLITH will also result in some very practical – and urgent – use-cases on our home planet.

“As encapsulated in its Latin motto Ad Lunam pro Terra, ASTROLITH is dedicated to developing technologies with direct impacts here on Earth: enabling development of infrastructure in the Far North or facilitating the energy transition, for example,” says the release.

“Indeed, the research unit’s founding members are already involved in developing technologies in various areas related to space and extreme environments, from design of resilient habitats and infrastructures for remote regions to deployment of cislunar communications technologies to development of advanced robotics systems for prospecting and mining, among many others. Their work is bolstered by contributions from specialists in life-cycle analysis, sustainable development and space-related policy development.”

The team is composed of academics and researchers that span all seven Polytechnique departments. Beltrame, not surprisingly, is on the team – which is pictured below. (He’s in the back row, centre.)

 

INDRO’S TAKE

 

We find the work being carried out at Polytechnique Montréal, the MIST lab – and now ASTROLITH – both fascinating and important. It’s also a terrific example of how dedicated researchers and students can develop and test projects in the lab that eventually have real-world (and off-world) applications.

“I’m incredibly impressed with the work being carried out here, and the fact it can be put to positive use-cases both on earth and in space,” says InDro Robotics CEO Philip Reece.

“We wish Dr. Beltrame and his colleagues well, and we’ll certainly be watching these lunar missions with great interest. It’s always a pleasure when InDro can support teams doing important work like this.”

You can find more about the MIST lab here. And if you’d like to talk about AgileX robots (or any other robotic solution), connect with an InDro expert here

Assistive devices on the rise at Korea’s Robot World Conference

Assistive devices on the rise at Korea’s Robot World Conference

By Scott Simmie

A major robotics conference is underway in Seoul, South Korea.

Robot World 2023 features some 200 exhibitors and 700 booths, ranging all the way from heavy hitters like Hyundai (which makes robots for industrial purposes) through to companies that manufacture the various widgets that make up the robot supply chain. There are manufacturers of wheels, servos, end effectors, lubricants, cable management systems – you name it, you’ll find it.

Need a hand? There’s no shortage of robotic arms. While many are suited for factory and warehouse work, others are destined for the food services industry. Turn a corner and you’re more likely than not to see an arm smoothly pouring a coffee, grabbing a soft drink or snack and presenting it to an attendee.

Below: A Hyundai robot that can lift and reposition autonomobiles. It’s part of the Hyundai WIA (World Industrial Ace) division.

USE-CASES

 

The robots at this show illustrate the many use-cases. There are welding robots, pick-and-place machines, and heavy-lift AMRs (Autonomous Mobile Robots) that can lift more than a ton. Need something stacked, sorted, inspected, delivered? Want a manipulator arm you can program to start preparing French fries the moment a take-out order has been placed by an app? Need a robot to move a car?

At Robot World 2023, you’ll find all of the above – and more.

 

ASSISTIVE DEVICES

 

But there was another category of robot on display at the exhibition: Assistive medical devices. Specifically, very smart machines that can be used for patients requiring rehabilitation.

InDro Robotics, which was invited to attend Robot World 2023, was struck by the number of companies with products in this sector. There were ground robots – friendly-looking devices that keep an eye on vulnerable people and can call for assistance if there’s a fall or some other crisis. But more intriguing to us were machines that can play a role – both physiologically and psychologically – in helping to rehabilitate someone from a serious injury or other challenging condition.

Below: A shape-shifting wheelchair wheel can climb stairs

Robot World Microsurgery

RE-LEARNING TO WALK

 

Like any major convention, exhibitors range from established global companies like Hyundai all the way to smaller startups with a great idea. And one that caught our attention is a company called Astrek Innovations. Its CEO and co-Founder is Robin Kanattu, a young engineer from Kerala in southern India.

“We are mainly focussing on building and designing products for the 20 per cent of people who are suffering from disability and accessibility issues,” says Robin. “One of the products is the lower limb exoskeleton, for people who are suffering form lower limb disabilities.”

As the company’s website explains:

“Established in 2018, we develop cutting edge solutions to some of our most complex problems – Disability and Rehabilitation. Leveraging our knowledge and expertise in robotics, machine learning and motion capture, we design devices that would transform the current state-of-the-art in the rehabilitation and assistive technology arena.

“Our magnum opus is a wearable robotic device, an exoskeleton, that would help people with lower-limb immobility walk again. A culmination of motorised limb braces, motion capturing & tracking; and machine learning; this device would transform rehabilitation into a precise, immediate treatment protocol.”

Established in 2018, the company has been building and testing versions of this product for four years.

“Now we have a final version, and we wanted to provide independence for people who are suffering form these disabilities,” he says.

A lot of research has gone into this product. Robin says a great deal of groundwork was spent capturing data on healthy people: How they walk, how they sit, how gaits alter during the course of a stride.

“Now we use that same data to predict the walking pattern of users, so they will have much more stable walking and standing while using the device.”

The exoskeleton provides support and strength and moves the legs. Forward-facing crutches are used to aid in stability. The product can be used on someone who is paralysed from the waist down, people recovering from strokes, those with certain genetic issues and people recovering from accidents.

 

HOW THE IDEA WAS BORN

 

Robin is an electrical engineer. But there was a personal motivation to put his skills to use in this arena.

“My grandfather had this issue. After having an accident, he was not able to walk properly. And after doing knee replacement surgery he was not able to walk again,” he explains. “So that’s how our team came togeher.”

Astrek has been recognized for product excellence at Robot World 2023, and Korea has brought the company in on a program called the K Startup Grand Challenge. Robin has been working in Korea on streamlining the manufacturing chain, working with mentors and looking for collaboration.

But the product, he says, is fully functioning. And people who are paralyzed from the waist down have been able to walk with it.

“Psychologically, they are so happy,” he says. “Their sole dream is to walk again, and we are happy to see them doing that.”

Robin did not have the prototype at the show because of red tape involving flying the batteries to Seoul. He’s pictured below with a banner showing the device.

Robin Kanattu Astrek

ROBOT REHABILITATION

 

Another company, RpiO, has already cracked the market. Its R-BoT plus is a device designed for people with central nervous system damage (including stroke, paraplegia, spinal cord injury etc.). It’s more of a rehab device designed for hospital settings, but allows users to exercise lower extremities while lying down or standing upright. The product is approved by a Korean regulatory body (Korean Ministry of Food and Drug Safey, formerly the KFDA), and the company has already sold seven units inside Korea.

“We have major hospitals, locals hospitals and private hospitals who are using the machine with people who have damage impacting their lower body,” explains CEO Jay Moh.

“Because KFDA is a standard in Southeast Asia, we are starting to sell in Hong Kong, Malaysia and Singapore. Many doctors have come to see our robots.”

The R-BoT plus works in three modes: Passive, active and resistive – depending on the patient’s abilities. What sets this device apart is that the person exercising watches a large-screen display during rehabilitation sessions. The display features outdoor scenes, and with every ‘step’ made, a footprint appears on the ground and the patient has a visual cue that they’re making progress. Distance covered, calories burned and heart rate are all displayed as well, providing further incentive.

“Once the machine starts, they look at the display,” he says. “This has been medically tested; this stimulates the brain and releases a chemical that stimulates recovery. People feel better – they enjoy the workout and feel like they’re walking through the grass.”

For those ready to actually move in the real world, the company also has a product called EXOwalk. Here, an exoskeleton is strapped to the patient’s limbs and can help move their legs (again, in multiple modes). But this exoskeleton is fixed to a rolling robotic platform – meaning the patient actually moves forward on the ground, rather than being fixed to a static machine.

“This is driven – so they actually move along the hallway in the facility.”

 

EXO Motion

 

For patients with upper limb motor impairments, the company has developed a product called EXO motion. This is strictly a portable exoskeleton device that attaches to the arm. In active mode, it detects myolectric signals from the user’s arm and – with some sophisticated algorithms and mechatronics – converts those signals into mechanical motion that moves the arm.

In addition to these robotic devices, RpiO also is a leading company in software designed to help people with dementia.

“We have a high population of elderly people who suffer with this,” says Moh. “So the market is growing very fast.”

Below: CEO Jay Moh, followed by the R-BoT plus and display. Note the footprints…

 

Robot World Korea R-BoT plus
R-BoT plus display

INDRO’S TAKE

 

We enjoyed checking out these devices at Robot World 2023 – and were pleased to see yet more evidence of #robotsforgood.

“Robots can be tremendous tools on their own,” says InDro Robotics CEO Philip Reece. “But there’s something truly special about products designed to directly help human beings improve their mobility and health. We applaud the inventors and engineers who develop these products, and look forward to even more assistive device breakthroughs in future.”

And a final note: The feature image at the top of this story shows some very, very, tiny arms used for microsurgery. InDro was able to take a run at the controls (pictured below). It took some patience, but we were able to grasp an impossibly small elastic band.

Now picture a highly skilled microsurgeon operating on someone remotely.

It’s happening now, thanks to robotics.

Robot World Microsurgery