2022: A great year for InDro Robotics

2022: A great year for InDro Robotics

By Scott Simmie

 

We thought, as we embark on a New Year, it might be fun to look back on the year that was. Specifically, to document some of the highlights that occurred within InDro Robotics.

Most of you are familiar with the company by now. For those who aren’t, InDro is a Research and Development company. We identify market needs and create new solutions we sell to clients. Sometimes companies (including very big ones) approach InDro and ask us to help them solve a problem. We also do service provision, deploying ground and aerial robots (drones) globally for complex tasks and data acquisition. In addition, we collaborate on many research projects, looking at new ways that technology can be put to positive use-cases.

You can get the Big Picture in this What InDro Does feature, but that’s it in a nutshell.

But what does that look R&D look like in the real world? Let’s recap our 2022 successes, starting with the launch of our Sentinel remote inspection robot.

InDro Robotics Sentinel

Remote inspection workhorse

 

Sentinel has been built, from the ground up, with one purpose in mind: To carry out remote inspections of facilities such as electrical substations or solar farms. These inspections are carried out over 4G or 5G, meaning the facility could be hundreds – even thousands – of kilometres away.

Sentinel’s rugged mobility has its roots in the workhorse Bunker platform. Featuring tread locomotion, it’s ideal for locations where the environment can at times be hostile. Mud, snow, ice are no deterrent. So that’s the brawn.

The brains come from InDro Robotics. Specifically, the addition of our InDro Commander module; the black and orange box sitting on top of the Bunker.

 

InDro Commander

InDro Commander

 

This module plays a significant role with Sentinel and other 2022 products. Commander is a bolt-on solution that enables remote teleoperations over 4G or 5G, as well as rapid sensor integration and other robot modifications. It contains a powerful Edge computer for onboard processing, as well as the complete Robot Operating System software libraries (ROS1 and ROS2). It’s literally Plug & Play – eliminating the time and hassle of manual sensor integration. You can get the full scoop on Commander here.

With Commander connected to the Bunker base, our engineers were ready to start customizing Sentinel. They added a 30x optical Pan-Tilt-Zoom (PTZ) camera – complete with a lens ‘windshield wiper’ for inclement weather – a thermal sensor and LiDAR. They also enabled wireless charging, and programmed optical recognition so that Sentinel can autonomously back up to its charging dock.

Plus, we made Sentinel super simple to operate. Running a dashboard on your laptop or desktop, you simply plug in an Xbox controller to control direction, speed and the camera’s PTZ functions. And the data? It comes into the dashboard with an easy-to-understand display. You can even customise it so that, for example, detection of a component with temperatures exceeding a predefined limit will set off an alert.

Below: A screengrab of the detailed Sentinel dashboard, during a mission you’ll hear about in a moment…

InDro Robotics

A substation solution

 

InDro developed Sentinel with remote teleoperation in mind. Specifically, for facilities like electrical substations, solar farms, etc. These installations are typically in rural locations, far from the nearest major city. They also tend to be unstaffed, requiring frequent inspection trips by human beings. In addition to scheduled monitoring, people are frequently dispatched following severe weather events to assess whether there’s been damage.

Wouldn’t it be easier to have a remotely teleoperated robot do the job on demand? We believe so.

In fact, we’re not the only ones with this kind of vision for remote inspection. One of the highlights of 2022 was being invited to Lenox, Massachusetts, by the Electric Power Research Institute, or EPRI. The non-profit institute is constantly carrying out research to look at how new technologies can be put to use to improve the generation and distribution of electrical power. Or, as it puts it, “driving innovation to ensure the public has clean, safe, reliable, affordable, and equitable access to electricity across the globe.”

It shares its findings with some 450 utilities and companies around the globe. And when it heard about Sentinel, InDro was invited down to its test facility. We spent a week there, putting Sentinel through its paces inspecting an EPRI test lab electrical substation. The facility can be energised or de-energised to determine whether electrical-magnetic fields interfere with test devices. It can simulate heavy rain through a set of overhead water pipes capable of drenching the facility. Plus, we ran the tests during the day and overnight, using both teleoperations and autonomous missions.

We were pleased with how Sentinel performed, and also learned a few things to even further tweak its capabilities. So Sentinel – which has been deployed as far away as a California solar farm – is definitely one of our 2022 highlights. You can learn more about our EPRI testing here.

Below: A video that offers a snapshot of key Sentinel features. This was Sentinel 1.0; we’ve since lowered the PTZ camera and made other enhancements.

The aerial side of things

 

While we’ve been looking at ground robots, InDro is very much involved in the world of drones. In fact, the company’s early years were pretty much exclusively devoted to R&D and service provision in the drone world. That’s still a large part of what we do.

An early 2022 highlight (and one of several) was our work with the Ottawa International Airport’s (YOW) Drone Detection Pilot Project. The program involves long-range drone detection hardware and software from InDro Robotics and micro-doppler radar detection from QinetiQ. Collectively, this technology provides a comprehensive look at any drone operations taking place in the vicinity of the airport – and beyond.

YOW, in conjunction with NAV Canada, is interested in getting a better picture of drone traffic in order to ensure the safety of crewed aircraft and to develop protocols should a Remotely Piloted Aircraft System pose a threat to traditional aircraft.

But data collected in early 2022 was an eye-opener. During the anti-vaccine mandate protests in Ottawa, InDro’s longer-range system detected drones flying in a restricted flight zone over Parliament Hill and elsewhere in the downtown Ottawa core, with a spike during police operations to clear the protests. A total of 27 different drones carried out 59 flights over a period of four days. Of those, 25 flights exceeded 400’ above ground level (Transport Canada’s limit, except in special circumstances). These flights all took place in restricted airspace. A small number were carried out by law enforcement, but the vast majority were not. Fifteen unique drone IDs were detected, and one flight took place at 1583′ AGL – nearly four times the legal altitude limit.

You’ll get a look at some of the data in the images below; you can also read an in-depth story here. The Ottawa Citizen also wrote about this. Finally, on the drone detection front, it’s worth noting that a sister company, Bravo Zulu Secure, specialises in both drone detection and mitigation.

 

Drone Detection

Expanding the capabilities of drones

 

InDro Robotics was a pioneer in remote operations, obtaining Canada’s first Special Flight Operations Certificates for Beyond Visual Line of Sight flights carried out over 4G and 5G networks. And we continue to push the envelope.

At our Area X.O facility, 2022 saw us successfully complete a technology challenge in conjunction with Ericsson, the Ontario Centre of Innovation, and the ENCQOR 5G network. The challenge involved building a drone with very specific capabilities, including enhanced BVLOS safety features and dense data transmission capabilities.

It was called the NERDs project – Network Enhanced Realtime Drone project. Here are some of the milestones it achieved:

  • Drone Command & Control (C2) over 5G
  • Transmission of telemetry back to the control station: altitude, speed, compass heading, high-precision GPS, battery level, ambient temperature, barometric pressure, etc.
  • Transmit ultra low-latency, uncompressed 4K video stream via 5G
  • Use a Software Defined Radio to transmit to nearby traditional aircraft that a drone operation in the area is underway

 

And how did we do it?

 

Area X.O took the lead on this project, building a module we call InDro Capsule. That capsule contained – among other things – a high-speed 5G modem, an Edge computer, and a software defined radio capable of informing crewed aircraft that a drone operation was taking place in the vicinity. Streaming, uncompressed 4K video also enhanced situational awareness for the pilot.

InDro Capsule has been designed to work with Enterprise drones using the Pixhawk flight controller. And so, just as the InDro Commander enables remote and secure teleoperations for ground robots, InDro Capsule is an add-on that can transform an Enterprise drone into a sophisticated BVLOS machine. If you’re interested in taking a deep dive on the NERDs project, InDro has produced a White Paper. You’ll find that here.

The first-generation InDro Capsule is that black hexagonal box seen below. InDro has now reduced its size and weight, and is currently deploying Capsule-enabled drones for remote industrial operations in South America. Those missions will be remotely tele-operated by Indro Robotics pilots in Canada.

Canada Drones

InDro Pilot

 

We knew the InDro Capsule module had the potential to truly transform the capabilities of Enterprise drones with Pixhawk flight controllers. And so we didn’t stop there. We built an entire platform to make the most of it. We call it InDro Pilot.

In a nutshell, it brings about both enhanced capabilities for the drone itself (ie 4G, 5G, dense data realtime uploads etc.) as well as enhanced options for the drone operator to further customize drone sensors and peripherals for any given mission via dashboard. All of that data is encrypted for secure download, direct-to-cloud upload, and Command & Control communication between the drone and our InDro Base ground station.

Because InDro Capsule enables the swift integration of additional sensors, we wanted to make that easy for the operator as well. InDro Pilot allows the pilot to customize their drone by simply adding software widgets for specific sensors. 

You can find more details in this post about InDro Pilot. But we’ll leave you with a glimpse of our winch widget. Others are available for LiDAR, thermal and other sensors. It’s simply drag and drop. We’ll be rolling out more about this in 2023, including the much smaller, commercial version of InDro Capsule.

InDro Robotics

ROLL-E and London Drugs

 

It was also quite a year for InDro delivery robots. Specifically, the deployment of our teleoperated ROLL-E and ROLL-E 2.0 in two separate pilot projects in conjunction with London Drugs.

The western Canadian retailer was initially interested in seeing how consumers might react to receiving curbside deliveries from a robot – and how such deliveries might fit into the company’s future plans. InDro had previously partnered with London Drugs to demonstrate the secure delivery of prescription drugs to remote locations via drone, so it was logical to partner up on this effort as well.

Because of the global pandemic, some consumers are more comfortable with curbside pickups rather than entering a store. So the first pilot project, at a single London Drugs location in Victoria, focussed on that. Customers would place their orders online; ROLL-E would deliver their order to a pickup point in the parking lot outside.

The results? People seemed to like the robot. And a local CTV reporter even had a little fun with ROLL-E.

A London Drugs store in Victoria is the first to test out a new remote controlled delivery robot for curbside service. https://t.co/aFOVT0iE1n— CTV News Vancouver Island (@CTVNewsVI) April 9, 2022

London Drugs, Part II

 

Those first curbside pickups were a success. And so we pushed ahead with a more sophisticated version of ROLL-E, coming up with a second-generation version. It has a secure and large cargo bay with a whopping 50kg capacity. And London Drugs was eager to try it out, this time for home deliveries in Surrey, BC.

ROLL-E 2.0 (which some employees have affectionately named “EVA”), featured some significant upgrades from the original, including:

  • A total of six cameras, including two sets of depth perception cameras at the front and rear for greater situational awareness for the operator
  • LED running lights, signal lights, brake lights
  • Greater all-weather protection and a touchscreen interface for customers

And how did it perform? Well, like this:

Good dog

 

The year 2022 also brought us a new product line, and a new partnership. Specifically, we’re talking about Unitree Robotics – a Chinese manufacturer of highly capable and affordable quadruped robots.

We’ve already been modifying these robots, adding on something we call the InDro Backpack. That’s the equivalent of the InDro Commander, which allows for teleoperations and additional sensor integration. We’ve even mounted a LiDAR sensor on one of the Unitree robots, with excellent results. We see a lot of potential for remote inspections with these machines in 2023. Indro Robotics is proud to be a North American distributor of the Unitree line.

Plus, these robots are just a lot of fun. Here’s InDro account executive Luke Corbeth with the entry-level GO-1:

Meet LIMO

 

2022 also saw the release of the LIMO robot, intended for educational purposes, R&D and more. As a distributor in North America, we’ve delivered LIMO to many clients who have been doing their own R&D work with this very versatile and smart machine. It comes, out-of-the-box, with the following:

  • An NVIDIA Jetson Nano, capable of remote teleoperation over 4G
  • An EAI X2L LiDAR unit
  • Stereo camera
  • Four steering modes (tracked, Ackerman, four-wheel differential, and omni-directional)

Customers love this thing – and so do we. If you’d like to learn more about LIMO, check this out.

LIMO

TCXpo

 

One of our highlights of the year was the TCXpo, a major public event put on by Transport Canada, Innovation, Science and Economic Development Canada, and Area X.O. InDro Robotics was one of the sponsors. Many Canadian technology companies were displaying their products, with an emphasis on Smart Mobility and other IoT devices.

InDro had its robots out in full swing; CEO Philip Reece was in charge of the airspace for the drone demonstrations – and a moderator for one of the excellent panel discussions. It was amazing to see the range of technologies on display and a clear sign that Smart Mobility is well on its way. Even the rain didn’t dampen the excitement.

You’ll hear a bit from Philip at the 2:18 mark of this video, and see him at 2:49.

Wait, there’s more!

 

Thanks for getting this far. We know you’ve got other things to do in 2023, so we’ll put a bow on this quickly with a few additional things we were up to in 2022.

Sister company Aerometrix continued its work doing methane detection and monitoring, using InDro Robotics pilots to carry out the work. The company has mapped methane emissions at petrochemical plants, gas wells, landfills – and even on agricultural sites. More on that work here.

We embarked on major long-term research at the University of British Columbia, in conjunction with Rogers, Honeywell and others. The project will use AI to help predict energy requirements for drone flights, taking into account payload, weather conditions, etc. It will also examine the capacity for 5G to carry out multiple simulataneous drone missions with minimal latency and interference. It will even compare the relative energy requirements of hydrogen-powered drones versus traditional LiPo batteries. Many more details can be found here.

We also launched FLYY, an online drone learning portal featuring one of Canada’s most recognized and respected instructors – InDro’s own Kate Klassen. If you’re looking to obtain your Basic or Advanced RPAS Certificate, schedule a Flight Review – or take a deeper dive into many other other drone course offerings – you’ll find it at FLYY. And if you’re part of an educational or company program, we offer group discounts. Email Kate for more info here.

Drone Training

Ssshhhhhh… it’s secret!

 

Finally, InDro continued work – and embarked on new work – with some very high-profile global clients in 2022. We can’t name names here due to NDAs, but we’re very pleased to be working on such interesting projects with such amazing companies. Trust us on this one; cool stuff is happening.

InDro’s Take

 

A company is, ultimately, only as good as its team. The accomplishments of 2022 reflect the skills, dedication and hard work of InDro employees in Vancouver, Victoria and at our Area X.O office in Ottawa.

“I’m incredibly proud of the work InDro accomplished in 2022,” says InDro CEO Philip Reece. “Our engineering and sales staff consistently punch above their weight, with multiple significant milestones – including excellent revenue growth – achieved in the past year. Just as gratifying is the fact our employees love what they do.”

That’s very true. On behalf of InDro Robotics, we wish you a Happy, Healthy and Prosperous 2023.

We look forward to sharing more as the year unfolds.

CONTACT

INDRO ROBOTICS
305, 31 Bastion Square,
Victoria, BC, V8W 1J1

P: 1-844-GOINDRO
(1-844-464-6376)

E: Info@InDroRobotics.com

copyright 2022 © InDro Robotics all rights reserved

Breaking drone regulations can be expensive

Breaking drone regulations can be expensive

By Scott Simmie

 

Drone regulations exist for a reason. Actually, multiple reasons.

Probably the most important is to keep airspace safe and avoid any potential collisions or interference with crewed aircraft. That’s why altitude is limited to 400′ above ground level (AGL), and why flights in controlled airspace must be cleared through NAV Canada’s NAV Drone app. (If you’re a drone pilot and don’t have this app, you can get more details and links to download here.)

And, just as a reminder on that front, drones carrying out basic operations must be at least 5.6 kilometres (three nautical miles) from airports and 1.9 kilometres (one nautical mile) from heliports.

One of the other key reasons is to protect people and property on the ground. If you’re flying a drone weighing more than 250 grams and less than 25 kilograms, you’ll need to ensure that you’re separated horizontally from bystanders by at least 30 meters – though drones with an RPAS Safety Assurance declaration can fly closer in Advanced operations.

There are, of course, other rules. No flying over outdoor concerts, parades or other special events. Some of you may recall that a drone pilot paid a hefty price during the victory parade for the Toronto Raptors in 2019. The person in question flew over the event and was fined $2750 by Transport Canada. (We actually were at that parade and saw the pilot take off; he was flying a DJI Mavic Pro.)

Breaking drone rules can be expensive.

Below: A 360° shot taken during Raptors celebrations. The illegal drone flight took off about 15m from where this image was taken.

Drone Regulations

There’s a reason behind every rule

 

The laws that govern drones in Canada are written up in a section of the Canadian Aviation Regulations, also known as CARs. Specifically, they reside in Part IX. We recommend that everyone flying a drone in Canada – particularly drones weighing more than 250 grams – has a read through this section. It lays out the rules very clearly.

And if you break those rules? Well, there’s a price to pay. Fines for individuals include:

  • up to $1,000 for flying without a drone pilot certificate
  • up to $1,000 for flying unregistered or unmarked drones
  • up to $1,000 for flying where you are not allowed
  • up to $3,000 for putting aircraft and people at risk

So it’s worth knowing the regs, because violating them can both create risk and be very costly.

 

Forest fires

 

Wildfires in Canadian forests cause major problems every year. Significant resources are allocated to try to control and extinguish these fires – which often occur in remote locations. Aerial firefighting techniques are a big part of the equation, with water bombers and helicopters routinely deployed. (You can get a snapshot of the current wildfire situation in Canada with this interactive map. At the time this article was written, a significant Alberta fire – north of Banff and east of Lake Louise – was out of control. That fire started August 31 and has been burning for three and a half months.)

Helicopters are used to transport crews, and occasionally drop fuel retardant on small hotspots. Water bombers come in low to take on water from lakes and also drop that same water on fires from low altitudes so that targeting is accurate and there’s minimal dispersal of the fluid on the way to the ground.

And both of those scenarios? They mean these aircraft are often flying below 400′ AGL.

Drone regulations

Keep your drone clear of forest fire operations

 

With that context, you no doubt have guessed where we’re going with this. Rules in CARs Part IX prohibit flying drones near forest fire operations. In fact, you must keep drones (and other aircraft not involved with the operations) at least five nautical miles (9.3 kilometres) away from the scene. There is also a mechanism within the Canada National Parks Act that allows for the prohibition of activities – including the banning of drone flights.

Recently, a drone pilot found out just how seriously regulators take flying drones close to a wildfire. A Canadian Press story published December 9th says that Rajwinder Singh was found guilty in an Alberta provincial court of the offence and fined $10,000.

In fact, Singh was one of four people charged for flying too close to the Chetamon wildfire in September. Four drones were also seized by authories.

 

InDro’s role

 

 

InDro Robotics played a role on the technology side. The company supplied drone detection equipment capable of identifying models, location and trajectory of drones in proximity of Alberta wildfires.

InDro is also involved with the Ottawa International Airport Authority’s ongoing Drone Detection Pilot Project at the Ottawa International Airport. Early in 2021, during the convoy blockade that took place in Ottawa, that project detected a very high number of illegal drone flights taking place over sensitive areas in the capital’s downtown core.

In fact, a sister company of InDro Robotics – Bravo Zulu Secure – specializes in drone detection and mitigation systems. InDro Founder and CEO Philip Reece is the Chief Technical Officer of Bravo Zulu. Here, he explains some of the company’s proprietary systems:

InDro’s Take

 

We’ve been in this business long enough to remember the early days. The drone space was often called The Wild West, because many people were either unaware of regulations or chose to willfully ignore them. This was particularly true of rogue pilots, usually recreational operators, who would carry out reckless flights. Those flights often (and rightfully) received negative press coverage and caused regulators to take an even more cautious, incremental approach with opening up the skies. Understandable.

Since then, the drone community has done a great job of educating and even policing itself. Flights like the four that took place near that Alberta wildfire are now, fortunately, very rare.

But, as we’ve seen here, they still happen. Not only is it wise for drone operators to become fully familiar with Part IX of CARs, but also to be aware that hefty fines can and will be imposed on those who violate the law. It’s also worth remembering, regardless of location, that the technology exists to detect these flights, along with the location of the operator.

Thankfully, the vast majority of drone pilots know the regulations – and abide by them.

Still a long road to fully autonomous passenger cars

Still a long road to fully autonomous passenger cars

By Scott Simmie

 

We hear a lot about self-driving cars – and that’s understandable.

There are a growing number of Teslas on the roads, with many owners testing the latest beta versions of FSD (Full Self-Driving) software. The latest release allows for automated driving on both highways and in cities – but the driver still must be ready to intervene and take control at all times. Genesis, Hyundai and Kia electric vehicles can actively steer, brake and accelerate on highways while the driver’s hands remain on the wheel. Ford EVs offer something known as BlueCruise, a hands-free mode that can be engaged on specific, approved highways in Canada and the US. Other manufacturers, such as Honda, BMW and Mercedes, are also in the driver-assist game.

So a growing number of manufacturers offer something that’s on the path to autonomy. But are there truly autonomous vehicles intended to transport humans on our roads? If not, how long will it take until there are?

Good question. And it was one of several explored during a panel on autonomy (and associated myths) at the fifth annual CAV Canada conference, which took place in Ottawa December 5. InDro’s own Head of Robotic Solutions (and Tesla owner) Peter King joined other experts in the field on the panel.

 

Autonomous Cars

Levels of autonomy

 

As the panel got underway, there were plenty of acronyms being thrown around. The most common were L2 and L3, standing for Level 2 and Level 3 on a scale of autonomy that ranges from zero to five.

This scale was created by the Society of Automotive Engineers as a reference classification system for motor vehicles. At Level 0, there is no automation whatsoever, and all aspects of driving require human input. Think of your standard car, where you basically have to do everything. Level 0 cars can have some assistive features such as stability control, collision warning and automatic emergency braking. But because none of those features are considered to actually help drive the car, such vehicles remain in Level 0.

Level 5 is a fully autonomous vehicle capable of driving at any time of the day or night and in any conditions, ranging from a sunny day with dry pavement through to a raging blizzard or even a hurricane (when, arguably, no one should be driving anyway). The driver does not need to do anything other than input a destination, and is free to watch a movie or even sleep during the voyage. In fact, a Level 5 vehicle would not need a steering wheel, gas pedal, or other standard manual controls. It would also be capable of responding in an emergency situation completely on its own.

Currently, the vast majority of cars on the road in North America are Level 0. And even the most advanced Tesla would be considered Level 2. There is a Level 3 vehicle on the roads in Japan, but there are currently (at least to the best of our knowledge and research), no Level 3 vehicles in the US or Canada.

As consumer research and data analytics firm J.D. Power describes it:

“It is worth repeating and emphasizing the following: As of May 2021, no vehicles sold in the U.S. market have a Level 3, Level 4, or Level 5 automated driving system. All of them require an alert driver sitting in the driver’s seat, ready to take control at any time. If you believe otherwise, you are mistaken, and it could cost you your life, the life of someone you love, or the life of an innocent bystander.”

To get a better picture of these various levels of autonomy, take a look at this graphic produced by the Society of Automotive Engineers International.

Autonomy

Now we’ve got some context…

 

So let’s hear what the experts have to say.

The consensus, as you might have guessed, is that we’re nowhere near the elusive goal of a Level 5 passenger vehicle.

“Ten years ago, we were all promised we’d be in autonomous vehicles by now,” said panel moderator Michelle Gee, Business Development and Strategy Director with extensive experience in the automotive and aerospace sectors. Gee then asked panelists for their own predictions as to when the Level 4 or 5 vehicles would truly arrive.

“I think we’re still probably about seven-plus years away,” offered Colin Singh Dhillon, CTO with the Automotive Parts Manufacturers’ Association.

“But I’d also like to say, it’s not just about the form of mobility, you have to make sure your infrastructure is also smart as well. So if we’re all in a bit of a rush to get there, then I think we also have to make sure we’re taking infrastructure along with us.”

Autonomous Cars

It’s an important point.

Vehicles on the path to autonomy currently have to operate within an infrastructure originally built for human beings operating Level 0 vehicles. Such vehicles, as they move up progressive levels of autonomy, must be able to scan and interpret signage, traffic lights, understand weather and traction conditions – and much more.

Embedding smart technologies along urban streets and even on highways could help enable functionalities and streamline data processing in future. If a Level 4 or 5 vehicle ‘knew’ there was no traffic coming at an upcoming intersection, there would be no need to stop. In fact, if *all* vehicles were Level 4 or above, smart infrastructure could fully negate the need for traffic lights and road signs entirely.

 

Seven to 10 years?

 

If that’s truly the reality, why is there so much talk about autonomous cars right now?

The answer, it was suggested, is in commonly used – but misleading – language. The term “self-driving” has become commonplace, even when referring solely to the ability of a vehicle to maintain speed and lane position on the highway. Tesla refers to its beta software as “Full Self-Driving.” And when consumers hear that, they think autonomy – even though such vehicles are only Level 2 on the autonomy scale. So some education around langage may be in order, suggested some panelists.

“It’s the visual of the word ‘self-driving’ – which somehow means: ‘Oh, it’s autonomous.’ But it isn’t,” explained Dhillon. “…maybe make automakers change those terms. If that was ‘driver-assisted driving,’ then I don’t think people would sleeping at the wheel whilst they’re on the highway.”

One panelist suggested looking ahead to Level 5 may be impractical – and even unnecessary. Recall that Level 5 means a vehicle capable of operating in all conditions, including weather events like hurricanes, where the vast majority of people would not even attempt to drive.

“It’s not safe for a human to be out in those conditions…I think we should be honing down on the ‘must-haves,’ offered Selika Josaih Talbott, a strategic advisor known for her thoughtful takes on autonomy, EVs and mobility.

“Can it move safely within communities in the most generalised conditions? And I think we’re clearly getting there. I don’t even know that it’s (Level 5) something we need to get to, so I’d rather concentrate on Level 3 and Level 4 at this point.”

 

Autonomous Cars

InDro’s Peter King agrees that Level 5 isn’t coming anytime soon.

I believe the technology will be ready within the next 10 years,” he says. “But I believe it’ll take 30-40 years before we see widespread adoption due to necessary changes required in infrastructure, regulation and consumer buy-in.”

And that’s not all.

“A go-to-market strategy for Level 5 autonomy is a monumental task. It involves significant investments in technology and infrastructure – and needs to be done so in collaboration with regulators while also factoring in safety and trust from consumers with a business model that is attainable for the masses.”

What about robots?

Specifically, what about Uncrewed Ground Vehicles like InDro’s Sentinel inspection robot, designed for monitoring remote facilities like electrical substations and solar farms? Sentinel is currently teleoperated over 4G and 5G networks with a human controlling the robot’s actions and monitoring its data output. 

Yet regular readers will also know we recently announced InDro Autonomy, a forthcoming software package we said will allow Sentinel and other ROS2 (Robot Operating System) machines to carry out autonomous missions.

Were we – perhaps like some automakers – overstating things?

“The six levels of autonomy put together by the SAE are meant to apply to motor vehicles that carry humans,” explains Arron Griffiths, InDro’s lead engineer. In fact, there’s a separate categorization for UGVs.

The American Society for Testing and Materials (ASTM), which creates standards, describes those tiers as follows: “Currently, an A-UGV can be at one of three autonomy levels: automatic, automated, or autonomous. Vehicles operating on the first two levels (automatic and automated) are referred to as automatic guided vehicles (AGVs), while those on the third are called mobile robots.”

“With uncrewed robots like Sentinel, we like to think of autonomy as requiring minimal human intervention over time,” explains Griffiths. “Because Sentinel can auto-dock for wireless recharging in between missions, we believe it could go for weeks – quite likely even longer – without human intervention, regardless of whether that intervention is in-person or virtual,” he says.

“The other thing to consider is that these remote ground robots, in general, don’t have to cope with the myriad of inputs and potential dangers that an autonomous vehicle driving in a city must contend with. Nearly all of our UGV ground deployments are in remote and fenced-in facilities – with no people or other vehicles around.”

So yes, given that InDro’s Sentinel will be able to operate independently – or with minimal human intervention spread over long periods – we are comfortable with saying that machine will soon be autonomous. It will even be smart enough to figure out shortcuts over time that might make its data missions more efficient.

It won’t have the capabilities of that elusive Level 5 – but it will get the job done.

InDro’s take

 

Autonomy isn’t easy. Trying to create a fully autonomous vehicle that can safely transport a human (and drive more safely than a human in all conditions), is a daunting task. We expect Level 5 passenger vehicles will come, but there’s still a long road ahead.

Things are easier when it comes to Uncrewed Ground Vehicles collecting data in remote locations (which is, arguably, where they’re needed most). They don’t have to deal with urban infrastructure, unpredictable drivers, reading and interpreting signage, etc.

That doesn’t mean it’s easy, of course – but it is doable.

And we’re doing it. Stay tuned for the Q1 release of InDro Autonomy.

 

Coming soon: InDro Autonomy software

Coming soon: InDro Autonomy software

By Scott Simmie

We’ve got news.

InDro Robotics is in the final stages of a new product that will vastly improve the capabilities of ground robots running on ROS2 or ROS1 Robot Operating System libraries. In short, it will transform a remotely tele-operated machine into an autonomous one. The software – no surprise here – is called InDro Autonomy.

“It’s our solution to automating the mundane tasks of outdoor navigation,” says Arron Griffiths, lead engineer at InDro’s Area X.O R&D facility in Ottawa, Ontario.

As you know, ground and aerial robots excel at jobs often referred to as “The Three Ds” – meaning tasks that are dirty, dull or dangerous (and sometimes all three). We would actually add a fourth “D” to that set and include jobs that are distant.

Think, for example, of remote locations such as electrical substations or solar farms. Currently, most robots (including many InDro products in the field) are remotely tele-operated by someone connecting with those robots over 4G or 5G networks. That’s an awesome capability, and one being put to use regularly by InDro clients. (In fact, we recently did a demonstration for T-Mobile at an Analyst’s Summit in Washington State. Attendees could operate a robot using an Xbox controller in real-time. The robot was in Ottawa – some 4,000 kilometres away.)

So tele-operation will still be with us, and is exceedingly effective for many use-cases. But there are some tasks where autonomy would be preferable.

Below: InDro’s Austin Greisman tweaks a Sentinel robot at our Area X.O facility

Robot Autonomy

Why autonomy?

 

While tele-operations are appropriate for a variety of inspection and surveillance tasks, there are cases where autonomy is a preferable option. Specifically, when a robot is repeatedly carrying out the same route/mission. This is especially true when the path becomes larger, such as inspections at solar farms. Why assign a human being to control a robot for a lengthy and repetitive task when a robot can carry it out on its own? That’s where InDro Autonomy comes in.

“Solar farms can be absolutely massive and very hard to maintain,” explains Griffiths. “Having a human walk or even drive through with a thermal camera is very inefficient. Our Sentinel ground robot, for example, can do this on its own.”

InDro’s Austin Greisman, who has been integral to InDro Autonomy’s development, puts it like this:

“Performing routine inspection checks – going to see the same thing over and over again – can be automated with this type of system,” he says. “So you just collect the data.”

 

Compatability

 

InDro Autonomy was inspired by our exclusive Commander module. It’s a bolt-on solution for ground robots that allows for rapid customisation and sensor integration. It does so by containing the complete Robot Operating System (ROS2) software library onboard, as well as an Edge computer for real-time processing. With its 4G and 5G tele-operating capabilities, open USB slots, built-in camera and slick User Interface, it’s a snap to add and integrate sensors and carry out remote missions via dashboard.

While InDro Autonomy was developed to work seamlessly with Commander-enabled robots, our developers wanted to maximise interoperability. So while Commander takes the pain out of robot customisation, you don’t have to have it to deploy InDro Autonomy.

“Not only does InDro Autonomy fully work with any platform Commander supports, InDro Autonomy will work with any ROS2-based Robot that has an IMU, GPS, and wheel odometry,” says Greisman.

Here’s a look at the Commander module, the box that’s the brains of Sentinel. It’s directly above the robot treads.

 

InDro Sentinel

How does it work?

 

With lots of coding, lol.

But there’s more than that, of course. InDro Autonomy works by recording its path via GPS during an initial tele-operated cruise through the desired route. In the case of Commander-enabled robots, that GPS trail is immensely accurate.

“We have a very high quality GPS unit in Commander that is accurate to around 5 cm,” explains Greisman. “As the robot moves, it drops GPS breadcrumbs. Later on, at any time, even if you reboot it and drop it somewhere random, it will understand where it is relative to where it’s been – so if can figure out where it needs to go next.”

 

Wait, there’s more!

 

And there is.

Greisman says InDro Autonomy has been designed for even very large spaces. Often, covering more territory requires greater onboard computational power. Not with this system.

“You can be in as big of a space as you like and there’s no computational limitation to that. What sometimes happens with autonomy systems, as you go to a bigger space you need more computational power, and this system has been designed to be efficient on low compute platforms. So this allows us to keep costs low for the client as well.”

 

Anomaly detection, alerts

 

As InDro Autonomy gets ready for a Q1 2023 release, InDro’s R&D team has a few other features it’s planning on adding to the software.

Because it’s all about autonomous missions, it’s assumed that not every inspection will be monitored in real-time. All captured data will be georeferenced and stored, of course, with the ability to review any mission remotely. But InDro thought it would be good to take things even further.

InDro is baking in the ability to customize the software per customer requests. So, for example, if components at an electrical substation should not exceed 50° Celsius, an alert will be sent by text or email if the robot detects temperatures exceeding that parameter. Engineers are also looking into integrating an early warning system for arcing, which could be triggered by its unique sonic signature. Plus, Commander-enabled robots will have the ability to autonomously snug right up to their charging docks.

So InDro Autonomy has a lot of features. And they’re coming soon.

InDro’s take

 

When InDro engineers developed the InDro Commander, we knew we had something special. And it wasn’t long before a growing number of clients realized that fact. Our Commander module became popular because it simplified a previously painstaking task, making a tough and time-consuming job easier.

We feel the same way about InDro Autonomy – and we believe our clients will, too.