A deep dive into our Sentinel inspection robot

A deep dive into our Sentinel inspection robot

By Scott Simmie

 

Back in 2022 we officially took the wraps off Sentinel – a workhorse robot aimed at remotely inspecting assets like electrical substations.

Before we even designed and built Sentinel, our engineering and sales team put a lot of thought into what would need to go into such a robot. We knew, first and foremost, it had be rugged and capable regardless of terrain. It had to be nearly impervious to inclement weather. It had to be capable of transmitting even dense data from hundreds or thousands of kilometres away from the client. Plus, it had to be equipped with state-of-the-art sensors. Oh yes, it also needed to perform self-diagnostics and send back an easy to read overall health report.

And then our team at Area X.O got to work.

Below: Sentinel

INVENT, ENHANCE, DEPLOY

 

You may have heard that phrase before. It’s a quote from Founder and CEO Philip Reece that succinctly encapsulates what InDro does. It has since become our tagline, and if you see us at a convention you’ll see it on our branding.

The reason we emphasize this now is because InDro remains committed to this ethos. Once we have a product out in the field, we don’t rest on our laurels. We gather learnings from our testing, deployments, and – most importantly of all – our clients to see if we can make an already good product better.

Sentinel featured high-power onboard compute, a 30x optical PTZ camera (complete with wiper!), a thermal sensor and more. It also carried the ROS1 software library onboard which – among other things – allowed Sentinel to instantly recognise any new sensors that were added or replaced. It came equipped with a high-speed modem for remote teleoperations. And it had a pretty good version of our own InDro Autonomy stack.

During a demonstration from Washington State we connected over a 5G network to Area X.O in Ottawa. The two locations were more than 4100 kilometres apart. At the Bellevue end, we had an Xbox controller connected to a laptop. That laptop was logged into a third-party console for remote operations.

At the other end, Sentinel was awaiting instructions. We showed several people the basics of how to operate (and it doesn’t get more intuitive than an Xbox controller) and let them take a spin. You might well think, given the distance involved, there would have been a perceptible lag. There wasn’t (I was there). The response was so instantaneous it was almost like playing a video game. Plus, realtime data – including a video feed – was coming in from Sentinel’s sensors.

 

THE EPRI DEPLOYMENT

 

Testing robots – particularly robots like Sentinel – in a real-world environment is crucial. And, since Sentinel was designed for the remote inspection of critical assets like electrical substations, we caught the attention of EPRI – the Electric Power Research Institute. The non-profit organization is constantly doing research, collaborating with more than 450 private companies across 45 countries globally.

EPRI has multiple research facilities, including one in Lenox, Massachusetts. This particular location features an electrical substation that can be energised, de-energised – and can even simulate rain for testing purposes. So we took Sentinel down there and put it through its paces. We ran it through every variation of testing they could throw at it, including nighttime missions (with the substation both energised and de-energised) as well as with and without rain in each of those scenarios. (Yes, we did daytime missions as well.)

The purpose was to see how well Sentinel could perform in that very much real-world setting. It did very well – though we aso learned some lessons. We discovered that gravel could occasionally get caught between the gears and the treads. And, more importantly, we found that capturing and delivering all that data while doing remote ops put a crushing demand on the compute (a Jetson Xaiver NX).

“We were maxing out the CPU,” recalls Head of R&D Sales Luke Corbeth, who was on that mission. “We were at pretty much 99 per cent usage.”

Over the course of subsequent deployments and testing, we began to explore ways to improve Sentinel.

Below: Data flows through the third-party console we were using at the time to monitor missions

UPGRADED INTERIOR, EXTERIOR

We’ve always had a consistent vision for Sentinel and its use-cases.

“The concept has basically gone unchanged since our initial vision,” says Corbeth. “We envisioned certain industries with an emphasis on the value of preventative maintenance. That has remained the focus.”

But as we encountered new environments and challenges, we worked on ways to improve the build. We are now taking advantage of the latest in AI processing, giving these robots the NVIDIA Jetson AGX Orin Developer Kit for compute. It’s capable of up to 275 trillion operations per second (TOPS) – and is a huge leap forward in compute and AI recognition. Plus, you can throw literally everything at it and it doesn’t break a sweat.

“We’re now able to operate – with all data streaming – at about 30 to 40 per cent of the CPU’s capacity,” says Corbeth.

An optional platform upgrade brings us to the Bunker Pro, which has better weather protection (including skirts that prevent gravel from getting stuck) and longer run time. We moved to the latest models of PTZ and thermal cameras to ensure exceptional resolution and the best imagery in low-light situations. We integrated more pinhole cameras for 360° situational awareness and added a second depth perception camera. We can also add a range finder and two hemispherical LiDAR units, pending client needs. (There’s also the option of safety LiDAR units if Sentinel is deployed around people.)

And that’s just for starters. In addition, InDro’s engineering team can add:

  • New connectivity module for greater bandwidth and lower latency
  • Improved GPS and IMU units
  • The latest InDro Autonomy stack

All of these capabilities ensure Sentinel can operate with precision in unfamiliar and GPS-denied environments. It returns to base and recharges wirelessly without any mechanical connection (thus avoiding a potential point of failure).  It can capture flawless digital twins of entire facilities.

And InDro is in control of all facets of production.

“With the introduction of InDro Forge, we’ve been able to do all of the design and manufacturing in-house,” says Corbeth.

Below: Sentinel combines brains with brawn

InDro Sentinel

MISSION PLANNING

 

Remember how we mentioned originally operating Sentinel via a third-party console? Well, despite getting pretty low latency we found some things were lacking. We wanted a more intuitive and powerful system for controlling Sentinel and setting up autonomous missions. We also wanted a console with bulletproof security.

So we built one. InDro Controller both improves the user experience and adds more power and customization features for the client. We asked Luke to walk us through how easy it is for a client to plan a mission.

“So the robot will always begin its mission starting in the doghouse where it’s actively wirelessly charging, ready to deploy at a moment’s notice with full battery. Deployments can be automated and autonomous, or manually operated,” he explains.

Most clients prefer to have autonomous missions. And InDro is happy to help set up optimal mission planning, with specific repeatable actions at various waypoints. The exceptional AI and machine vision onboard means that Sentinel can not only recognise a gauge – it can understand the reading.

“So we help create the most efficient and safest route for the robot to follow. And at each of its specific waypoints, it’s capturing high-resolution photos, video or thermal data. It will remember, for example, to not only stop but to adjust the camera and zoom in on a specific predetermined asset. You’ll get actionable data with every mission,” adds Corbeth.

Watch both Sentinel and InDro Controller at work in the video below

INDRO’S TAKE

 

There are even more enhancements on the way for Sentinel that we didn’t explore in this post. If you’re curious, you can check out even more features here.

“Sentinel is an exceptionally well-engineered product – where every design decision was made with the client in mind,” says InDro Robotics Founder and CEO Philip Reece. “It has already drawn attention from those seeking a cutting-edge solution to autonomous remote inspections. A US client just purchased several for precisely that use-case, and we’ll be completing those builds shortly.”

Interested in a demo? Get in touch with Luke Corbeth and he’ll set you up.

Let InDro Robotics pilot your next inspection mission – remotely

Let InDro Robotics pilot your next inspection mission – remotely

Picture this: You run a solar farm. And it’s time for a routine inspection to detect faulty or damaged solar cells.

Traditionally, you’ve inspected using a handheld thermal sensor – hoping to identify any anomalies on your solar panels. It does the job, but it’s time-consuming. You’re aware that drones are capable of carrying out this task much more rapidly, but that’s not a simple solution either. The time and expense of training an in-house pilot to meet the regulatory bar, along with the cost of a drone with a thermal sensor, add up.

What options do you have? Well, you could hire someone from outside on a contract basis. That gets pricey as well, since the fee generally includes travel time and other expenses for the operator. Like most solar farms, your facility is located in a rural area far from the nearest major city.

InDro Robotics is pleased to offer a solution: We ship you a fully-charged drone with thermal sensor, and we fly the mission remotely.

And how does that work? Well, just like this:

Inspections without the hassle

 

Let’s back up a bit.

InDro created this solution in response to a need. Solar and other industries told us they understood the value proposition of drone inspections but couldn’t justify the cost of purchasing a drone with the appropriate sensor for their needs. Many also said they didn’t need a drone pilot on staff.

And so we started thinking of options that would work within the current regulatory framework. In Canada, as long as the pilot is in contact with a visual observer monitoring the flight, these missions can be carried out without additional permissions beyond notifying NAVCAN of the flight.

“It’s a straightforward solution for solar farms or other clients requiring any form of aerial inspection,” explains Peter King, InDro’s Head of Robotic Solutions. “A qualified pilot instructs the client how to turn on the drone and monitor airspace. A pilot from InDro Robotics takes care of the rest, capturing and delivering meaningful data to the client – and at a significantly lower price point than having a contractor travel to the client’s location.”

And when the drone lands? The client simply powers it off, puts it back in the box, and ships it to the nearest InDro Robotics location (there are five in Canada).

 

Wait – there’s more!

Remotely Operated Drones

Secure, remotely operated flights

 

If you follow our news, you’ll be aware we have created our own, proprietary platform for low-latency operations with high data bandwidth. We call the system InDro Pilot, and you can take a deeper dive here.

This system, which includes a special hardware module we’ve developed, is capable of exceedingly low-latency over 5G connections. It can also be operated over 4G as well. So regardless of where you need an inspection, we can carry it out as long as there’s a cellular connection. If that connection is 5G, we have the capability to upload your data in real-time to the cloud for processing – meaning you’ll receive meaningful and actionable data as soon as possible following the flight.

What’s more, the InDro Pilot system also informs traditional aircraft in the vicinity that a drone operation is underway at your location. This “Hear and be Heard” function, using a Software Defined Radio, reduces the likelihood of any conflict with low-flying aircraft.

If you check out the photo below, the black module on our WayFinder contains an Edge processor, high-speed modem, the Software Defined Radio – and much more. This is an integral ingredient in the secret sauce of InDro Pilot.

Canada Drones

InDro’s Take

 

Not surprisingly, we’re keen on this solution.

But that’s not just because we created it. We truly believe this fills a niche in the marketplace, offering value to those who require top quality data collection and analysis but infrequent flights. For companies requiring up to four annual inspections, missions carried out remotely by InDro Robotics specialists are a cost-effective solution. We simply ship you the drone, ready to fly out of the box. All you have to do is watch the sky and keep in touch with our pilot during the flight – and the data will be your way in no time. And, by the way, InDro Robotics was the first company in North America to carry out a remote inspection in this way.

We are currently offering this solution in Canada. US operations are slightly more complex due to the FAA’s differing regulations, but not impossible.

To learn more of receive a quote for remote data acquisition, contact us here.

Voliro brings a new solution to an old inspection problem with aerial Non-Destructive Testing

Voliro brings a new solution to an old inspection problem with aerial Non-Destructive Testing

By Scott Simmie, InDro Robotics

Imagine, for a second, you’re an engineer responsible for the integrity of an aging water tower. The steel structure is elevated about 10 metres off the ground and is spherical in shape.

From your vantage point on the ground, it appears to be okay. There’s no visible rust, but you’re concerned there could be corrosion beneath the paint.

What are your options? Well, you could send someone up to inspect it visually. Or, better yet, have them take a specialized tool that can precisely measure the thickness of that metal or even the paint or coating on the surface – simply by touching it.

This is known as Non-Destructive Testing, or NDT. In the photo you’re about to see, there’s a ladder leading to a lower-level catwalk. This provides some access for an inspector – but only allows them to examine a fraction of the entire structure.

In order to make a complete inspection you’ll need to look at other options. Will you build scaffolding beneath and surrounding the structure so the worker has a safe platform from which to carry out the measurements? Will you rig them with a safety harness and ropes and lower them from the top of the tank? Might you have them attach the sensor to a super-long stick?

None of these choices are optimal, and the first two involve varying degrees of risk (falls from height are one of the leading causes of death or disability in the workplace). You’ll also have to ensure you’re fully compliant with a host of worker safety regulations – all of which exist for very good reasons. Plus, scaffolding is an expensive proposition and will require about a week for a contractor to put up and then disassemble. And sticks or poles? Well, the longer the reach the more cumbersome and awkward the task.

Take a really good look at the image below. How would you solve the problem? How would you deploy resources in order to get measurements from anywhere on the water tower’s surface? And what about that black semi-sphere at the bottom? Tricky.

Of course, you’d face the same issue if you wanted to spray-paint or apply some other coating to the surface. In fact, it’s the latter issue that the engineers who developed this product initially set out to solve.

(Photo by TheTechnician27, via Wikimedia Commons)

Voliro

A Swiss solution

Back in 2016, engineering students Timo Müller and Mina Kamel set out to design a drone that could do that kind of work – spraying paint or coatings. They were at Switzerland’s Zürich ETH, a research university that has been a catalyst for a number of successful technology startups.

Working in the ETH Lab, they started from scratch on the project. But as it evolved, they realized there was an even greater need for a drone that could carry out Non-Destructive Testing, which requires that the sensor attached to the flying robot physically touch the surface of the asset being inspected. That asset might be the hull of a ship, the interior of a tall steel tank – even the massive pylons that support high-power transmission lines.

They knew that a standard quadcopter would not be up to the task. Turbulence was one issue. But they also wanted to design a product that could point its sensor anywhere in space – and then make precise contact with pressure.

Picture a drone inside a sphere, with a sensor pointing forward. The Voliro T is capable of directing that sensor anywhere within that sphere, then holding it against the surface with a force of up to three kilograms.

You’ll get a better idea of what we mean in this video. What this drone can do would be impossible for a standard quadcopter. (And yes, it can still paint!)

Multiple advantages…

At first glance, you might think of this as a tricopter. But it’s really very different. First of all, the motors are in a T-5 configuration – with twin rotors on each forward arm and a single rotor for stability in the rear. Traditional tricopters use a Y configuration, with a servo tilting that rear motor for yaw authority. This rear motor is fixed, but the forward motors can be tilted and rotated forward or aft for precise thrust vectoring.

This unusual design means the Voliro T can be stable when pointed in literally any direction in space. Think back to that water tank. This drone could take measurements from the bottom-up, the top-down, and everywhere in between. The design intrigued us enough that we got in touch with Voliro.

“We exist because we want to remove working at height,” explains Chris Udell, Voliro’s Business Development Lead, adding that the Voliro T “is one of the first drones to be designed from the very start to push against a surface.”

That’s not something you can do with a quadcopter, at least not reliably.

“We’ve seen a lot of cowboys where they’ve strapped an NDT sensor to a multirotor,” he says. “Standard multirotors are amazing tools…but what they cannot do is touch a surface reliably and hold position.” That’s because turbulence close to structures can really mess with a stable position hold.

“So multirotors are really the wrong tool for the job. The other advantage is that you can push between two and three kilograms of force on the surface.” That pressure is needed for some of the sensors to get accurate readings – and another reason why long poles are a challenging option. The greater the height, the more difficult it is to apply pressure from below.

Universal payload interface

One of Voliro’s value propositions is the ability to quickly swap sensors, depending on the task.

The Voliro T interfaces with three different NDT sensors, each of which is designed to capture specific kinds of data.

They are:

 

Ultrasonic Flaw Detector
Measures the thickness of materials, including metals, composites and plastics
Electro-Magnetic Acoustic Transducer (EMAT) Thickness Gauge
This one measures the thickness of conductive materials, such as iron or mild steel
ElektroPhysik MiniTest
Measures the thickness of dry films, such as paint or coatings or wraps – even metallic plating (chrome, zinc, nickel)
Voliro
“Because we’ve got different sensors,” explains Udell, “we have pylon inspections, offshore and onshore storage tanks, wind turbines, commercial ships (and more).”

Years in development

 

We know, from experience, that developing new products is challenging, exhilarating, and time-consuming. Though Voliro is now in the hands of some major early adopter clients, it wasn’t an overnight slam-dunk. The Voliro team, starting with Mina Kamel and Timo Müller – who’s also a former professional Skicross athlete (think motocross on skis) – have been at this now for six years.

That’s some tough slogging. But throughout the evolution of this product, there were regular technological milestones – as well as recognition and funding – that continuously validated the vision. Voliro provided a timeline of the company’s history; it’s impressive.

Voliro

Saves time, money

Of course, none of this effort would have been worthwhile if the final product didn’t offer a clear value proposition. Voliro says its field work has proven, repeatedly, that this system is faster and more cost-effective than traditional methods. In one of its case studies, using the Voliro T saved the installation and tear-down of some 615 cubic meters of scaffolding – which would have required 400 person-hours of labour. Working on a single asset, a pilot and inspector working in tandem can capture about 200 measurements per hour.

In another example, Voliro carried out ultrasonic flaw detection inside a total of five steel tanks – measuring the walls and roofs of the assets. Scaffolding would have been impossible inside this tank, and rope access (dangling an inspector with a handheld sensor) wasn’t feasible. And the old stick method? That’s limited to a height of 12 metres, meaning in this case only limited coverage would have been possible.

The Voliro T completed inspection of all five tanks in just 1.5 days, taking a total of 700 measurement points. Each of those points was geo-referenced and also captured in 4K video. In fact, the Voliro T has two 4K cameras onboard, plus a lot more, as detailed in this company handout:

 

Voliro

Robot as a service model

As we’re starting to see with a number of specialized drone companies, Voliro is going with a subscription model. Rather than purchase a Voliro T, you lease one. And that, says Udell, comes with a number of benefits.

“It really helps users get their return on the investment quicker. It splits down the initial outlay, so it’s a subscription charge every year.”

And what does a client get for their money?

“We give training, and also offer upgrades. The drone industry is moving very fast…so this idea of using a robot as a service and upgrading the platform as it goes along” means the customer never gets stuck with outdated equipment, nor faces the outlay of an outright purchase.

Companies like Shell and Chevron are part of Voliro’s early adopter program. And, says Udell, “There’s worldwide interest in the device.”

 

InDro’s take

As a research and development company, we have a lot of experience identifying technology gaps and building solutions that previously didn’t exist. We appreciate new approaches, as well as fresh engineering innovations. That’s why companies like Voliro and Canadian NDT drone manufacturer Skyguage catch our attention. They’re also important leaders as the drone market evolves from a sea of standard quadcopters into more specialized, task-specific drones.

“Voliro and Skyguage have taken a fresh look at an old problem,” says InDro CEO Philip Reece. “In doing so, both firms have really pushed the technology in new directions. The end result? More efficient and economical inspections of often complex assets while reducing risk for people.

“These are exciting times in the world of aerial and ground robots. We’ll be seeing a lot more specialized solutions in the future, including more from InDro.”

Stay tuned.

(Image/graphics courtesy of Voliro Airborne Robotics)

Throughout 2022, our friends at Osprey Integrity will be operating the only commercial Voliro unit in Canada. You can find out more about their work on their website.