When it comes to Last Mile, InDro’s ROLL-E delivers

When it comes to Last Mile, InDro’s ROLL-E delivers

By Scott Simmie, InDro Robotics

 

Picture this: You’re expecting an important delivery at home.

But instead of peeking out the window to spot a cargo truck or van, you’re awaiting a text. One minute before delivery, your phone pings with a notification and a QR code.

You look outside and see it approaching: A small robot. It pulls up directly in front of your steps (possibly even climbs the steps). You head outside and present your QR code to a reader on the robot. Once it has scanned to confirm, the lid protecting the cargo bay unlocks and slides open. You remove your package and go back inside. Before you’ve even closed the door, the robot has already moved on.

The transaction was rapid and contactless. The robot did not emit any CO2.

A decade ago, such a scenario would have sounded a bit like sci-fi. Not anymore. Such deliveries are coming – and not solely for the purpose of convenience.

Some context

 

On any given day, on any given street in North America, a large truck or cargo van is likely to come down the road. Inside? Groceries, clothing, electronics, books and more – on their way to people’s homes and businesses.

Even prescription medications are delivered by many pharmacies – which can be particularly helpful for those who may have mobility issues or lack access to transportation. Deliveries are now so ubiquitous that these vehicles have become part of the urban landscape.

But while deliveries have grown exponentially over the past couple of decades, so too have concerns about the efficiency – or inefficiency – of this approach. And that conversation now focuses on something known as the Last Mile.

That, and the potential for robots to become part of a cleaner and more cost-effective solution.

 

The Last Mile

 

The Last Mile phrase refers to the final, critical but inefficient phase of any delivery: Getting the product down that last path to its ultimate destination. That destination is most often the home of a consumer. But it might be to a client, waiting for just-in-time parts. Ultimately, it could be anything, to anyone, anywhere. And with the global pandemic, demand for delivery of everything from soup to nuts to meals has skyrocketed.

Currently, nearly all these deliveries are carried out by vehicles powered by internal combustion engines. It’s one thing to load up a truck with parcels headed from a warehouse in a suburb to, say, Toronto. That part of the voyage can be fairly efficient, because there’s a large volume of goods all initially headed in the same general direction. But things become far less efficient once that truck starts heading down scores of residential streets. Things slow down, more fuel is burned, and costs add up.

Here’s how Business Insider describes the problem:

“In a product’s journey from warehouse shelf, to the back of a truck, to a customer doorstep, the “last mile” of delivery is the final step of the process — the point at which the package finally arrives at the buyer’s door. In addition to being a key to customer satisfaction, last mile delivery is both the most expensive and time-consuming part of the shipping process…

That “last mile” is more costly than you might realize.

“As a share of the total cost of shipping, last mile delivery costs are substantial — comprising 53% overall. And with the growing ubiquitousness of “free shipping,” customers are less willing to foot a delivery fee, forcing retailers and logistics partners to shoulder the cost. As such, it’s become the first place they’re looking to implement new technologies and drive process improvements.”

 

Delivery by drone

Drone Delivery

The image above is from trials InDro Robotics carried out with London Drugs, Canada Post, and Country Grocer on Salt Spring Island. We demonstrated how delivering medications can save time – and potentially lives – by getting prescriptions quickly to people in remote communities. In some of these deliveries, the consumer would have had to travel by hours and take ferries to pick up medications that were delivered in minutes. In the case of products like an Epipen, or Narcan (used to save lives during opioid overdoses), minutes and even seconds can count.

In fact, InDro was a Canadian leader in delivering COVID-19 tests by drone, allowing health care providers on an island-based First Nations community to remain at their clinic – rather than travelling a full day to deliver and pick up test kits. (You’ll find our story on this here.)

But while drones can receive regulatory permission for these kinds of remote flights, we’re still some ways off from routine aerial deliveries to consumers in urban areas. The world of Advanced Air Mobility is certainly coming (see our deep dive into the topic here), but the regulatory landscape will take time to ensure that crewed and uncrewed aircraft can routinely (and safely) share the same airspace when it comes to cities. 

We’ve all seen the exciting vision of drones flying packages right to your doorstep, but in many cases it’s not the best solution,” explains InDro Robotics CEO Philip Reece.

“Ground robots can bring many of the same solutions with no impact on airspace – and due to their compact size they can utilize existing infrastructure. I’m confident in the future we’ll see drones and ground robots enabling delivery by working in unison, but that will take some time.”

And that brings us to UGVs, or Uncrewed Ground Vehicles. Specifically, an InDro-developed delivery product we call    ROLL-E.

 

ROLL-E delivers

 

ROLL-E has been designed by InDro’s engineering team to be part of the Last Mile solution. And there are very specific reasons why the company has chosen to develop this product.

First of all, UGVs are not subject to the same regulatory framework as aerial vehicles, so UGVs can be deployed in urban centres now. In fact, a company called Tiny Mile is already delivering meals in Toronto with its “Geoffrey” platform – and was just featured in this McLean’s magazine article. Though Geoffrey gets a lot of attention from curious pedestrians, this kind of delivery will become commonplace in the years to come. Plus, as noted earlier, we’re in an era of unprecedented global demand for deliveries – coupled with mounting concern over the environment and greenhouse gas emissions. The time is right for a green and efficient solution.

And that’s where ROLL-E fits in.

Last Mile Delivery Robot

ROLL-E is built on the AgileX Scout 2.0 platform. But that’s only the beginning. While platforms like the rugged and reliable Scout are great, they require software and hardware – and generally a lot of tweaking – to transform them into fully-functioning robots.

We did that by integrating another InDro innovation that we call ROS-IN-A-BOX, or RIAB. You can read all about RIAB here, but the key point is that it’s a hardware/software solution that relieves the end user of the tedious task of integrating the Robot Operating System software, plus any other hardware or sensors (such as cameras), and getting them all to work properly together.

With RIAB built in to ROLL-E, the customer has a solution onboard that will allow them to begin running remote deliveries via cellular connection. They simply drive ROLL-E using a gaming controller while watching its path, in real-time, from a remote location via a browser-based console.

Simple to operate

 

ROLL-E is a snap to operate – whether you’re across town or across the country. (In fact, during one recent internal company demo, an InDro employee who had zero background with ROLL-E operated a mission at our Area X.O location in Ottawa from her home in Vancouver.)

UGVs have lower barriers to entry than UAVs for deliveries,” explains Luke Corbeth, an InDro Account Executive specializing in UAV and UGV solutions with a specific focus on delivery.

“They can be setup and deployed quickly, don’t require certified operators and have notably less regulations – this means deliveries can happen anytime at a moment’s notice.”

And throughout the delivery, the robot operator can see what ROLL-E sees, in real-time. The screengrab below was taken from the console while running a demo at our Area X.O facility in Ottawa.

Last Mile Delivery Robot

With ROLL-E’s ample and insulated storage, its top compartment can be divided in two, allowing (for example) for the shipment of frozen goods on one side of the center divider, with non-refrigerated goods on the other. Or, in cases with larger objects, the divider can be removed entirely. This is InDro’s second-generation ROLL-E.

Delivery Robot

Accessible, but not autonomous

 

As noted, ROLL-E requires a human operator with eyes on the road. And while ROS-in-a-BOX platforms are AI capable, this is not an autonomous vehicle.

“It’s critical that it’s not misconstrued as autonomous in any way,” says Engineering Manager Arron Griffiths. “ROS-in-a-BOX is autonomous capable – it has the capacity to put autonomous software on it. But the real core advantage here is the ability to carry teleoperation over 4G and 5G networks.”

In other words, as long as there’s a cellular network at each end, ROLL-E can be operated remotely from anywhere.

That doesn’t mean, of course, that InDro won’t make a fully autonomous product using a LiDAR sensor, SLAM (Simultaneous Localization And Mapping) and obstacle avoidance down the road. It simply means that for this road,    ROLL-E is ready to go.

And – seriously – you could learn how to operate it in an hour. (It also features wireless charging, so no plugging in or battery removal required.)

 

Delivery Robot

Building simple solutions

 

That concept, of doing the heavy technical lifting so that end-users can deploy a simple and pain-free solution, is at the core of InDro’s R&D philosophy: Build innovative things that work reliably and are easy for the end-user to operate.

“We develop specialized robotic solutions for our customers so they can do what they do best and then simply add our solution on to their existing transportation options,” says Philip Reece.

“InDro looks to make using ground robots easy. Working together we can make the end customer experience easier, more convenient and even fun. Who wouldn’t want their groceries delivered right to their door by a friendly robot?”

Or anything else, for that matter.

 

InDro’s view

 

Robots are already beginning to play a role in the Last Mile solution. This is particularly true in China, where robotic vehicles making deliveries are becoming commonplace in cities like Shenzhen. And they’re already making inroads in North America, with even Amazon running trials.

Like ROLL-E, the Amazon robot has been designed to make Last Mile deliveries more efficient, while using current infrastructure (sidewalks, crosswalks, even paths through parks) without being obtrusive.

Products like ROLL-E will play a significant role in the future both by delivering securely and safely – and helping to ease the burden of that last, critical mile.

If you’re interested in what ROLL-E might do for your company, you can get more information (and possibly even drive it remotely!) by contacting Luke Corbeth here.

The InDro Robotics “InDro Commander” for ground robots

The InDro Robotics “InDro Commander” for ground robots

By Scott Simmie, InDro Robotics

 

Today, building basic robots isn’t hugely challenging for engineers – though, of course, some robots are a lot more complex than others.

The really tough part is making those robots be useful.  Tasks like navigating, capturing thermal imagery and other data – even identifying and manipulating objects – all require much more than wheels and sensors and end effectors (the robotic equivalent of hands). Regardless of whether the robot is simple or complex, it needs brains.

Those brains consist of both hardware and software, with specific bundles of code that can help with specific tasks. And that’s where the Robot Operating System, or ROS, comes into play. ROS.org is a repository of software packages, purpose-built for specific robotic applications by a global network of collaborators.

 

via ROS.org

As the organization’s website explains it, ROS “is a collection of tools, libraries, and conventions that aim to simplify the task of creating complex and robust robot behavior across a wide variety of robotic platforms.

“Why? Because creating truly robust, general-purpose robot software is hard. From the robot’s perspective, problems that seem trivial to humans often vary wildly between instances of tasks and environments. Dealing with these variations is so hard that no single individual, laboratory, or institution can hope to do it on their own.”

And so ROS could be thought of as a super helpful toolkit, where collaborators upload and share code they’ve developed – and also download and integrate (or even modify) code others have written in order to make their robot carry out required tasks, including specific ways of communicating with an operator or base station.

 

ROS is cool, but could it be even cooler?

 

Some time back, we started to ponder this question. Specifically, what if you could pack some of that software in a box – along with the hardware required to run it? And what if that box could easily be integrated to a ground-based robot (most already use ROS drivers) to get it up and running as seamlessly as possible?

That’s the concept of a new InDro Robotics product called InDro Commander, developed by Engineering Manager Arron Griffiths in conjunction with the InDro Robotics Area X.O team.

Arron had been working with ROS for about five years, so he already had a great understanding of the available software tools. Arron has worked in robotics for more than a decade now (he was also the Senior Application Engineer at Clearpath Robotics prior to joining InDro Robotics). And Unmanned Ground Vehicles, or UGVs, is an area that has really picked up for InDro since we partnered with Chinese robotics leader AgileX. The picture below is of “Scout” – one the company’s UGVs.

 

AgileX Scout

With a solid understanding of the software and the hardware required to run it, Arron realized there could be tremendous potential for an “all-in-one, bolt-on” solution. Such a device could get an ROS-compatible robot up and running much more quickly, with zero hassle. In a nutshell, that’s the concept behind InDro Commander. Here’s Arron:

“We’ve created a hardware product around the concept of a simple ROS module, which can be utilized on multiple different robot types. We’re also trying to make it platform-agnostic. We actually don’t want to make a robotic platform, we want to make a box that has robotic systems in it, to make other robotic platforms smarter.”

We’ve been using our InDro Commander on the AgileX Scout Mini, a great R&D platform. And, well, it works like a charm. InDro Commander is also compatible with all the AgileX platforms and any other ROS-ready robot platform.

In fact, we’re so proud of this InDro Robotics innovation that we produced this video for the recent ROS World 2021 Virtual Conference. (At that time, we were calling it ROS-IN-A-BOX):

 

InDro Commander integrates easily

 

That’s a key piece here. The box contains everything a developer or end-user would need. EDGE computing is done onboard by the NVIDIA Jetson processor, reducing latency and unlocking potential for AI-related tasks like object recognition or change detection. Connectivity is via 4G/5G, and the box can utilize the CAN (Controller Area Network) protocol, Serial or Ethernet. The ruggedized box has its own cooling system and power regulator, and has an Ingress Protection factor of IP55. It’s literally a solution you can bolt onto pretty much any ground-based robot and begin remote teleoperations over 4G or 5G.

And yes, InDro Commander vastly simplifies things.

“It’s just two wires (battery power and communications) people plug in,” says Arron. “The box already has cameras, communications, power regulators – all inside the box. So you’re not fiddling with all of these various peripherals. It’s truly a self-contained ecosystem. Suppliers, OEMs, they don’t have to think – they just have to bolt this box on.”

ROS-IN-A-BOX

InDro Robotics has long been known for its R&D in the drone space, and has garnered multiple industry “firsts” as a result. Now, with the company’s expansion into ground robotics, InDro Commander is a significant breakthrough – not only for InDro, but for others who will immediately see the benefit of this solution.

“We work closely with academia and collaborate with industry partners and end users,” explains InDro Robotics CEO Philip Reece.

“The common question is: ‘How can we integrate this sensor or piece of tech with this robot or system?’ Now we have a simple working answer to this question, as InDro Commander is designed as a Plug and Play all-in-one module and is platform agnostic.” (Providing the platform either has a ROS driver already, or working example (Python/C++) code which Indro can use to develop a custom ROS driver.)

ROS-IN-A-BOX

Reece says the creation of this product is a very different solution, which he anticipates will help many in the Unmanned Ground Vehicle (UGV) space.

“There are many UGV companies, and more start up every day. Ninety-five per cent of them only make custom solutions for their own. hardware. InDro is doing things differently,” he says.

“InDro Commander is an important addition to our technology development, as we are supplying the industry with a number of different ground robots, and they are interacting in many different ways. InDro Commander will build on the benefits of a common operating system such as ROS, by bringing a standard suite of sensors and systems (camera, GPS, IMU, Computers Power distribution, communications, 4/5G) that can all be simply but powerfully integrated onto any flavour of UGV.”

InDro partners with ROCOS

We’re already quite proud of the InDro Commander solution. But we’ve taken things a step further, partnering with ROCOS. The company’s Robot Operations Platform allows an operator to connect, monitor and control robots – whether it’s a single unit or an entire fleet. But that’s not all.

ROCOS was recently acquired by DroneDeploy, one of the world leaders in drone data acquisition, interpretation and photogrammetry. And what does that mean? Well, imagine having data acquired by a ground robot seamlessly integrated with what is captured by air and presented as meaningful data for the end-user. Further picture a desktop, browser-based console where you can program aerial or ground-based missions and monitor a feed as they unfold in real-time.

Force multiplier

Whether the use-case is industrial, agricultural, security – and much more – having eyes in the air, combined with robotic boots on the ground, can only be a force multiplier.

We’ve already seen what InDro Commander can do in our own testing; we can’t wait to see what others do with this solution.

For more information on InDro Commander, contact us here.

The amazing, unusual robots of Squishy Robotics

The amazing, unusual robots of Squishy Robotics

By Scott Simmie, InDro Robotics

 

When we think of robots, a few different images can come to mind.

You might envision something like Spot, the dog-like ground robot built by Boston Dynamics. You might also think of an Uncrewed Ground Vehicle, or UGV, such as the AgileX Scout 2.0. You might even think of a walking, talking machine from some sci-fi film. And sure, they’re all robots. For that matter, even a Roomba vacuum cleaner is a robot.

Before we hop in further, we’d like to drop in this definition, from Brittanica.com:

“any automatically operated machine that replaces human effort, though it may not resemble human beings in appearance or perform functions in a humanlike manner. By extension, robotics is the engineering discipline dealing with the design, construction, and operation of robots.”

Robots can come in unexpected shapes and sizes

Today, we’re going to look at a very atypical robot that really intrigues us. It’s made by a US company called Squishy Robotics. Why Squishy? Well, it’s because of the form factor of these unique devices. They are, actually, squishy. And that form factor allows Squishy’s robots to do things that others cannot.

Let’s take a look at an introductory video. It gives a great high-level overview of what the product does, and why it’s built the way it is: 

Use-case scenarios

As you likely noted in the video, these robots can be dropped from significant heights without damage. So in situations where you can’t easily get a drone to the ground, they can be deployed simply by dropping them from the air. Squishy has done tests dropping from up to 1,000′ from fixed-wing crewed aircraft and helicopters. (In North America, drones are generally limited to 400′ Above Ground Level).

As the Squishy website explains, “We provide sensor robots that can be air-deployed into hazardous areas to furnish persistent, ground-level, real-time data for your operations.”

Static or mobile

The company has two different flavours of Squishy Robots. One version is static, and simply reports back from a stationary position after it’s been dropped (or tossed). There’s also a version that can move itself using a rolling motion. Here’s CEO and Co-Founder Dr. Alice Agogino:

We have both a Stationary Robot and a Mobile Robot. Our Stationary Robot is currently being used by several pilot partners,” she says. “Of course, some situations require mobility, but our customer discovery determined that deploying our stationary tensegrity sensor unit (either by drone or by tossing) provided an ideal solution to improve the efficiency and increase the safety of emergency responders and the public. The robot’s six camera and sensor could provide—and continuously update—the immediate situational awareness that emergency personnel need to respond to a crisis.”

And these little devices do a lot. We’ve borrowed, with permission, this graphic from the Squishy Robotics website. It helps to explain what its robots do:

 

Squishy Robotics Feature

There are multiple use-cases for such a device. Imagine, for example, there’s been a dangerous gas leak. One of the Squishy Robots comes equipped with a sensor that can ‘sniff’ the levels of four different gases: CO, H2S, LEL, O2. That same robot has six cameras for full 360° coverage and a GPS. Because it creates its own mesh network, data can be shared with its operator even in situations where a cellular network is down.

We asked Dr. Agogino what she feels differentiates the company’s products from other robots.

“A key differentiator is that our air-deployed robots can get to places that ground robots cannot easily access,” she says.

“We can fly over rivers or wreckage and debris from natural disasters, for example. Some ground robots can manage travel around such obstacles, but our tensegrity robots can get there faster and send data sooner than a ground-based robot. Our robots can also be deployed by humans—someone can easily throw or toss one of our lightweight robots over a fence or a rescuer could drop them down a mineshaft or into a cave. Those actions aren’t possible with a heavy robot with so many breakable components.”

In an earthquake scenario, a Squishy Robot could be tossed into a building at risk of collapse. It would provide eyes on the ground, be able to sniff for dangerous gases, and – depending on the model – potentially move by rolling around. It’s pretty easy to see the utility here, and how such a device would aid First Responders in gathering data before sending people inside.

How did Squishy Robotics begin?

Good question. And the answer is found on the company’s website.

“Squishy Robotics is a spinoff of research at UC Berkeley with NASA to develop planetary probes for space exploration. The probe could orbit a planet and drop to the surface and survive to provide scientific monitoring. Squishy Robotics has commercialized this technology for a range of applications on planet Earth: disaster response, military applications, Industrial Internet of Things (IIoT), and package delivery.”

We can certainly envision situations where these devices could be put to good use in the Public Safety, Industrial/Enterprise, and even Military sectors. We particularly like that these devices could be safely dropped by drone, meaning decision-makers would be able to gather more data before dispatching human beings into potentially hazardous situations.

A solid team

Squishy Robotics is a majority female-owned startup. CEO Dr. Alice Agogino’s research has included work on machine learning, sensor fusion and a specialty called “tensegrity robotics” – which was referred to earlier. We looked up a definition for this one, and found the following here:

“Soft spherical tensegrity robots are novel steerable mobile robotic platforms that are compliant, lightweight, and robust. The geometry of these robots is suitable for rolling locomotion, and they achieve this motion by properly deforming their structures using carefully chosen actuation strategies.”

Squishy Robotics dropped from drone
Squishy Robotics on the ground
In addition to her work as CEO, Dr. Agogino’s bio states that she’s “currently the Roscoe and Elizabeth Hughes Professor of Mechanical Engineering and is affiliated faculty at the Haas School of Business at the University of California at Berkeley.”
Alice Agogino

What’s next for Squishy Robotics?

We asked Dr. Agogino that question. And it looks like there are some interesting developments on the horizon.

We are working to develop an innovative solution for increasing the number of methane inspections and the quality of recorded measurement data with our robots,” she says.

“Methane is the second most common greenhouse gas and accounts for approximately 20 percent of global emissions. Identifying methane emissions requires improved tracking and analysis and will need to incorporate tracking at remote and often unmanned sources, such as at orphan wells and pipelines.”

Squishy Robots are currently being deployed – with very positive results – by a number of partners. In fact, the capabilities of these devices were designed with those end-users in mind.

We listened to our future users and honed our robots to their specifications and needs. I think that is why we get positive feedback from virtually all the First Responder and military personnel that have tested and used our robots,” says Dr. Agogino.

“We have several ongoing pilot partnerships with U.S. fire departments that are putting our robots to work out in the field in real life emergencies.”

InDro’s Take:

We’re alway keeping our eyes out for unusual robots that break the mold and offer something of value. Squishy Robotics definitely fits this criteria. The ability to drop these devices from a significant height – directly into a situation that could be very hazardous for humans – is something we haven’t seen elsewhere. It doesn’t surprise us that this design emerged from research for planetary exploration.

And now, these devices are available for exploration on our own planet. If you’d like more information, you’ll find it at the Squishy Robotics website.

Oh, and if you’re aware of another intriguing robot you think we should write about, feel free to flag me here.

 

Percepto’s autonomous drone-in-a-box

Percepto’s autonomous drone-in-a-box

By Scott Simmie, InDro Robotics

 

If you’re in the drone industry, you’ve likely heard the phrase: “Drone-in-a-box.” If refers to an autonomous system where a drone nests inside an enclosure for charging and safe harbour – and is regularly dispatched for automated missions. Usually, those missions are pre-programmed and involve inspection, surveillance, or change detection. Manual missions can be carried out when necessary, but the real point is automation.

The idea is that missions are carried out repeatedly, with a human simply monitoring from a remote location. Remotely could mean inside a building on an industrial site where the drone is based. But, because these emerging systems operate using LTE to control the drone and communicate with the software, they can be operated from hundreds or even thousands of kilometres away (providing you have permission to operate Beyond Visual Line of Sight and an available LTE network). With missions carried out automatically and on a regular schedule, this makes for vastly more efficient inspections, surveillance, tracking of construction progress, etc.

It beats requiring a pilot on site, and the drone never suffers from fatigue. The advantages for Enterprise clients are immediately apparent: Inspections, surveillance or general monitoring take place like clockwork, with all relevant data stored for easy access and interpretation. But think also of the edge such systems could provide for First Responders: A drone could be automatically dispatched to the location of a 9-1-1 call or critical incident. Video or thermal imagery can be securely live-streamed to decision makers down the line, regardless of where they’re located. The potential of such systems is unlimited.

At InDro Robotics, we’re no strangers to this concept. In fact, we’ve got a few things under the hood in this regard. But we like to acknowledge and celebrate success in this field. And so today’s post will focus on Percepto – the world’s leader in drone-in-a-box solutions. The company has a proven system, currently deployed in more than 100 locations around the globe. We recently had an opportunity to see a demo of the Percepto system, hosted by Canadian distributors RMUS (Rocky Mountain Unmanned Solutions).

Percepto’s autonomous drone system

The Percepto website outlines its offering with this statement: “Changing the way visual data is collected and analyzed, Percepto AIM is the only end-to-end inspection and monitoring software solution that fully automates visual data workflows, from capture to insights.” AIM stands for Autonomous Inspection and Monitoring, and is the software integral to the overall package.

This Percepto video provides a good overview:

It’s one thing to see a company video, quite something else to see that system in person. We were part of a briefing with Percepto’s Ehud Ollech (Head of Business Development) and Shykeh Gordon (VP Global Sales). They demonstrated the AIM software, the Sparrow drone (which comes with a parachute), and much more.

But they started by explaining that this system is purpose-built for major industrial customers, with clients from the mining, solar, oil & gas/petrochemical and utilities sector. And, they said, don’t think of Percepto as a drone company.

“Basically we are a big data analytics company,” said Shykeh, “offering end-to-end inspection and monitoring solutions.” What kind of solutions? This corporate graphic, supplied by Percepto’s marketing department, helps explain:

Percepto Drone

Percepto’s AIM software

During the demonstration, Shykeh and and Ehud walked us through the AIM (Autonomous site Inspection and Monitoring) software. It’s a browser-based system that allows you to program missions, monitor flights in real-time, watch a live stream from the Sparrow drone’s RGB or thermal camera, and take a deep dive into meaningful data. The User Interface is simple, and Percepto says a mission can be planned in as little as three minutes. In fact, they flew a brief mission from indoors with visitors watching from a conference room and visual observers outside. Every aspect of the mission, including a live video feed, was delivered in real-time. We could monitor what the drone was seeing, which is part of the point. And Ehud had the option, if something caught his eye, of stopping for a closer look.

RGB and thermal data is continuously captured during missions, then uploaded to the AWS cloud when the drone comes home to roost. Significantly, the AIM software is capable of change detection – a major feature for many clients. Once a baseline capture of a designated area has been stored in the Cloud, if a subsequent mission detects any changes, anomalies will be flagged. These could include thermal changes, issues with solar panels, oil leaks, a broken window – the list goes on. (The thermal data is radiometric, meaning it provides the actual temperatures measured.) The AI does not always categorize the type of anomaly, but even when it doesn’t it will quickly point out the relevant images for the operator to take a closer look. Percepto can also be integrated with Smart Fences or Pan-Tilt-Zoom cameras and dispatched automatically if something seem amiss.

Percepto Autonomous Drone

“The heart of our system is our software,” says Ehud.

AIM can also integrate data from ground-based robots, such as Boston Dynamics’ Spot. Even a smartphone photo or other image can be added to the mix, providing it contains geolocation data. The system can produce 3D digital twins, with all photogrammetry stitching done in the Cloud by AIM. (Some solutions for automated data capture rely on third-party software for photogrammetry.)  As part of the demonstration, Ehud defined an area of a pile of earth; a volumetric calculation was instantly performed. And this was all while the group was comfortable indoors. We were probably 50 metres from the actual system, but we could have just as easily have been across the planet, assuming LTE connection at the drone end.

Seeing the Percepto drone in a box in action

Percepto Autonomous Drone

After the first mission was complete, we went outside to watch the system in person. It began with the clamshell housing – which Percepto says can withstand a Category 5 hurricane, closed. Once the mission was initiated, it opened up quickly and the Sparrow took off. The system is operational in winds up to 40 kph, with a takeoff/landing limit of 27 kph. Winds during the demo were 24 kph; the Sparrow was rock steady.

Percepto Autonomous Drone

The system does not have obstacle avoidance, but uses ground-based radar to avoid conflicts with crewed aircraft. Altitude parameters, obviously, are programmed when setting the mission.

“Everyone’s waiting for aerial radar to get cheaper and lighter,” said Shykeh.

More sensors to come

The company already is working on a gas detection sensor (aka OGI camera), and is looking at potential LiDAR sensors as well. Maximum flight time is 40 minutes under optimal conditions, but generally flights are limited to 30 minutes. The next generation battery will offer a 20-30 per cent increase in time and range, and charging time in the station – from zero to full – is about 40 minutes.

Percepto Drone

InDro’s view

This is a refined and mature system, well-suited for major corporations with the budget for this kind of data acquisition and interpretation. It’s particularly suited for remote sites – especially sites that do not have staff on site but require persistent monitoring for safety, security or other reasons. Percepto has some very high-profile clients on its roster, including FPL, Koch, Verizon and Enel.

We’re strong supporters of drone-in-a-box solutions – and are actively exploring systems that might be helpful to First Responders. Kudos to Percepto…and stay tuned.