Percepto’s autonomous drone-in-a-box

Percepto’s autonomous drone-in-a-box

By Scott Simmie, InDro Robotics

 

If you’re in the drone industry, you’ve likely heard the phrase: “Drone-in-a-box.” If refers to an autonomous system where a drone nests inside an enclosure for charging and safe harbour – and is regularly dispatched for automated missions. Usually, those missions are pre-programmed and involve inspection, surveillance, or change detection. Manual missions can be carried out when necessary, but the real point is automation.

The idea is that missions are carried out repeatedly, with a human simply monitoring from a remote location. Remotely could mean inside a building on an industrial site where the drone is based. But, because these emerging systems operate using LTE to control the drone and communicate with the software, they can be operated from hundreds or even thousands of kilometres away (providing you have permission to operate Beyond Visual Line of Sight and an available LTE network). With missions carried out automatically and on a regular schedule, this makes for vastly more efficient inspections, surveillance, tracking of construction progress, etc.

It beats requiring a pilot on site, and the drone never suffers from fatigue. The advantages for Enterprise clients are immediately apparent: Inspections, surveillance or general monitoring take place like clockwork, with all relevant data stored for easy access and interpretation. But think also of the edge such systems could provide for First Responders: A drone could be automatically dispatched to the location of a 9-1-1 call or critical incident. Video or thermal imagery can be securely live-streamed to decision makers down the line, regardless of where they’re located. The potential of such systems is unlimited.

At InDro Robotics, we’re no strangers to this concept. In fact, we’ve got a few things under the hood in this regard. But we like to acknowledge and celebrate success in this field. And so today’s post will focus on Percepto – the world’s leader in drone-in-a-box solutions. The company has a proven system, currently deployed in more than 100 locations around the globe. We recently had an opportunity to see a demo of the Percepto system, hosted by Canadian distributors RMUS (Rocky Mountain Unmanned Solutions).

Percepto’s autonomous drone system

The Percepto website outlines its offering with this statement: “Changing the way visual data is collected and analyzed, Percepto AIM is the only end-to-end inspection and monitoring software solution that fully automates visual data workflows, from capture to insights.” AIM stands for Autonomous Inspection and Monitoring, and is the software integral to the overall package.

This Percepto video provides a good overview:

It’s one thing to see a company video, quite something else to see that system in person. We were part of a briefing with Percepto’s Ehud Ollech (Head of Business Development) and Shykeh Gordon (VP Global Sales). They demonstrated the AIM software, the Sparrow drone (which comes with a parachute), and much more.

But they started by explaining that this system is purpose-built for major industrial customers, with clients from the mining, solar, oil & gas/petrochemical and utilities sector. And, they said, don’t think of Percepto as a drone company.

“Basically we are a big data analytics company,” said Shykeh, “offering end-to-end inspection and monitoring solutions.” What kind of solutions? This corporate graphic, supplied by Percepto’s marketing department, helps explain:

Percepto Drone

Percepto’s AIM software

During the demonstration, Shykeh and and Ehud walked us through the AIM (Autonomous site Inspection and Monitoring) software. It’s a browser-based system that allows you to program missions, monitor flights in real-time, watch a live stream from the Sparrow drone’s RGB or thermal camera, and take a deep dive into meaningful data. The User Interface is simple, and Percepto says a mission can be planned in as little as three minutes. In fact, they flew a brief mission from indoors with visitors watching from a conference room and visual observers outside. Every aspect of the mission, including a live video feed, was delivered in real-time. We could monitor what the drone was seeing, which is part of the point. And Ehud had the option, if something caught his eye, of stopping for a closer look.

RGB and thermal data is continuously captured during missions, then uploaded to the AWS cloud when the drone comes home to roost. Significantly, the AIM software is capable of change detection – a major feature for many clients. Once a baseline capture of a designated area has been stored in the Cloud, if a subsequent mission detects any changes, anomalies will be flagged. These could include thermal changes, issues with solar panels, oil leaks, a broken window – the list goes on. (The thermal data is radiometric, meaning it provides the actual temperatures measured.) The AI does not always categorize the type of anomaly, but even when it doesn’t it will quickly point out the relevant images for the operator to take a closer look. Percepto can also be integrated with Smart Fences or Pan-Tilt-Zoom cameras and dispatched automatically if something seem amiss.

Percepto Autonomous Drone

“The heart of our system is our software,” says Ehud.

AIM can also integrate data from ground-based robots, such as Boston Dynamics’ Spot. Even a smartphone photo or other image can be added to the mix, providing it contains geolocation data. The system can produce 3D digital twins, with all photogrammetry stitching done in the Cloud by AIM. (Some solutions for automated data capture rely on third-party software for photogrammetry.)  As part of the demonstration, Ehud defined an area of a pile of earth; a volumetric calculation was instantly performed. And this was all while the group was comfortable indoors. We were probably 50 metres from the actual system, but we could have just as easily have been across the planet, assuming LTE connection at the drone end.

Seeing the Percepto drone in a box in action

Percepto Autonomous Drone

After the first mission was complete, we went outside to watch the system in person. It began with the clamshell housing – which Percepto says can withstand a Category 5 hurricane, closed. Once the mission was initiated, it opened up quickly and the Sparrow took off. The system is operational in winds up to 40 kph, with a takeoff/landing limit of 27 kph. Winds during the demo were 24 kph; the Sparrow was rock steady.

Percepto Autonomous Drone

The system does not have obstacle avoidance, but uses ground-based radar to avoid conflicts with crewed aircraft. Altitude parameters, obviously, are programmed when setting the mission.

“Everyone’s waiting for aerial radar to get cheaper and lighter,” said Shykeh.

More sensors to come

The company already is working on a gas detection sensor (aka OGI camera), and is looking at potential LiDAR sensors as well. Maximum flight time is 40 minutes under optimal conditions, but generally flights are limited to 30 minutes. The next generation battery will offer a 20-30 per cent increase in time and range, and charging time in the station – from zero to full – is about 40 minutes.

Percepto Drone

InDro’s view

This is a refined and mature system, well-suited for major corporations with the budget for this kind of data acquisition and interpretation. It’s particularly suited for remote sites – especially sites that do not have staff on site but require persistent monitoring for safety, security or other reasons. Percepto has some very high-profile clients on its roster, including FPL, Koch, Verizon and Enel.

We’re strong supporters of drone-in-a-box solutions – and are actively exploring systems that might be helpful to First Responders. Kudos to Percepto…and stay tuned.

Human lungs transported by drone in Toronto: A global first

Human lungs transported by drone in Toronto: A global first

By Scott Simmie, InDro Robotics

 

In a world first, a set of human lungs has been transported between two hospitals by drone.

It happened in Toronto September 25, with the drone carrying the organs on a six-minute flight between Toronto Western Hospital and Toronto General Hospital. Other organs have been transplanted by drone previously in the US, but it’s believed this is the first drone transport of lungs in the world.

The mission was carried out by Unither Bioélectronique, a Quebec-based subsidiary of United Therapeutics Corporation. The parent company is focussed on cutting-edge medical research, including the 3D printing of human-compatible biological tissue. Unither Bioélectronique, meanwhile, is building a network to be able to deliver organs. Both share a commitment to help save the lives of those awaiting transplant; the following comes from the Unither Bioélectronique website:

“Thousands of patients die very year waiting for an organ transplant due to the severe shortage of donors, and the time-sensitive supply of compatible and useable organs. Supply is simply not meeting the critical level of demand…

“United Therapeutics has a vision to change the fate and lives of these patients. Through innovative techniques in lung manufacturing, including pig-to-human xenotransplantation and advanced 3D bio-printing, and enabled by an integrated delivery network, Unither Bioelectronics has set itself on a course to be both a game-changer and lifesaver for those in need.”

A lot of preparations…

 

This was not a simple flight; a lot of planning and testing went into getting ready for the big day. In fact, according to a Canadian Press story carried by Global News, preparations took 18 months from beginning to end. Tasks included designing a custom container that would be relatively impervious to changes in barometric pressure (which varies with altitude and weather) and also provide protection from vibrations and minor bumps. This was all before getting regulatory clearance to fly at short notice over a congested urban centre.

Eventually all was done. And when a suitable pair of donor lungs became available, both Unither Bioélectronique and the University Health Network were ready. On October 12, the company released a video outlining the process:

The drone doctor

The University Health Network’s surgeon-in-chief, Dr. Shaf Keshavjee, was deeply involved with the project. In fact, it was Dr. Kehavjee’s patient who would be the recipient of this precious cargo, according to the Canadian Press story. Dr. Keshavjee was waiting on the roof when as the flight took place.

“To see it come over the tall buildings was a very exciting moment,” he told CP reporter Tara Deschamps. “I certainly did breathe a sigh of relief, when it landed and I was able to…see that everything was OK.”

The surgery took place soon after the organs arrived, and the recipient was recovering nicely as of mid-October. He is also, according to the story, a drone enthusiast.

The bigger picture

Using drones to deliver organs is a high-profile mission, and we’re happy to see this has taken place. But the reality – as Unither Bioélectronique points out – is that there’s a tremendous shortage of donor organs. Often, too, organs must be flown far greater distances for those awaiting transplant – routinely between cities and not just across town. Such missions would not be suitable for a general multi-rotor drone, though there are certainly uncrewed fixed-wing aircraft that could be adapted for the job.

This is not in any way to diminish the accomplishment here. But the reality is that drone deliveries of other essential medical supplies, particularly to destinations outside of urban centres, will benefit the greatest number of people. One need look no further than Zipline, which has completed hundreds of thousands of flights carrying critical (and often life-saving) medical supplies in Rwanda, Ghana and elsewhere.

Medical drone deliveries

InDro Robotics has long believed in the use of drones for positive use-cases. That’s why the company has been involved in numerous trials – as well as real-world deliveries – over a period of many years. We have delivered simulated blood products between hospitals in Montreal via drone, using insulated pouches equipped with temperature sensors that would send an alert if the temperature of the sample changed. (Certain blood products become less viable if they are not maintained within precise temperature parameters.)

InDro has also partnered with Canada Post, London Drugs and Country Grocer on trials to securely deliver prescription medications directly from the pharmacy to the end-user. The medications were contained in tamper-proof vials that require a specific code to unlock. Getting critical medications to people quickly – even products like Narcan, which saves lives during opioid overdoses – can save lives. Here’s a look at the joint project InDro carried out back in 2019:

 

And there’s more…

During the peak of the COVID-19 pandemic, InDro Robotics regularly shuttled COVID test kits and swab samples between an island-based First Nations community and a mainland clinic. This saved the local healthcare providers from manually transporting these by car and ferry – a multi-hour undertaking – meaning they could spend more time helping patients. InDro has also carried out tests in conjunction with the County of Renfrew Paramedic Service, delivering Automated External Defibrillators to the site of 9-1-1 calls involving simulated cardiac events. The drone was able to repeatedly get the life-saving equipment to the site faster than paramedic teams driving emergency vehicles. In these kinds of urgent healthcare crises, minutes – and even seconds – count.

With multiple trials and real-world deliveries under its belt (along with standing approval for Beyond Visual Line of Sight flights and a Cargo delivery license from the Canadian Transportation Agency), InDro Robotics looks forward to regular deliveries of critical medical supplies in the future.

If you’re interested in exploring options for InDro solution for your community or healthcare network, we’d love to her from you. Contact us here.