Wednesday, September 26, 2018

UAS Senior Capstone Proposal Abstract and Presentation

Below is the first abstract for my group's senior capstone project. Myself, Thomas Gonya, and Todd Horn have designed the following multifaceted project to have significant implications to forest management, manned-unmanned aircraft joint missions, and high-resolution remote sensing. Underneath the abstract is a link to a presentation on this initial proposal that can be accessed directly. The roles that each of the members will have on this project are detailed in the presentation.



The Impacts of Altitude on High-Resolution Multispectral Remote Sensing for Hardwood Forest Species Delineation

    Hardwood forest inventory is a time consuming and expensive process, especially for small forest owners (Butler et al., 2004). To expedite the process, satellite remote sensing techniques have been used with limited success due to low spatial resolution; unless expensive high-resolution satellite data is purchased (Immitzer et al., 2012). Recent studies have shown that unmanned aerial systems (UAS) can be a means to collect affordable high-resolution forestry data that is as accurate as  ground surveys in the Central Hardwood Forest region of the United States (Hockridge, 2018). However, to fully match the quality of ground surveys, UAS remote sensing methods will need to successfully delineate species of trees in the imagery.
    Our project seeks to identify tree species through UAS multispectral imagery utilizing the RedEdge Altum sensor integrated on the C-Astral Bramor ppX airframe. The sensor’s access to the LWIR and NIR bands and aircraft’s low altitude flight capability should allow for species specific spectral signatures to be identifiable. The aircraft will be flown at forested sites local to the West Lafayette, IN region at approximately 300 feet. It is unknown how much flight altitude’s effect on spatial resolution will impact the accuracy of the species delineation, so the Altum sensor will also be mounted on a fixed wing manned airplane that will fly surveying transects at altitudes of 2,000 and 3,000 feet so that data can be compared. The airborne datasets will be processed into multi-band orthomosaics and then analyzed to determine indices that can be used to identify tree species. From there, maps of tree species will be generated for both manned and unmanned aircraft data, and the accuracy associated with different spatial resolutions will be assessed when compared with ground surveys of tree species. From this, an ideal altitude for tree identification can be determined. 


References
Butler, B.J., J.H. Hewes, B.J. Dickinson, et al. 2016. Family Forest Ownerships of the United States, 2013: Findings from the USDA Forest Service’s National Woodland Owner Survey. Journal of Forestry 114: 638–647.

Hockridge E. (2018, April). Exploring the use of unmanned aerial systems (UAS) for hardwood tree inventory. Poster session presented at: Purdue Undergraduate Research Conference. West Lafayette, IN.

Immitzer, M., Atzberger, C., & Koukal, T. (2012). Tree Species Classification with Random Forest Using Very High Spatial Resolution 8-Band WorldView-2 Satellite Data. Remote Sensing, 4(9), 2661-2693. doi:10.3390/rs4092661 




 Proposal presentation link Here

Monday, September 24, 2018

Exposure to New Systems: C-Astral Bramor ppX and M600 Alternative

This past week our lab group visited one of Purdue University Department of Forestry and Natural Resource's properties, the Martel Forest, for an aircraft demonstration. Martel is a large forestry research site on the outskirts of West Lafayette, IN and a potential test site for extended UAS research operations. The aircraft demonstration was conducted by staff of Menet Aero, a UAS operations consulting firm. Menet Aero brought their Bramor ppX aircraft, developed by C-Astral Aerospace, as well as a custom built large hexacopter. I was fortunate to work with Peter Menet, the CEO and founder of Menet Aero, to set up his field equipment and help prepare the demonstration aircraft for flight. Joining the class, was Marko Peljhan, the CEO of C-Astral aircraft. Ultimately, the lab activity was a fantastic way to interact with industry and be introduced to aircraft we will likely have access in the department this year.


Menet Aero's field station and ground equipment






The above three images are of the C-Astral Bramor ppX on its launch catapult 




Preparing the large hexacopter build for flight. This aircraft is custom designed to have the same performance of the DJI Matrice 600 but without the airspace geo-fencing. This allows the aircraft to operate in critical infrastructure, controlled airspace, or TFR environments.

Wednesday, September 19, 2018

UAS Crew Resource Management Activty

As a class, we decided to develop and work on crew resource management (CRM) skills. Ultimately these skills are critical to safe operation of a UAS because CRM maximizes the efficiency of work by delineating specific tasks to specific people. While CRM is structured differently for each operation, there is homogeneous requirements. One of which is a checklist which was posted immediately before this blog post. Please see the checklist blog post if you wish to visualize the specific checklist we used during this mission. In addition, we worked on communication and task structures for two person UAS teams. This included communication line-of-sight and workflow plans.

This mission exercise was carried out with a DJI Inspire 1 aircraft. Krista was my partner and we traded off the roles of remote pilot in command (RPIC) and visual observer between two flights. We managed to collect video of a rural street, following it a significant distance. The two person crew with sufficient communication allows this to be possible because the observer can maintain line-of-site with the aircraft at all times and the operation can maintain orientation via first person view (FPV). The observer can also reposition them self so that the aircraft remains visible even if the operator can not. At the end of the day, this class exercise was practice for future higher risk operations. It is probably in the best interest of any drone operating team to practice on lesser cost systems so that they can learn each other's personal styles, build trust, and maximize efficiency.  Below are a series of images from the outing including the other student teams.

Unfortunately, because blogger is not compatible with high resolution images, please see my images by clicking here.

Wednesday, September 12, 2018

Multi-sensor DJI Inspire 1 Series Checklist

Here is the checklist for a DJI Inspire 1 series aircraft utilizing a stock RGB camera and a multispectral sensor developed by Micasense called the RedEdge. This combined sensor package and associated aircraft are ideal for educational mapping training or short duration multispectral mapping. The checklist includes every aspect of operation and attempts to leave no aspect to guess. Even the most skilled crews should use a checklist before every operation, with more general operational manuals available for more detail. This checklist also is built for operational efficiency by including different lists for various forms of operation, namely manual and autonomous takeoff allowing for a variety of mission types. There is also an abbreviated startup checklist for when the aircraft lands and only needs a battery to take off again. This is important for flights that will need multiple batteries or very high temporal resolution missions where the same area is covered multiple times in a day so that the aircraft does not need to be transported between flights.

Tuesday, September 11, 2018

UAS Consulting Report: A Case for the Hawksbill Seaturtle

Endangered Wildlife Survey: Hawksbill Sea Turtle


Summary Intro:
This consulting report seeks to provide unmanned aerial system platform recommendations so that conservationists can perform an inventory of Hawksbill Sea Turtles in the Hawaiian islands. More particularly, reproducing members of the Hawaiian Hawksbill population.

There are several major considerations for choosing aircraft and sensor options to accomplish this task. First of all, the Hawksbill Sea Turtle is a critically endangered species worldwide, and the hawaiian population is one of the most endangered turtle populations on Earth. Thus, to study the species, researchers must follow the endangered species act of 1973 and all of the associated regulations. Effectively, drone activity can not in any way alter the actions of the endangered animals. In other words, the turtles can not react to the unmanned aircraft in any capacity to remain compliant with the endangered species act. The easiest way to achieve this is to insure the turtles do not notice the aircraft, making sound a major consideration. Where the sea turtles are surveyed will impact any sound considerations.

Over the ocean, sound is less of a factor as it is unlikely submerged animals will notice an aircraft overhead. However, even though the hawksbill sea turtle is a notoriously shallow swimming animal, it would be much more difficult to count the turtle while it is at sea. This is because it is decently camouflaged with the water and thermal cameras are not very effective if the animal is at any significant depth due to low amounts of reflectance by water in the infrared section of the electromagnetic spectrum. Also, the target species does not travel far from where it reproduces to where it lives most of its life compared to other sea turtle species. Meaning that, if individuals were inventoried at sea, it is possible that non-reproducing individuals would be counted which is not the goal of the study. Flights at sea also require boat launches or limited duration surveys if flown from shore out towards water. For these considerations, aircraft are being
selected that could best perform beach surveys of turtle populations. This is because only reproducing individuals come to shore, removing bias of non-target individuals. This will also make finding the aircraft easier as there is greater contrast between turtle coloration and the color of the beach.

Lastly, reproductive trends are important to consider. Most notably, the fact that the turtle usually breads nocturnally. It is worth surveying during the day for nests, but if only individual organisms are going to be considered, night time drone flights are needed. This means that the sensor needs to be capable of searching for turtles in the dark, and the aircraft needs features enabling navigation and orientation at night.

Image result for hawksbill sea turtle 
 Image by World Wildlife Fund


Low-Cost Drone Options 

 

Low Cost Multi: DJI Mavic Pro Platinum w/ 8331 series propellers (68db) and a ready-to-use thermal. Approximately $4,299

For the low-level commercial quadcopter option, an appropriate platform would be the DJI Mavic Pro Platinum equipped with 8331 series propellers and a FLIR Boson 320 video camera. This platform is affordable, while also being capable of getting the task done. This is a custom build, but it can be purchased from Dronenerds.com with the thermal sensor installed. The props would need to be purchased separately and can be purchased from DJI.com. The prop customization would keep the noise level of the UAV at 68db which is much quieter than the props it comes with.

The 4k camera and thermal camera are dual mounted and can film simultaneously. The gimbal cameras are permanently mounted. The range is 4.3 miles and has a top speed of 40mph. While the maximum flight time is listed at 27, the actual time will be much lower due to the higher cross winds found along coastlines.

Some of the biggest advantages of the drone are the price point and the ability to hover. The ability to hover allows the UAV to track a specific turtle or monitor an isolated activity. A con to this platform is not made to fly in rain or snow (no weather resistance). Also, the flight time would be considerably lower than maximum on windy days. This is an important consideration since weather near the coastline is often not stable.

Image result for dji mavic pro platinum thermal   
Image provided by FLIR



Low Cost Fixed wing: Skywalker x8 with pixhawk 2 and sony   a6000. Aircraft all inclusive: $220, Pixhawk 2 and GPS: $330, Sony a7R: $909, folding props for more silent flying Aeronauts 12 x 8, $13.00 (about $1475).

As a low cost fixed wing option, a modified RC aircraft is likely the most cost effective option. While at first this option may seem non-ideal or even unprofessional versus proprietary options, a custom built aircraft can be very effective or even more effective when compared to proprietary choices. A strong recommendation is the Skywalker x8 fixed wing aircraft frame will all inclusive systems. The only hardware that would need to be purchased separate is an autopilot and GPS system, which we recommend the Pixhawk 2 open source autopilot platform and branded GPS Unit. This system is highly customizable and programmable for a variety of mission types, as well as highly supported with many users combining the system with the skywalker x8 platform. To take into consideration sound, foldable props are recommended as they are quieter than non-foldable propellers and can even be entirely silent at the time of image capture by programming in a temporary glide feature. Foldable propellers will fold in flight when low to zero thrust is applied and be entirely silent. We recommend Aeronauts 12 x 8 foldable propellers as a highly rated and fair priced choice.

For sensor considerations, we recommend the Sony a7R RGB mirrorless camera. As a negative, this sensor will work best during daylight situations, limiting use during prime turtle nesting time. However, nested sites can be delineated without the presence of adult turtles and from that information, total turtle count can be interpolated. The camera has a large sensor and very fast shutter speed making it ideal for mapping operations of coastline. The sensor is 24 megapixel from which, a very high spatial resolution can be achieved to find small features associated with turtle nests.

As far as aircraft performance, this aircraft is hand launched, or catapult launched, and can land in a deep stall condition or an installed parachute system. Long flight times of 30 minutes can likely be achieved without much difficulty. This would allow for sufficient coverage of coastline, likely covering a greater area than multi-rotor aircraft at the same price range. However, our suggested multi-rotor has the advantage of a thermal camera while remaining in the same price category. Perhaps the final assessment for deciding the appropriate aircraft in this price category will be an opportunity cost analysis of the importance of large survey area over thermal data advance. 


 Image result for skywalker x8

Image provided by FLIR

Medium Cost Drone Options

 
Medium Multi:  M600 Matrice Pro (~$5,000 from DJI) with  Zenmuse XT (~$4,500- $6,000 from various places)

For the medium price multi-rotor recommendation, the M600 Matrice Pro is suggested. The M600 was ideally made for industrial applications and is a relatively easy to fly UAV. This platform features a better battery life than the previous multi-rotor suggestion and can would be capable of tracking the sea turtles more efficiently.

For the sensor recommendation, the Zenmuse XT is well fitted for surveying wildlife. The sensor is within a mid-range price and has specs fit for the mission. According to DJI.com, The sensor can rotate 360 which would make the turtle populations easier to track from any direction. There is multiple different software that can work with this platform for mission planning such as DJI GO and XT Pro. Its transmission range is 5km and its max flight time is 35 minutes. The DJI Go software works well with this platform.

Some unique features of the M600 Matrice Pro platform with the Zenmuse XT is that it is a hexacopter and can hold 6 batteries. The batteries have a battery management system that ensures that all of them are working in sync. This is a great option for a mid-range priced UAV to track sea turtle operations.

Image result for matrice 600 zenmuse xt

Image by DJI


Medium Fixed:FireFLY6 PRO hybrid-fixed wing VTOL aircraft with FLIR Vuo PRO ($11,500 when purchased together from BirdsEyeView)

Combining the versatility of a multi-rotor option and the performance of a fixed wing aircraft is the next suggestion, he FireFLY6 PRO. This aircraft uses advanced flight control systems allowing it to takeoff and land vertically and then, once at altitude, low cost fixed wing option.

This aircraft should provide versatility in take off and landing similar to that of the multirotor option, but more care must be practiced in how this aircraft is oriented during landing if not being performed autonomously. Once operational the aircraft can cover more ground without changing batteries than multirotor options and land in smaller area than other fixed wing options. The aircraft has onboard lighting allowing for identification and orientation during night operations. This is a solid option for the large scale, minimal obstacle flights that would be required to track turtle populations.

The FLIR Vuo PRO sensor is our suggested package as it is a full thermal sensor capable of operation at night. This sensor will allow thermal gradient contrast and logged heat values for turtles allowing for very easy identification. The sensor could potentially work during the day because of the logging feature because, while turtles are cold blooded and could in theory match the temperature of their environment, there is likely to be some temperature difference as they are leaving cooler water for the hot beach and their bodies interact with solar radiation differently than sand. This sensor is the most capable so far on this list for monitoring wildlife. 

Image result for firefly 6 pro
Image by BirdsEyeView

High Cost Drone Options


High Multi: The Vanguard (aprox. $45,000)

Lastly, as the higher end option, The Vanguard by Airbornedrones is suggested. Typically labelled as a long range surveillance drone, this UAV has everything necessary for the survey mission. This drone is built for monitoring wildlife as a main function without any add ons. One of the top features of this UAV is that there is a low noise footprint.

Here are some of the specs for The Vanguard from airbournedrones.co. This UAV has a flight time of 94 which is the 2nd highest on this list of options. The aircraft has a 35 km range and can fly 18 meters per second. The aircraft can withstand winds up to 37 km/h. It comes with its own Skylink software system. The platform comes with JAR gimbal duel sensors (10xs optical and thermal). The sensors are water resistant, and they are perfect for high quality target tracking especially at night to record any reproduction tracking.

This platform had the most details and fits more requirements than any of the multirotors on this list. Some unique scecs of this platform is that its frame is water resistant. The aircraft features a virtual fence where you can control where to put safe zones. All in all, The Vanguard will be efficient at getting the mission performed.

Image result for vanguard drone
Image by Airbornedrones

High Fixed:     Penguin B  or BE (aprox. $50,000)  with UAV factory epsilon 135 night (Aprox $20,000): Total aprox $70,000

This option is very difficult to accurately price because the aircraft is highly customizable. Generally speaking, both aircraft option (Penguin B or Penguin BE) will likely cost about $50,000. This aircraft, while large is highly versatile. Due to sound considerations we are mostly going to discuss the Penguin BE, the electric propulsion version, as it is significantly quieter than the gas engine version, Penguin B. The only significant performance difference is flight time, so if the flight time of the BE aircraft is insufficient, we recommend considering the Penguin B.

The Penguin BE while more cumbersome to bring to a field site due to relatively large size, can be launched in a variety of ways making it an ideal candidate for the Hawaiian coastline. The aircraft can be launched via catapult, car mounting, or standard ground run takeoff. If the standard takeoff option is selected, the aircraft only needs 90 feet of “runway”. The aircraft is also waterproofed from rain, an important consideration on some parts of the Hawaiian island chain. The aircraft boasts the best flight time of all our options at 110 minutes at a high cruise speed of 22 m/s, allowing for a very large area to be covered adequately. Arrested, standard, and even car capture landings are possible with this system. As far as flight performance it is very capable.

The sensor we recommend is the epsilon 135 night IR sensor package. This sensor is made by the same developer of the Penguin series aircraft, UAV factory, and is designed to be utilized with the Penguin aircraft.   The sensor is gimbaled so that a sensor operator can utilize the sensor multi directionally while another crew member flies. However, with the piccolo autopilot features, the aircraft is famously possible to fly with one crew member that also utilizes the sensor gimbal. The sensor also actively tracks any target and processes all imagery onboard. Sea turtles could be actively tracked, hands free, so that a population inventory can be conducted extremely efficiently. The 640 x 480 infrared sensor with 60mm lense allows for high resolution tracking of turtles so that its species can be easily delineated when paired with the automatic video stabilization. The epsilon 135 when paired with the Penguin B can be an extremely efficient wildlife surveillance system.Image result for penguin BY drone 
Image by Pinterest User Elite Daily

Wednesday, September 5, 2018

UAS Dacum: Purdue UAS as Reference

A Dacum: Why is it important and why use it here ?

A dacum, which stands for development of curriculum model, is effectively a way to gauge what is important to a field and the considerations needed to correctly teach a subject. Being that one must understand a wide arrange of skills to utilize unmanned aircraft systems, a dacum is particularly useful for the field. Organization of critical skills, career outlooks, and classes that correctly cover topics is important to insure a full mosaic of necessary skills is achieved. In particular, what is important could be different between academic programs. Being that anything involving drones is multidisciplinary, and the academic body proposing a degree in unmanned aerial systems should desire to train experts, I suggest a perhaps unorthodox viewpoint. A major consideration in a dacum for a program should involve as many courses different from the departments strengths as possible. This is because too much of a deficit on any one skill can be harmful to students' careers, unless they are capable of easily building up those skills on their own. In theory, classes and general day to day interactions should easily develop skills in a departments strength within the student body; but significant effort must be placed to develop weaker skills. For example, an engineering program offering a UAS degree should put enhanced effort into operational considerations, a geography program should put effort into the aircraft construction and report aspect, and an aviation program should invest heavily into the geospatial component of UAS. Thus, being that this dacum is written for an aviation department, I emphasized the current lack of geospatial knowledge in the curriculum.

Here is a link to the Dacum:

https://purdue0-my.sharepoint.com/:w:/g/personal/ehockrid_purdue_edu/EbgCebHafClFvocDOv0N-wEBC27k9cywhyn4pPhV-0AItw?e=A8BJbG

It is important to note that the linked document is my modification on a class made version of the dacum that I contributed to. The only major differences are attempts to clean up categories that are perhaps repeats, very similar, and generally unclear. I also highlighted sections of the curriculum I feel are severely lacking. I will explain this further shortly.

Breaking Up the Model: Industry Trends

The first section is simply a list of industry trends. Some of these are specific uses for unmanned aircraft, others are developments in technologies or techniques that will impact drone users in coming years. Ultimately, people being educated on the subject should develop either a basal understanding of all the topics on the list, or be able to effectively utilize a UAS in any of the listed industries or tasks. While the list is not close to all encompassing, it is representative of skills that should be taught as part of a UAS collegiate education.

UAS Critical Skills and Knowledge

This section is a list of specific skill sets or knowledge bases students should have a handle on to excel in the UAS industry. It is important to understand students will have focuses and strengths and weaknesses, but a basic understanding is key. Across from the skills are lists of related classes. I would like to draw attention to the highlighted boxes in orange. These represent skills I feel are severely lacking as of now. Most namely computer programing, which is entirely absent. Other skills, such as remote sensing, are present in the course structure but definitely not enough. Basically, I feel the data aspects are not taught enough as of now. Ultimately, the final product customers will care about for UAS is the data product, not the aircraft itself. Students should be well versed in producing data based outcomes. Even students who intend to go into engineering should develop geospatial data skills because they need to understand what they are designing their platforms to do.


UAS Technician Key Duties 

 These are the primary tasks a UAS technician would accomplish within their job description. While many students may not go on to perform this specific job, it is fairly basal and broad, and certainly a role that many students could take. Thus, a great comparison job to understand if students are learning enough in their courses. The curriculum should in the least prepare students for all the tasks a UAS technician must accomplish. The category is split off further into sections such as operational consideration and maintenance. Once again, a technician can have a focus on any of the sub categories, but should reasonably be skilled in each. Looking through the potential tasks, there is certainly a discrepancy between the curriculum and the job regarding data related aspects and geospatial tasks. Ultimately, students need to have a fundamental understanding of how to handle the product that will ultimately be delivered to the final customer. This is something that is rarely touched on. Operating the aircraft, as well as maintaining it, are strong areas that the program currently prepares students for. However, as mentioned in the very beginning of this post, each student needs to be competent in all areas. Just as a technician would be useless if they could not fly, a technician is useless if they do not produce quality data.