Group

Data management and processing tools / Feed

Conservation tech work doesn't stop after data is collected in the field. Equally as important to success is navigating data management and processing tools. For the many community members who deal with enormous datasets, this group will be an invaluable resource to trade advice, discuss workflows and tools, and share what works for you.

discussion

Drop-deployed HydroMoth

Hi all, I'm looking to deploy a HydroMoth, on a drop-deployed frame, from a stationary USV, alongside a suite of marine chemical sensors, to add biodiversity collection to our...

2 1

Hi Sol! This seems like an awesome project! I have a few questions in response: Where were you thinking of deploying this payload and for how long? 

Regarding hydromoth recorders, there have been several concerns that have popped up in my work with deploying the them at this depth because it's a contact type hydrophone which means it utilizes the case to transmit the sound vibrations of the marine soundscape to the microphone unlike the piezo element based hydrophones. 

  • At 30-60m you will likely have the case leak after an extended period of time if not immediately. The O-ring will deform at this depth, especially around the hinge of the housing. The square prism shape is not ideal for deep deployments you describe.  
  • After that depth and really starting at about 50m, a major concern is synthetic implosion from the small air pocket of the hydromoth not having a pressure release valve and lithium ion batteries getting exposed to salt water. This type of reaction would cause your other instruments to probably break or fail as well. 
  • You are unlikely to get a signal with a reinforced enclosure. The signal is generated via the material and geometry of the housing. The plastic will probably deform and mess with your frequency response and sound to noise ratio. If you place it against metal, it will dampen the sound quite a lot. We tried to do this, but the sensitivity is quite low with a large amount of self noise. 
  • A side not: for biodiversity assessments, the hydromoth is not characterized and is highly directional, so you wouldn't be able to compare sites through your standard aocustic indices like ACI and SPL.  

    That said if you are deploying for a short time, a hydrophone like an Aquarian H1a attached through a penetrator of a blue robotics housing that contains a field recorder like a zoom recorder may be optimal for half a day and be relatively cheaper than some of the other options. You could also add another battery pack in parrallel for a longer duration. 

     

Hi Matthew,

Thanks for your advice, this is really helpful!

I'm planning to use it in a seagrass meadow survey for a series of ~20 drops/sites to around 30 m, recording for around 10 minutes each time, in Cornwall, UK.

At this stage I reckon we won't exceed 30 m, but based on your advice, I think this sounds like not the best setup for the surveys we want to try.

We will try the Aquarian H1a, attached to the Zoom H1e unit, through a PVC case. This is what Aquarian recommended to me when I contacted them too.

Thanks for the advice, to be honest the software component is what I was most interested in when it came to the AudioMoth- is there any other open source software you would recommend for this?

Best wishes,

Sol
 

See full post
discussion

WILDLABS AWARDS 2024 - Underwater Passive Acoustic Monitoring (UPAM) for threatened Andean water frogs

In our project awarded with the "2024 WILDLABS Awards", we will develop the first Underwater Passive Acoustic Monitoring (UPAM) program to assess the conservation status and for...

4 10

This is so cool @Mauricio_Akmentins - congrats and look forward to seeing your project evolve!

See full post
discussion

SURAKHSYA Portal for Human-Elephant Conflict - any updates? 

Hi everyone, I'm looking into proven systems for managing human-wildlife conflict, particularly focused on early warning systems. I'm keen to hear of any examples from your...

5 0

Ha - you're already in my thread, i've got your project in there, don't worry! 

But it's more I don't want proof of concept early R&D type projects that are just destined for a paper or a hobby project, I want to hear about projects that have some plan for usability and scaling so that other people can take and implement them. 

I think that my system is likely the closest thing you will find in terms of production ready and potential to scale as it once was a commercial system with complete over the air updates more than 10 years ago. It’s been in use by many people for more than 10 years and has used AI triggering since 2019. I’m pretty sure no other system can claim that.


So I have the system but you got me on the scalability because to do that you need funding. I don’t have the funding. If I had the funding I’d be doing it full time. But I’ve said enough now. So I’ll leave it at that.

This thread is off-topic in this conversation, so happy to continue it in the other one. However, just noting - your system is one example, but not the only one - there are certainly other early warning systems in varying stages of development, testing and roll out, and using different levels of technology (ai or otherwise). 

See full post
article

The Variety Hour: 2024 Lineup

You’re invited to the WILDLABS Variety Hour, a monthly event that connects you to conservation tech's most exciting projects, research, and ideas. We can't wait to bring you a whole new season of speakers and...

1
See full post
event

Catch up with The Variety Hour: March 2024

Variety Hour is back! This month we're talking about making AI more accessible with Pytorch, new developments from WildMe and TagRanger, and working with geospatial data with Fauna & Flora. See you there!

3 10
Unfortunately, I can't be there. When will you upload the recording?    
See full post
discussion

Leveraging Actuarial Skills for Conservation Impact

Hello Wildlabs Community,I'm an experienced actuary with a deep passion for wildlife and conservation. With over 15 years in the insurance industry, I've honed my skills in data...

7 1
See full post
article

Navigating corporate due diligence in the Voluntary Carbon Market

Emerging trends for Nature-Based Solutions project assessments

4 1
Thanks, Cassie. How much is the annual license? I don't see it anywhere on your site.
See full post
discussion

Calculating Wingbeat Frequency From Accelerometer Data

Does anyone have any experience calculating WBF from ACC data? I'm trying to accomplish this in R. For the most part, I'm getting back pretty accurate number when going in to...

6 0

Great suggestion! Diving bird studies and their analyses are actually what has helped me get thus far with solving this problem. They happen to have done quite the same thing as I'm trying to do, just with more behaviors added. I believe the study was done with murres and kittiwakes.

 

Best,

Travis

I'm very close to solving the problem. Just waiting for a function to run on a fairly large dataset to see the results. I will share the repository link with you when it gets accomplished!

 

The species I'm working with roost atop cave ceiling as also drop from there to get airborne!

 

Yes, they are triaxial (Technosmart) and body mounted right on their backs.

 

So far, I have created thresholds for different metrics derived from the accelerometer data. Essentially, I sectioned out a bunch of ACC data where I am positive flight is occurring, and did the exact same with roosting, and crawling around/scratching(activity while roosting). From there, I plotted the distribution of all the metrics to see which metrics have unique distributions that were significantly different than roosting/activity.

Using those distributions, I created thresholds for the important metrics in which all flight behavior was either above or below a certain value for that metric. This got me to being able to construct a decision tree based on these metrics which had pretty solid accuracy.

 

The downside is a small chunk of flight from the beginning and end of flight bouts are not being included in the behavior classification. I noticed that their wbf during those small chunk are indicative of flight and am going to try and add wbf as the last decision on the tree to improve the accuracy of it.

 

VeDBA is also being included and calculated and based on the values for the thresholds I have created for flight it should not matter how high their head is, rather how low it is, when x y and z thresholds are also met. If that makes sense.

 

Hope I answered most of your questions!

Were you ever able to solve the problem? Interestingly enough, I begin a seal bio-logging study next year!

 

Also, you are correct. The errors were occurring during short bout flights as well as some spectral leakage, but I may have solved the problem by lower the window size. I've also corrected for the spectral leakage by creating a separate function that identifies any significant changes in calculated WBF that last < 2 seconds, then counts number of heave amplitudes within 1 second. I'm using an fft for the calculations and am just waiting for a function to run on a larger dataset to see if everything came out the way I am hoping for. Fingers crossed.

 

Best,

Travis

See full post
discussion

Image analysis with volunteers

Hello! I'm working with volunteers on a pilot project using camera traps and PAMs to monitor a mixed species waterbird colony on an Army Corps of Engineers constructed island....

2 0

I have a little experience with Timelapse and would say it is definetely worth the invested time.

The developer Saul Greenberg has made a ton of documentation on its use and is also very approachable in person, if you have any issues.

I can only highly recommend it.

 

 

See full post
discussion

Jupyter Notebook: Aquatic Computer Vision

Dive Into Underwater Computer Vision Exploration OceanLabs Seychelles is excited to share a Jupyter notebook tailored for those intrigued by the...

3 0

This is quite interesting. Would love to see if we could improve this code using custom models and alternative ways of processing the video stream. 

This definitely seems like the community to do it. I was looking at the thread about wolf detection and it seems like people here are no strangers to image classification. A little overwhelming to be quite honest 😂

While it would be incredible to have a powerful model that was capable of auto-classifying everything right away and storing all the detected creatures & correlated sensor data straight into a database - I wonder if in remote cases where power (and therefore cpu bandwidth), data storage, and network connectivity is at a premium if it would be more valuable to just be able to highlight moments of interest for lab analysis later? OR if you do you have cellular connection, you could download just those moments of interest and not hours and hours of footage? 

Am working on similar AI challenge at the moment. Hoping to translate my workflow to wolves in future if needed. 

We all are little overstretched but it there is no pressing deadlines, it should be possible to explore building efficient model for object detection and looking at suitable hardware for running these model on the edge. 

 

 

See full post
discussion

Need advice - image management and tagging 

Hello Wildlabs,Our botany team is using drones to survey vertical cliffs for rare and endangered plants. Its going well and we have been able to locate and map many new...

6 0

I have no familiarity with Lightroom, but the problem you describe seems like a pretty typical data storage and look up issue.  This is the kind of problem that many software engineers deal with on a daily bases.  In almost every circumstance this class of problem is solved using a database.

In fact, a potentially useful analysis is that the Lightroom database is not providing the feature set you need.

It seems likely that you are not looking for a software development project, and setting up you own DB would certainly require some effort, but if this is a serious issue for your work, you hope to scale your work up, or bring many other participants into your project, it might make sense to have an information system that better fits your needs.

There are many different databases out there optimized for different sorts of things.  For this I might suggest taking a look at MongoDB with GridFS for a couple of reasons.

  1. It looks like you meta data is in JSON format.  Many DBs are JSON compatible, but Mongo is JSON native.  It is especially good at storing and retrieving JSON data.  Its JSON search capabilities are excellent and easy to use.  It looks like you could export your data directly from Lightroom into Mongo, so it might be pretty easy actually.
  2. Mongo with the GridFS package is an excellent repository for arbitrarily large image files.
  3. It is straightforward to make a Mongo database accessible via a website.
  4. They are open source (in a manner of speaking) and you can run it for free.

Disclaimer: I used to work for MongoDB.  I don't anymore and I have no vested interest at all, but they make a great product that would really crush this whole class of problem.

See full post