Thank you for sending your enquiry! One of our team members will contact you shortly.
Thank you for sending your booking! One of our team members will contact you shortly.
Course Outline
Foundations of Audio Classification
- Types of sound events: environmental, mechanical, and human-generated.
- Overview of use cases: surveillance, monitoring, and automation.
- Differences between audio classification, detection, and segmentation.
Audio Data and Feature Extraction
- Types of audio files and their formats.
- Considerations for sampling rate, windowing, and frame size.
- Techniques for extracting MFCCs, chroma features, and mel-spectrograms.
Data Preparation and Annotation
- Utilization of datasets such as UrbanSound8K, ESC-50, and custom datasets.
- Labeling sound events and defining temporal boundaries.
- Strategies for balancing datasets and audio augmentation.
Building Audio Classification Models
- Application of Convolutional Neural Networks (CNNs) for audio data.
- Model inputs: comparing raw waveforms versus extracted features.
- Understanding loss functions, evaluation metrics, and managing overfitting.
Event Detection and Temporal Localization
- Strategies for frame-based and segment-based detection.
- Post-processing detections using thresholds and smoothing techniques.
- Visualizing predictions on audio timelines.
Advanced Topics and Real-Time Processing
- Applying transfer learning for scenarios with limited data.
- Deploying models using TensorFlow Lite or ONNX.
- Handling streaming audio processing and latency considerations.
Project Development and Application Scenarios
- Designing a complete pipeline from data ingestion to classification.
- Developing a proof-of-concept for surveillance, quality control, or monitoring.
- Implementing logging, alerting, and integration with dashboards or APIs.
Summary and Next Steps
Requirements
- A solid understanding of machine learning concepts and model training processes.
- Practical experience with Python programming and data preprocessing techniques.
- Familiarity with the fundamentals of digital audio.
Target Audience
- Data scientists.
- Machine learning engineers.
- Researchers and developers specializing in audio signal processing.
21 Hours
