Skip to content

Performance Degradation with YOLOv5 on CPU – Need Assistance in Improving FPS #61

@ranjith502

Description

@ranjith502

Dear play_with_tflite Contributors,

First and foremost, I would like to extend my sincere gratitude for your hard work in developing this library. It has been immensely beneficial to my learning journey, and I appreciate the clarity and quality of the code.

I am currently facing a performance issue while running YOLOv5lite on a CPU. I've made some modifications to main.cpp to enable camera support. Initially, the software runs as expected with a frame rate of approximately 10-12 FPS. However, after the first 10 frames, I observe a significant drop in performance, with FPS values plummeting to around 2-3 FPS.

This performance bottleneck is a critical issue for my project, as I aim to achieve near real-time processing speeds, ideally around 25 FPS, on a CPU-only setup. I understand that running advanced models like YOLOv5 exclusively on a CPU can be challenging, but I am seeking advice or potential optimizations that could help in improving the frame rate.

Screenshot from 2024-01-03 16-26-52
Screenshot from 2024-01-03 16-31-18

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions