EasyCV

An all-in-one toolkit for computer vision

alibaba
1799
205
Python

PyPI
Documentation Status
license
open issues
GitHub pull-requests
GitHub latest commit

EasyCV

English | 简体中文

Introduction

EasyCV is an all-in-one computer vision toolbox based on PyTorch, mainly focuses on self-supervised learning, transformer based models, and major CV tasks including image classification, metric-learning, object detection, pose estimation, and so on.

Major features

  • SOTA SSL Algorithms

    EasyCV provides state-of-the-art algorithms in self-supervised learning based on contrastive learning such as SimCLR, MoCO V2, Swav, DINO, and also MAE based on masked image modeling. We also provide standard benchmarking tools for ssl model evaluation.

  • Vision Transformers

    EasyCV aims to provide an easy way to use the off-the-shelf SOTA transformer models trained either using supervised learning or self-supervised learning, such as ViT, Swin Transformer, and DETR Series. More models will be added in the future. In addition, we support all the pretrained models from timm.

  • Functionality & Extensibility

    In addition to SSL, EasyCV also supports image classification, object detection, metric learning, and more areas will be supported in the future. Although covering different areas,
    EasyCV decomposes the framework into different components such as dataset, model and running hook, making it easy to add new components and combining it with existing modules.

    EasyCV provides simple and comprehensive interface for inference. Additionally, all models are supported on PAI-EAS, which can be easily deployed as online service and support automatic scaling and service monitoring.

  • Efficiency

    EasyCV supports multi-gpu and multi-worker training. EasyCV uses DALI to accelerate data io and preprocessing process, and uses TorchAccelerator and fp16 to accelerate training process. For inference optimization, EasyCV exports model using jit script, which can be optimized by PAI-Blade

What’s New

[🔥 2023.05.09]

  • 09/05/2023 EasyCV v0.11.0 was released.

[🔥 2023.03.06]

  • 06/03/2023 EasyCV v0.10.0 was released.
  • Add segmentation model STDC
  • Add skeleton based video recognition model STGCN
  • Support ReID and Multi-len MOT

[🔥 2023.01.17]

  • 17/01/2023 EasyCV v0.9.0 was released.
  • Support Single-lens MOT
  • Support video recognition (X3D, SWIN-video)

[🔥 2022.12.02]

  • 02/12/2022 EasyCV v0.8.0 was released.
  • bevformer-base NDS increased by 0.8 on nuscenes val, training speed increased by 10%, and inference speed increased by 40%.
  • Support Objects365 pretrain and Adding the DINO++ model can achieve an accuracy of 63.4mAP at a model scale of 200M(Under the same scale, the accuracy is the best).

[🔥 2022.08.31] We have released our YOLOX-PAI that achieves SOTA results within 40~50 mAP (less than 1ms). And we also provide a convenient and fast export/predictor api for end2end object detection. To get a quick start of YOLOX-PAI, click here!

  • 31/08/2022 EasyCV v0.6.0 was released.
    • Release YOLOX-PAI which achieves SOTA results within 40~50 mAP (less than 1ms)
    • Add detection algo DINO which achieves 58.5 mAP on COCO
    • Add mask2former algo
    • Releases imagenet1k, imagenet22k, coco, lvis, voc2012 data with BaiduDisk to accelerate downloading

Please refer to change_log.md for more details and history.

Technical Articles

We have a series of technical articles on the functionalities of EasyCV.

Installation

Please refer to the installation section in quick_start.md for installation.

Get Started

Please refer to quick_start.md for quick start. We also provides tutorials for more usages.

notebook

Model Zoo

Architectures
Self-Supervised Learning Image Classification Object Detection Segmentation Object Detection 3D
  • Instance Segmentation
  • Semantic Segmentation
  • Panoptic Segmentation
    		•

    Please refer to the following model zoo for more details.

    Data Hub

    EasyCV have collected dataset info for different scenarios, making it easy for users to finetune or evaluate models in EasyCV model zoo.

    Please refer to data_hub.md.

    License

    This project is licensed under the Apache License (Version 2.0). This toolkit also contains various third-party components and some code modified from other repos under other open source licenses. See the NOTICE file for more information.

    Contact

    This repo is currently maintained by PAI-CV team, you can contact us by

    Enterprise Service

    If you need EasyCV enterprise service support, or purchase cloud product services, you can contact us by DingDing Group.

    dingding_qrcode