research
∙
05/31/2023
Spectral Heterogeneous Graph Convolutions via Positive Noncommutative Polynomials
Heterogeneous Graph Neural Networks (HGNNs) have gained significant popu...
share
research
∙
02/21/2023
Label Information Enhanced Fraud Detection against Low Homophily in Graphs
Node classification is a substantial problem in graph-based fraud detect...
research
∙
02/20/2023
TA-MoE: Topology-Aware Large Scale Mixture-of-Expert Training
Sparsely gated Mixture-of-Expert (MoE) has demonstrated its effectivenes...
research
∙
11/04/2022
PP-YOLOE-R: An Efficient Anchor-Free Rotated Object Detector
Arbitrary-oriented object detection is a fundamental task in visual scen...
research
∙
11/01/2022
Efficient AlphaFold2 Training using Parallel Evoformer and Branch Parallelism
The accuracy of AlphaFold2, a frontier end-to-end structure prediction s...
research
∙
10/11/2022
PP-StructureV2: A Stronger Document Analysis System
A large amount of document data exists in unstructured form such as raw ...
research
∙
09/18/2022
ERNIE-mmLayout: Multi-grained MultiModal Transformer for Document Understanding
Recent efforts of multimodal Transformers have improved Visually Rich Do...
research
∙
08/17/2022
Boosting Distributed Training Performance of the Unpadded BERT Model
Pre-training models are an important tool in Natural Language Processing...
research
∙
07/14/2022
Large-scale Knowledge Distillation with Elastic Heterogeneous Computing Resources
Although more layers and more parameters generally improve the accuracy ...
research
∙
07/12/2022
HelixFold: An Efficient Implementation of AlphaFold2 using PaddlePaddle
Accurate protein structure prediction can significantly accelerate the d...
research
∙
06/07/2022
PP-OCRv3: More Attempts for the Improvement of Ultra Lightweight OCR System
Optical character recognition (OCR) technology has been widely used in v...
research
∙
05/20/2022
PaddleSpeech: An Easy-to-Use All-in-One Speech Toolkit
PaddleSpeech is an open-source all-in-one speech toolkit. It aims at fac...
research
∙
05/20/2022
SE-MoE: A Scalable and Efficient Mixture-of-Experts Distributed Training and Inference System
With the increasing diversity of ML infrastructures nowadays, distribute...
research
∙
05/19/2022
Nebula-I: A General Framework for Collaboratively Training Deep Learning Models on Low-Bandwidth Cloud Clusters
The ever-growing model size and scale of compute have attracted increasi...
research
∙
05/13/2022
Simple and Effective Relation-based Embedding Propagation for Knowledge Representation Learning
Relational graph neural networks have garnered particular attention to e...
research
∙
04/20/2022
PP-Matting: High-Accuracy Natural Image Matting
Natural image matting is a fundamental and challenging computer vision t...
research
∙
04/06/2022
PP-LiteSeg: A Superior Real-Time Semantic Segmentation Model
Real-world applications have high demands for semantic segmentation meth...
research
∙
12/23/2021
ERNIE 3.0 Titan: Exploring Larger-scale Knowledge Enhanced Pre-training for Language Understanding and Generation
Pre-trained language models have achieved state-of-the-art results in va...
research
∙
12/06/2021
End-to-end Adaptive Distributed Training on PaddlePaddle
Distributed training has become a pervasive and effective approach for t...
research
∙
11/20/2021
HeterPS: Distributed Deep Learning With Reinforcement Learning Based Scheduling in Heterogeneous Environments
Deep neural networks (DNNs) exploit many layers and a large number of pa...
research
∙
11/01/2021
PP-PicoDet: A Better Real-Time Object Detector on Mobile Devices
The better accuracy and efficiency trade-off has been a challenging prob...
research
∙
11/01/2021
PP-ShiTu: A Practical Lightweight Image Recognition System
In recent years, image recognition applications have developed rapidly. ...
research
∙
10/22/2021
Exploiting Cross-Modal Prediction and Relation Consistency for Semi-Supervised Image Captioning
The task of image captioning aims to generate captions directly from ima...
research
∙
09/07/2021
PP-OCRv2: Bag of Tricks for Ultra Lightweight OCR System
Optical Character Recognition (OCR) systems have been widely used in var...
research
∙
07/05/2021
ERNIE 3.0: Large-scale Knowledge Enhanced Pre-training for Language Understanding and Generation
Pre-trained models have achieved state-of-the-art results in various Nat...
research
∙
04/21/2021
PP-YOLOv2: A Practical Object Detector
Being effective and efficient is essential to an object detector for pra...
research
∙
03/10/2021
Beyond Self-Supervision: A Simple Yet Effective Network Distillation Alternative to Improve Backbones
Recently, research efforts have been concentrated on revealing how pre-t...
research
∙
05/08/2020
Distilling Knowledge from Pre-trained Language Models via Text Smoothing
This paper studies compressing pre-trained language models, like BERT (D...
research
∙
12/10/2019
How to Evaluate the Next System: Automatic Dialogue Evaluation from the Perspective of Continual Learning
Automatic dialogue evaluation plays a crucial role in open-domain dialog...
research
∙
06/22/2019